-- Logs begin at Wed 2022-09-07 15:16:12 UTC, end at Wed 2022-09-07 16:11:35 UTC. -- Sep 07 15:41:26.255904 dv-cinder-853315-8-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 07 15:41:26.263724 dv-cinder-853315-8-smb devstack@keystone.service[81487]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 07 15:41:26.265717 dv-cinder-853315-8-smb devstack@keystone.service[81487]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 7 15:41:26 2022] *** Sep 07 15:41:26.265717 dv-cinder-853315-8-smb devstack@keystone.service[81487]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 07 15:41:26.265717 dv-cinder-853315-8-smb devstack@keystone.service[81487]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 07 15:41:26.265717 dv-cinder-853315-8-smb devstack@keystone.service[81487]: nodename: dv-cinder-853315-8-smb Sep 07 15:41:26.265717 dv-cinder-853315-8-smb devstack@keystone.service[81487]: machine: x86_64 Sep 07 15:41:26.265717 dv-cinder-853315-8-smb devstack@keystone.service[81487]: clock source: unix Sep 07 15:41:26.265717 dv-cinder-853315-8-smb devstack@keystone.service[81487]: pcre jit disabled Sep 07 15:41:26.266172 dv-cinder-853315-8-smb devstack@keystone.service[81487]: detected number of CPU cores: 4 Sep 07 15:41:26.266172 dv-cinder-853315-8-smb devstack@keystone.service[81487]: current working directory: / Sep 07 15:41:26.266172 dv-cinder-853315-8-smb devstack@keystone.service[81487]: detected binary path: /usr/bin/uwsgi-core Sep 07 15:41:26.266172 dv-cinder-853315-8-smb devstack@keystone.service[81487]: your processes number limit is 47680 Sep 07 15:41:26.266172 dv-cinder-853315-8-smb devstack@keystone.service[81487]: your memory page size is 4096 bytes Sep 07 15:41:26.266172 dv-cinder-853315-8-smb devstack@keystone.service[81487]: detected max file descriptor number: 2048 Sep 07 15:41:26.266172 dv-cinder-853315-8-smb devstack@keystone.service[81487]: lock engine: pthread robust mutexes Sep 07 15:41:26.266172 dv-cinder-853315-8-smb devstack@keystone.service[81487]: thunder lock: enabled Sep 07 15:41:26.266172 dv-cinder-853315-8-smb devstack@keystone.service[81487]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 07 15:41:26.266172 dv-cinder-853315-8-smb devstack@keystone.service[81487]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 07 15:41:26.306107 dv-cinder-853315-8-smb devstack@keystone.service[81487]: Python main interpreter initialized at 0x557c1fdf99c0 Sep 07 15:41:26.306107 dv-cinder-853315-8-smb devstack@keystone.service[81487]: python threads support enabled Sep 07 15:41:26.306107 dv-cinder-853315-8-smb devstack@keystone.service[81487]: your server socket listen backlog is limited to 100 connections Sep 07 15:41:26.306107 dv-cinder-853315-8-smb devstack@keystone.service[81487]: your mercy for graceful operations on workers is 90 seconds Sep 07 15:41:26.306497 dv-cinder-853315-8-smb devstack@keystone.service[81487]: mapped 403077 bytes (393 KB) for 2 cores Sep 07 15:41:26.306574 dv-cinder-853315-8-smb devstack@keystone.service[81487]: *** Operational MODE: preforking *** Sep 07 15:41:26.306801 dv-cinder-853315-8-smb devstack@keystone.service[81487]: *** uWSGI is running in multiple interpreter mode *** Sep 07 15:41:26.306801 dv-cinder-853315-8-smb devstack@keystone.service[81487]: spawned uWSGI master process (pid: 81487) Sep 07 15:41:26.307006 dv-cinder-853315-8-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 07 15:41:26.309307 dv-cinder-853315-8-smb devstack@keystone.service[81487]: spawned uWSGI worker 1 (pid: 81501, cores: 1) Sep 07 15:41:26.309307 dv-cinder-853315-8-smb devstack@keystone.service[81487]: spawned uWSGI worker 2 (pid: 81502, cores: 1) Sep 07 15:41:26.309307 dv-cinder-853315-8-smb devstack@keystone.service[81487]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 07 15:41:30.642934 dv-cinder-853315-8-smb devstack@keystone.service[81502]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 15:41:30.642934 dv-cinder-853315-8-smb devstack@keystone.service[81502]: from cryptography.utils import int_from_bytes Sep 07 15:41:30.643731 dv-cinder-853315-8-smb devstack@keystone.service[81502]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 15:41:30.643731 dv-cinder-853315-8-smb devstack@keystone.service[81502]: from cryptography.utils import int_from_bytes Sep 07 15:41:30.644059 dv-cinder-853315-8-smb devstack@keystone.service[81501]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 15:41:30.644059 dv-cinder-853315-8-smb devstack@keystone.service[81501]: from cryptography.utils import int_from_bytes Sep 07 15:41:30.644504 dv-cinder-853315-8-smb devstack@keystone.service[81501]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 15:41:30.644504 dv-cinder-853315-8-smb devstack@keystone.service[81501]: from cryptography.utils import int_from_bytes Sep 07 15:41:30.693851 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 07 15:41:30.694030 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 07 15:41:30.694247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] command line args: [] {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 07 15:41:30.694527 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 07 15:41:30.694707 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ================================================================================ {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 07 15:41:30.694792 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 07 15:41:30.694946 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 07 15:41:30.695030 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] admin_token = **** {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.695147 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] command line args: [] {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 07 15:41:30.695230 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] config_dir = [] {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.695374 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.695459 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 07 15:41:30.695558 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] config_source = [] {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.695634 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ================================================================================ {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 07 15:41:30.695739 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] debug = True {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.695822 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] admin_token = **** {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.695939 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.696201 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] config_dir = [] {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.696270 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.696328 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.696458 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] config_source = [] {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.696563 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.696669 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] debug = True {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.696774 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.696875 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.697000 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.697100 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.697212 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] list_limit = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.697312 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.697410 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] log_config_append = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.697508 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.697607 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.697699 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] log_dir = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.697797 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.697890 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] log_file = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.697995 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] list_limit = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.698094 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.698213 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] log_config_append = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.698335 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.698443 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.698543 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] log_dir = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.698659 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.698739 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] log_file = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.698850 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.698929 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.699060 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.699137 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.699256 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.699331 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.699447 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.700168 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.700398 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.700485 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.700611 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.700692 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.700806 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.700926 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.701008 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.701080 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.701150 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.701221 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.701333 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.701419 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.701545 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.701659 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.701792 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.701890 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.702046 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.702309 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.702445 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.702521 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] publish_errors = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.702633 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.702717 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.702942 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.703069 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.703152 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.703256 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] publish_errors = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.703357 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.703493 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.703591 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.703729 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.703824 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] standard_threads = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.703906 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.704048 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.704149 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.704292 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.704378 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.704456 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.704612 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] standard_threads = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.704689 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] use_journal = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.704797 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] use_json = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.704878 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.705004 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] use_stderr = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.705083 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.705154 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] use_syslog = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.705247 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.705355 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.705431 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] use_journal = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.705592 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] use_json = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.705670 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.705770 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] use_stderr = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.705845 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.705948 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] use_syslog = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.706087 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.706172 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 15:41:30.706365 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.706452 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.706618 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.706695 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.706860 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.706947 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.707111 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.707194 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.707354 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.707436 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.707605 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.707689 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.707856 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.707931 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.708099 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.708175 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.708336 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.708419 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.708586 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.708668 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.708824 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.708899 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.709069 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.709155 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.709316 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.709392 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.709553 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.709631 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.709806 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.709892 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.710058 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.710135 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.710325 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.710402 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.710567 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.710720 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.710824 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.710900 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.711072 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.711146 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.711313 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.711397 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.711566 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.711647 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.711803 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.711879 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.712039 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.712116 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.712273 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.712354 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.712519 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.712596 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.712755 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.712831 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.712991 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.713066 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.713230 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.713310 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.713463 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.713540 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.713713 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.713788 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.713944 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.714025 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.714195 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.714309 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.714452 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.714539 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.714686 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.714768 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.714926 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.715002 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.715246 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.715336 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.715504 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.715580 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.715810 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.715887 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.716047 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.716123 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.716281 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.716362 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.716518 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.716590 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.716739 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.716817 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.716975 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.717052 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.717214 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.717291 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.717448 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.717530 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.717689 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.717769 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.717924 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.718000 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.718155 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.718290 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.718420 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.718496 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.718662 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.718738 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.718903 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.718980 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.719143 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.719219 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.719380 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.719455 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.719619 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.719757 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.719871 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.719979 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.720076 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.720169 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.720311 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.720414 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.720546 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.720676 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.720780 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.720898 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.721029 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.721106 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.721271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.721358 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.721504 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.721596 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.721746 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.721832 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.721984 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.722058 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.722238 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.722330 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.722483 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.722560 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.722707 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.722821 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.722984 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.723069 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.723224 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.723299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.723464 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.723543 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.723703 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.723788 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.723944 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.724025 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.724184 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.724260 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.724422 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.724507 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.724666 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.724740 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.724906 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.724981 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.725150 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.725237 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.725387 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.725462 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.725626 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.725700 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.725862 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.725945 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.726102 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.726194 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.726367 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.726442 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.726612 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.726700 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.726856 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.726932 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.727098 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.727174 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.727339 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.727422 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.727579 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.727655 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.727822 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.727898 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.728061 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.728206 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.728301 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.728384 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.728538 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.728651 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.728771 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.728856 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.729002 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.729334 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.729488 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.729566 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.729721 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.729796 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.729951 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.730027 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.730198 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.730275 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.730444 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.730522 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.730677 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.730760 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.730950 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.731030 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.731210 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.731286 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.731475 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.731553 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.731718 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.731794 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.731954 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] auth.external = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.732035 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.732191 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.732278 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.732491 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.732578 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.732734 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] auth.external = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.732817 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.732966 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] auth.password = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.733042 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.733202 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] auth.token = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.733281 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.733444 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.733521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.733683 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.733761 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] auth.password = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.733932 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] auth.token = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.734120 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.734237 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.734312 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.734436 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.734523 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.734688 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.734766 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.734923 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.735000 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.735163 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] credential.caching = True {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.735240 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.735414 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.735492 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.735651 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.735727 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.735898 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] credential.caching = True {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.735974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.736141 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.736218 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.736388 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.736465 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.736627 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.736712 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.736876 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.736953 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.737128 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.737205 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.737366 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.737441 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.737618 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.737695 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.737880 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.737956 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.738124 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.738256 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.738411 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.738490 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.738654 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.738730 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.738915 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.738993 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.739157 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] federation.caching = True {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.739235 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.739399 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.739482 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.739648 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.739725 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.739901 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.739980 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] federation.caching = True {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.740134 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.740217 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.740384 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.740466 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.740624 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.740701 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.740863 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.740938 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.741108 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.741195 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.741348 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.741424 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.741593 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.741669 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.741838 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.741921 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.742075 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] identity.caching = True {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.742152 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.742354 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.742431 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.742605 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.742758 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.742834 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.742904 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] identity.caching = True {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.743071 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.743150 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.743325 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.743411 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.743561 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.743638 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.743799 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.743875 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.744050 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.744134 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.744285 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.744361 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.744527 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.744602 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.744761 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.744846 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.744996 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.745075 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.745244 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.745321 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.745478 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.745561 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.745715 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.745792 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.745964 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.746041 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.746236 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.746328 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.747018 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.747115 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.747259 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.747336 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.747520 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.747674 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.747798 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.747916 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.748044 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.748162 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.748287 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.748399 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.748524 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.748641 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.748766 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.748886 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.749002 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.749131 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.749243 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.749385 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.749493 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.749621 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.749736 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.749873 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.749989 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.750125 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.750247 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.750393 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.750502 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.750648 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.750755 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.750898 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.750982 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.751133 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.751234 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.751375 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.751490 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.751609 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.751727 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.751850 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.751972 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.752091 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.752209 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.752334 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.752453 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.752576 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.752697 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.752820 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.752943 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.753072 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.753187 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.753430 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.753515 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.753667 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.753744 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.753905 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.753982 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.754153 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.754261 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.754414 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.754492 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.754667 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.754781 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.754909 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.755041 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.755153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.755287 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.755389 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.user = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.755532 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.755633 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.755779 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.755897 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.756019 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.user = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.756133 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.756266 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.756385 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.756534 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.756636 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.756772 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.756886 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.757027 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.757125 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.757283 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.757361 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.757535 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.757612 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.757778 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.757855 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.758016 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.758093 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.758279 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.758359 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.758521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.758597 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.758764 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.758846 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.759012 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.759160 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.759236 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.759305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.759485 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.759561 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.759719 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.759797 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.759968 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.760044 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.760209 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.760287 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.760444 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.760519 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.760681 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.760757 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.760923 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.761011 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.761163 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.761239 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.761406 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.761483 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.761645 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.761723 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.761892 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.761969 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.762708 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.762816 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.763072 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.763199 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.763341 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.763463 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.763581 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.763707 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.763837 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.763951 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.764082 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.764203 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.764327 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.764449 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.764573 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.764687 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.764830 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.764927 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.765080 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.765157 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] resource.caching = True {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.765321 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.765400 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.765565 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.765642 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.765813 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] resource.caching = True {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.765890 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.766071 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.766151 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.766354 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.766433 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.766596 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.766674 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.766852 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.766932 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.767091 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.767168 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.767334 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.767411 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.767574 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] role.caching = True {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.767654 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.767816 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.767892 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] role.driver = sql {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.768052 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.768149 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.768295 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] role.caching = True {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.768378 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.768542 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.768619 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] role.driver = sql {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.768777 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.768861 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.769028 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.769104 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.769277 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.769355 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.769526 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.769612 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.769774 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.769852 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.770023 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.770098 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.770277 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.770371 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.770529 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.770606 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.770780 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.770857 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.771015 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.771100 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.771268 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.771345 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.771520 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.771664 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.771775 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.771903 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.772029 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.772157 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.772412 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.772489 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.772659 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.772747 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.772907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.772984 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.773146 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.773223 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.773405 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.773491 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.773658 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.773734 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.773895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.773971 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.774128 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.774253 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.774390 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.774468 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.774624 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.774712 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.774878 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.774956 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.775115 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.775191 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.775356 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.775433 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.775600 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.775677 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.775840 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.775917 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.776074 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.776150 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.776312 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] token.caching = True {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.776390 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.776553 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.776630 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.776789 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.776864 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.777030 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.777107 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] token.caching = True {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.777271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.777347 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.777522 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.777634 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.777853 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.777935 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.778143 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.778249 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.778460 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.778559 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.778714 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.778793 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.778955 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.779033 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.779197 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.779274 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.779436 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.779514 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.779686 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.779764 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.779961 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.780039 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.780195 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.780282 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.780441 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.780520 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.780709 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.780791 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.780945 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.781034 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] database.connection = **** {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.781196 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.781284 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.781445 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.781522 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.781686 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.781763 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] database.connection = **** {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.781930 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.782015 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.782169 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.782268 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.782431 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.782509 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.782670 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.782760 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.782916 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.782995 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.783152 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.783229 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.783392 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.783478 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.783635 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.783713 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.783872 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.783949 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.784111 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.784196 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.784347 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.784423 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.784586 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.784662 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.784819 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.784903 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.785062 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.785140 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.785301 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.785378 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.785473 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 07 15:41:30.785560 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.785768 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.786012 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 15:41:30.786208 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 07 15:41:30.815183 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:30.815414 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:30.815612 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:30.815696 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:30.815849 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:30.816079 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:30.823959 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:30.824508 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:30.853608 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:30.853840 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:30.854011 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:30.854526 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:30.908711 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:30.908936 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:30.958059 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:30.958314 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:30.958400 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:30.958635 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:31.113900 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:31.114091 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:31.114227 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:31.114313 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:31.114389 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:31.114461 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:31.114578 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:31.114674 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:31.114800 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:31.114882 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:31.115020 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:31.115101 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:31.138599 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:31.138835 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:31.138927 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:31.139070 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:31.139154 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:31.139301 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:31.139401 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:31.139525 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:31.139607 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:31.139742 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:31.139823 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:31.139959 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:31.140041 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:31.140177 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:31.151158 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:31.151465 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:31.164076 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:31.164188 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:31.164260 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:31.164368 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:31.164479 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:31.164602 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:31.164711 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:31.164828 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:31.164933 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:31.165047 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:31.165154 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:31.165266 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:31.165372 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:31.165482 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 15:41:31.182851 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.183065 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 07 15:41:31.183360 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.183445 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.183575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 07 15:41:31.183659 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 07 15:41:31.183887 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.184526 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.184665 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 07 15:41:31.184871 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.184953 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.185148 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.185340 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.185428 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.185607 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.185872 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.195100 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.195386 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.195468 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.195666 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.195749 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.195960 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.196044 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.196258 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.203213 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81501) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:41:31.203313 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:41:31.206111 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81501) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:41:31.206223 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:41:31.206430 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.206526 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.206721 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.206802 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.207009 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.207089 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.207298 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.207389 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.207564 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.207646 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.207837 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.207917 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.208111 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.208193 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.208386 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.208466 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.208664 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.208752 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.208936 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.209016 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.232227 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.232973 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.233688 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:41:31.233977 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.234479 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81501) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:41:31.234773 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.238641 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:41:31.238929 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.239213 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.239446 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81501) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:41:31.239737 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.240024 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.245473 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:41:31.245763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.246367 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81501) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:41:31.247269 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.251943 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:41:31.252244 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.252535 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.252825 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.252907 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81501) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:41:31.253108 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.253190 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.253389 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.253547 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.253664 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.253747 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.253935 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.254015 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.254323 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.254605 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.254879 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.270004 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.270317 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.270901 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.271187 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.274142 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:41:31.275083 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81501) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:41:31.277372 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.277703 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.278532 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.278840 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.281967 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:41:31.283080 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81501) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:41:31.285468 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:41:31.286735 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81501) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:41:31.288476 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.288782 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.289071 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.289359 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.289640 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.289939 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.290082 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.290415 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.290712 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.291006 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.291293 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.291602 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.306106 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:41:31.306423 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.306698 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.306966 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.307914 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81501) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:41:31.308211 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.308490 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.308763 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.314353 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.315898 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.316185 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.317429 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.317707 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.317797 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.319300 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.319587 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.320470 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:41:31.320760 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.321053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.321339 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.321728 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.322284 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81501) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:41:31.322585 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.322878 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.323170 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.323560 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.332851 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:41:31.333139 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.333426 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.333708 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.334091 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.334407 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.334693 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.334787 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81501) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:41:31.334992 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.335282 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.335573 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.335963 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.336252 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.336550 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.350636 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:41:31.352536 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81501) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:41:31.353515 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:41:31.355747 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81501) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:41:31.357200 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.358687 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.359398 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.360142 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:41:31.360429 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.360830 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.360912 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.362331 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81501) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:41:31.362620 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.363026 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.367167 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.368623 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:41:31.369361 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.370850 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81501) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:41:31.372027 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.372590 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.372887 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.373172 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.374301 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.374710 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.375007 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.375295 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.380994 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:41:31.381287 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.381582 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.383169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81501) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:41:31.383470 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.383761 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.388780 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:41:31.389068 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.389356 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.389641 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.389923 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.390225 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.390511 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.390812 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.390905 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81501) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 15:41:31.391089 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.391219 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.391364 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.391464 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.391647 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.391782 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.391926 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.392015 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.392219 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.392307 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.392497 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.392585 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.392783 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.393059 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.393331 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.393622 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.393898 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.394171 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.394475 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 15:41:31.426866 dv-cinder-853315-8-smb devstack@keystone.service[81502]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557c1fdf99c0 pid: 81502 (default app) Sep 07 15:41:31.429146 dv-cinder-853315-8-smb devstack@keystone.service[81501]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557c1fdf99c0 pid: 81501 (default app) Sep 07 15:41:31.430077 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b257aa-1c86-461d-a167-9a0e4dcdd664 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:31.430391 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b257aa-1c86-461d-a167-9a0e4dcdd664 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:31.430670 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b257aa-1c86-461d-a167-9a0e4dcdd664 None None] PATH_INFO: `/v3` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:31.435451 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Wed Sep 7 15:41:31 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:41:38.278302 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc523f-6bbd-4de3-8bef-329ae437cce9 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:38.278832 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc523f-6bbd-4de3-8bef-329ae437cce9 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:38.278999 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc523f-6bbd-4de3-8bef-329ae437cce9 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:38.283322 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:41:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:41:38.288528 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b9456-bf73-4367-9547-a7947baf2b22 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:38.289079 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b9456-bf73-4367-9547-a7947baf2b22 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:38.289079 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b9456-bf73-4367-9547-a7947baf2b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:38.360602 dv-cinder-853315-8-smb devstack@keystone.service[81502]: INFO dbcounter [None req-359b9456-bf73-4367-9547-a7947baf2b22 None None] Registered counter for database keystone Sep 07 15:41:38.379861 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG oslo_db.sqlalchemy.engines [None req-359b9456-bf73-4367-9547-a7947baf2b22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81502) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 15:41:38.386031 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writer thread running {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 15:41:38.566549 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG passlib.handlers.bcrypt [None req-359b9456-bf73-4367-9547-a7947baf2b22 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81502) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 07 15:41:38.566864 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG passlib.handlers.bcrypt [None req-359b9456-bf73-4367-9547-a7947baf2b22 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81502) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 07 15:41:38.624843 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-359b9456-bf73-4367-9547-a7947baf2b22 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:41:38.626482 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-359b9456-bf73-4367-9547-a7947baf2b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:41:38.752501 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:41:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 07 15:41:39.042675 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc523f-6bbd-4de3-8bef-329ae437cce9 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:41:39.112428 dv-cinder-853315-8-smb devstack@keystone.service[81501]: INFO dbcounter [None req-c7bc523f-6bbd-4de3-8bef-329ae437cce9 None None] Registered counter for database keystone Sep 07 15:41:39.134140 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG oslo_db.sqlalchemy.engines [None req-c7bc523f-6bbd-4de3-8bef-329ae437cce9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81501) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 15:41:39.140482 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writer thread running {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 15:41:39.259353 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc523f-6bbd-4de3-8bef-329ae437cce9 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:41:39.263658 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a43ba-6118-4f64-969d-d6051ac8c5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:41:39.264281 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a43ba-6118-4f64-969d-d6051ac8c5f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:39.264562 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a43ba-6118-4f64-969d-d6051ac8c5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:39.264836 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a43ba-6118-4f64-969d-d6051ac8c5f5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:39.272991 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a43ba-6118-4f64-969d-d6051ac8c5f5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:41:39.325505 dv-cinder-853315-8-smb devstack@keystone.service[81501]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c48a43ba-6118-4f64-969d-d6051ac8c5f5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 07 15:41:39.326038 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a43ba-6118-4f64-969d-d6051ac8c5f5 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:41:39.335183 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1324 bytes} [Wed Sep 7 15:41:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 07 15:41:39.341552 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b9456-bf73-4367-9547-a7947baf2b22 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:41:39.358198 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b9456-bf73-4367-9547-a7947baf2b22 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:41:39.362704 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c988b-fec8-4b4b-bd70-351452d67ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:41:39.363831 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c988b-fec8-4b4b-bd70-351452d67ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:39.364114 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c988b-fec8-4b4b-bd70-351452d67ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:39.364390 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c988b-fec8-4b4b-bd70-351452d67ae9 admin admin] PATH_INFO: `/v3/projects/ddba81771a254b1699bec72cf0d93f2d` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:39.365947 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c988b-fec8-4b4b-bd70-351452d67ae9 admin admin] RBAC: Authorizing `identity:get_project(project_id=ddba81771a254b1699bec72cf0d93f2d)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:41:39.419956 dv-cinder-853315-8-smb devstack@keystone.service[81502]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6f1c988b-fec8-4b4b-bd70-351452d67ae9 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 07 15:41:39.420304 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c988b-fec8-4b4b-bd70-351452d67ae9 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:41:39.424902 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 3/5] 10.222.0.16 () {56 vars in 1207 bytes} [Wed Sep 7 15:41:39 2022] GET /identity/v3/projects/ddba81771a254b1699bec72cf0d93f2d => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:41:41.538869 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d03c8-e498-40fb-8562-43acc4b06891 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:41.539379 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d03c8-e498-40fb-8562-43acc4b06891 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:41.539491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d03c8-e498-40fb-8562-43acc4b06891 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:41.544145 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 3/6] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:41:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:41:41.549499 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461378ce-c6a1-423a-a981-dad3d476c952 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:41.549915 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461378ce-c6a1-423a-a981-dad3d476c952 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:41.550054 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461378ce-c6a1-423a-a981-dad3d476c952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:41.570399 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-461378ce-c6a1-423a-a981-dad3d476c952 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:41:41.571935 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-461378ce-c6a1-423a-a981-dad3d476c952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:41:41.580496 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:41:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 07 15:41:41.854887 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d03c8-e498-40fb-8562-43acc4b06891 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:41:41.867618 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d03c8-e498-40fb-8562-43acc4b06891 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:41:41.871777 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c097c-fd9d-491b-8472-2ea20e07de34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:41:41.872375 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c097c-fd9d-491b-8472-2ea20e07de34 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:41.872653 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c097c-fd9d-491b-8472-2ea20e07de34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:41.872928 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c097c-fd9d-491b-8472-2ea20e07de34 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:41.880427 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7c097c-fd9d-491b-8472-2ea20e07de34 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:41:41.882226 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7c097c-fd9d-491b-8472-2ea20e07de34 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:41:41.891362 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1324 bytes} [Wed Sep 7 15:41:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 15:41:41.896764 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461378ce-c6a1-423a-a981-dad3d476c952 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:41:41.906547 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461378ce-c6a1-423a-a981-dad3d476c952 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:41:41.910947 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2792aa-2326-41c4-838d-d140dca7f98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:41:41.911844 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2792aa-2326-41c4-838d-d140dca7f98b admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:41.912143 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2792aa-2326-41c4-838d-d140dca7f98b admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:41.912426 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2792aa-2326-41c4-838d-d140dca7f98b admin admin] PATH_INFO: `/v3/users/939472ebcad74baeadd29e0d5a82843a` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:41.913748 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2792aa-2326-41c4-838d-d140dca7f98b admin admin] RBAC: Authorizing `identity:get_user(user_id=939472ebcad74baeadd29e0d5a82843a)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:41:41.915613 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2792aa-2326-41c4-838d-d140dca7f98b admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:41:41.917134 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 5/9] 10.222.0.16 () {56 vars in 1198 bytes} [Wed Sep 7 15:41:41 2022] GET /identity/v3/users/939472ebcad74baeadd29e0d5a82843a => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:41:44.117823 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee3740-5dfe-47f0-84bf-e0f74b58bebb None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:44.118409 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee3740-5dfe-47f0-84bf-e0f74b58bebb None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:44.118409 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee3740-5dfe-47f0-84bf-e0f74b58bebb None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:44.119775 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:41:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:41:44.125176 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274e787-72d3-4f44-ad69-22270608f0db None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:44.125605 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274e787-72d3-4f44-ad69-22270608f0db None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:44.125717 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274e787-72d3-4f44-ad69-22270608f0db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:44.144078 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-b274e787-72d3-4f44-ad69-22270608f0db None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:41:44.145263 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b274e787-72d3-4f44-ad69-22270608f0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:41:44.197958 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f66994-becc-4588-a192-e9c60768c5c6 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:44.198268 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f66994-becc-4588-a192-e9c60768c5c6 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:44.198547 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f66994-becc-4588-a192-e9c60768c5c6 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:44.200250 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 6/11] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:41:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:41:44.208071 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bad668-e0db-4ab8-8644-150417ffdeae None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:44.208365 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bad668-e0db-4ab8-8644-150417ffdeae None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:44.208639 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bad668-e0db-4ab8-8644-150417ffdeae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:44.230776 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 6/12] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:41:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:41:44.253345 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG passlib.handlers.bcrypt [None req-90bad668-e0db-4ab8-8644-150417ffdeae None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81501) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 07 15:41:44.253744 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG passlib.handlers.bcrypt [None req-90bad668-e0db-4ab8-8644-150417ffdeae None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81501) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 07 15:41:44.303081 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-90bad668-e0db-4ab8-8644-150417ffdeae None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:41:44.304578 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-90bad668-e0db-4ab8-8644-150417ffdeae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:41:44.402969 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 7/13] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:41:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:41:44.502205 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b274e787-72d3-4f44-ad69-22270608f0db None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:41:44.526979 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:41:44.610650 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b274e787-72d3-4f44-ad69-22270608f0db None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:41:44.645104 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7ef11-87c1-4709-a50e-0674f9fb837c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:41:44.645734 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7ef11-87c1-4709-a50e-0674f9fb837c None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:44.646014 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7ef11-87c1-4709-a50e-0674f9fb837c None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:44.646320 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7ef11-87c1-4709-a50e-0674f9fb837c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:44.657480 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a7ef11-87c1-4709-a50e-0674f9fb837c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:41:44.666308 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-59a7ef11-87c1-4709-a50e-0674f9fb837c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:41:44.666308 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:41:44.666308 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:41:44.666308 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:41:44.666308 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:41:44.666308 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:41:44.666308 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:41:44.666308 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:41:44.666308 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:41:44.666308 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:41:44.666308 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:41:44.666308 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:41:44.666308 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:41:44.666308 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:41:44.666308 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:41:44.666308 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:41:44.667375 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:41:44.667375 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:41:44.667375 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:41:44.667375 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:41:44.667375 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:41:44.667375 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:41:44.667375 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:41:44.667375 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:41:44.667375 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:41:44.667375 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:41:44.667375 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:41:44.667375 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:41:44.667375 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:41:44.667375 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:41:44.667375 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:41:44.667375 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:41:44.668403 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:41:44.668403 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:41:44.668403 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:41:44.668403 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:41:44.668403 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:41:44.668403 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:41:44.668403 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:41:44.668403 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:41:44.668403 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:41:44.668403 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:41:44.668403 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:41:44.668403 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:41:44.668403 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 7/14] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 7 15:41:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:41:44.669412 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bad668-e0db-4ab8-8644-150417ffdeae None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:41:44.675064 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7ef11-87c1-4709-a50e-0674f9fb837c None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:41:44.758655 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:41:44.770171 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bad668-e0db-4ab8-8644-150417ffdeae None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:41:44.773229 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:41:44.777392 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7ef11-87c1-4709-a50e-0674f9fb837c None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:41:44.808743 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b742c9-7825-4dae-9c73-d8bc4fc06dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:41:44.810242 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b742c9-7825-4dae-9c73-d8bc4fc06dfb None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:44.810526 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b742c9-7825-4dae-9c73-d8bc4fc06dfb None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:44.810803 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b742c9-7825-4dae-9c73-d8bc4fc06dfb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:44.812627 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c5e9b-b309-4f12-9a5c-b5a1a1591b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:41:44.813232 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c5e9b-b309-4f12-9a5c-b5a1a1591b5c None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:44.813518 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c5e9b-b309-4f12-9a5c-b5a1a1591b5c None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:44.813788 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c5e9b-b309-4f12-9a5c-b5a1a1591b5c None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:44.814481 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0c5e9b-b309-4f12-9a5c-b5a1a1591b5c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:41:44.814786 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0c5e9b-b309-4f12-9a5c-b5a1a1591b5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:41:44.816183 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0c5e9b-b309-4f12-9a5c-b5a1a1591b5c None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:41:44.828478 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 8/15] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:41:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:41:44.834076 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c5e9b-b309-4f12-9a5c-b5a1a1591b5c None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:41:44.880324 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b742c9-7825-4dae-9c73-d8bc4fc06dfb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:41:44.881773 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b742c9-7825-4dae-9c73-d8bc4fc06dfb None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:41:44.940496 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c5e9b-b309-4f12-9a5c-b5a1a1591b5c None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:41:44.973534 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9ff06-c2f5-4eff-a55f-156880cde664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:41:44.974155 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9ff06-c2f5-4eff-a55f-156880cde664 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:44.974464 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9ff06-c2f5-4eff-a55f-156880cde664 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:44.974735 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9ff06-c2f5-4eff-a55f-156880cde664 None admin] PATH_INFO: `/v3/users/939472ebcad74baeadd29e0d5a82843a` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:44.975862 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece9ff06-c2f5-4eff-a55f-156880cde664 None admin] RBAC: Authorizing `identity:get_user(user_id=939472ebcad74baeadd29e0d5a82843a)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:41:44.977303 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece9ff06-c2f5-4eff-a55f-156880cde664 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:41:44.978871 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 9/16] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 7 15:41:44 2022] GET /identity/v3/users/939472ebcad74baeadd29e0d5a82843a => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:41:44.982685 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 8/17] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:41:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:41:44.985453 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9ff06-c2f5-4eff-a55f-156880cde664 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:41:44.988110 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b742c9-7825-4dae-9c73-d8bc4fc06dfb None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:41:44.990887 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:41:45.000480 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:41:45.086585 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b742c9-7825-4dae-9c73-d8bc4fc06dfb None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:41:45.088847 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9ff06-c2f5-4eff-a55f-156880cde664 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:41:45.121491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770637f7-4d43-4308-bc73-aa6b21b23396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:41:45.122050 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a85d7-61b1-4c72-9f4f-3c4eb4b1b1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:41:45.122523 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a85d7-61b1-4c72-9f4f-3c4eb4b1b1ae None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:45.122618 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770637f7-4d43-4308-bc73-aa6b21b23396 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:45.122804 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a85d7-61b1-4c72-9f4f-3c4eb4b1b1ae None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:45.122904 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770637f7-4d43-4308-bc73-aa6b21b23396 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:45.123077 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a85d7-61b1-4c72-9f4f-3c4eb4b1b1ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:45.123170 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770637f7-4d43-4308-bc73-aa6b21b23396 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:45.124191 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752a85d7-61b1-4c72-9f4f-3c4eb4b1b1ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:41:45.125648 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752a85d7-61b1-4c72-9f4f-3c4eb4b1b1ae None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:41:45.127210 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 10/18] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:41:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:41:45.132996 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a85d7-61b1-4c72-9f4f-3c4eb4b1b1ae None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:41:45.142242 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770637f7-4d43-4308-bc73-aa6b21b23396 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:41:45.143727 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770637f7-4d43-4308-bc73-aa6b21b23396 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:41:45.162148 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-770637f7-4d43-4308-bc73-aa6b21b23396 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:41:45.162148 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:41:45.162148 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:41:45.162148 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:41:45.162148 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:41:45.162148 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:41:45.162148 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:41:45.162148 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:41:45.162148 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:41:45.162148 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:41:45.162148 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:41:45.162148 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:41:45.162148 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:41:45.162148 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:41:45.162148 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:41:45.162148 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:41:45.163058 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:41:45.163058 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:41:45.163058 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:41:45.163058 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:41:45.163058 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:41:45.163058 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:41:45.163058 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:41:45.163058 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:41:45.163058 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:41:45.163058 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:41:45.163058 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:41:45.163058 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:41:45.163058 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:41:45.163058 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:41:45.163058 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:41:45.163058 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:41:45.163058 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:41:45.163847 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:41:45.163847 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:41:45.163847 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:41:45.163847 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 9/19] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:41:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:41:45.169492 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770637f7-4d43-4308-bc73-aa6b21b23396 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:41:45.213877 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:41:45.226301 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:41:45.235469 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a85d7-61b1-4c72-9f4f-3c4eb4b1b1ae None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:41:45.269659 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580f491-0f72-44e4-8bff-4eff6b385fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:41:45.270295 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580f491-0f72-44e4-8bff-4eff6b385fc2 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:45.270584 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580f491-0f72-44e4-8bff-4eff6b385fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:45.270864 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580f491-0f72-44e4-8bff-4eff6b385fc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:45.271589 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e580f491-0f72-44e4-8bff-4eff6b385fc2 None admin] RBAC: Adding query filter params (role.id=61605ebf17e643258730e55bf6db15ad, scope.domain.id=default, user.id=939472ebcad74baeadd29e0d5a82843a) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:41:45.271900 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e580f491-0f72-44e4-8bff-4eff6b385fc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:41:45.273336 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e580f491-0f72-44e4-8bff-4eff6b385fc2 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:41:45.273841 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770637f7-4d43-4308-bc73-aa6b21b23396 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:41:45.280450 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 11/20] 10.222.0.16 () {56 vars in 1322 bytes} [Wed Sep 7 15:41:45 2022] GET /identity/v3/role_assignments?user.id=939472ebcad74baeadd29e0d5a82843a&scope.domain.id=default&role.id=61605ebf17e643258730e55bf6db15ad => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:41:45.311554 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b4f54d-5fcb-4f32-a985-77582dda8712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:41:45.312190 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4f54d-5fcb-4f32-a985-77582dda8712 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:45.312473 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4f54d-5fcb-4f32-a985-77582dda8712 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:45.312747 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4f54d-5fcb-4f32-a985-77582dda8712 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:45.313410 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b4f54d-5fcb-4f32-a985-77582dda8712 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:41:45.313721 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b4f54d-5fcb-4f32-a985-77582dda8712 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:41:45.315186 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b4f54d-5fcb-4f32-a985-77582dda8712 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:41:45.335430 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 10/21] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:41:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:41:47.788963 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b854e3-ad93-4166-9c45-018f0e3cde6e None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:47.789832 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b854e3-ad93-4166-9c45-018f0e3cde6e None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:47.790281 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b854e3-ad93-4166-9c45-018f0e3cde6e None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:47.791775 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 12/22] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:41:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:41:47.797669 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c627d-fe6a-454b-8bcd-51d908616b56 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:47.798497 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c627d-fe6a-454b-8bcd-51d908616b56 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:47.798922 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c627d-fe6a-454b-8bcd-51d908616b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:47.823239 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-343c627d-fe6a-454b-8bcd-51d908616b56 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:41:47.824522 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-343c627d-fe6a-454b-8bcd-51d908616b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:41:47.914098 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 11/23] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:41:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:41:48.270528 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5b140-9d86-4b24-98c1-a997a13366f0 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:48.271226 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5b140-9d86-4b24-98c1-a997a13366f0 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:48.271720 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5b140-9d86-4b24-98c1-a997a13366f0 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:48.273320 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 13/24] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:41:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:41:48.279935 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc64eb8d-572a-414f-a490-bd9d2e21d62c None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:48.280226 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc64eb8d-572a-414f-a490-bd9d2e21d62c None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:48.280501 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc64eb8d-572a-414f-a490-bd9d2e21d62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:48.304324 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-fc64eb8d-572a-414f-a490-bd9d2e21d62c None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:41:48.305508 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-fc64eb8d-572a-414f-a490-bd9d2e21d62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:41:48.331851 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c55498-b2cd-4985-98ae-d1e77ed24fdf None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:48.332473 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c55498-b2cd-4985-98ae-d1e77ed24fdf None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:48.332948 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c55498-b2cd-4985-98ae-d1e77ed24fdf None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:48.334501 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 14/25] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:41:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:41:48.339754 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03735625-9d96-4046-8967-1870b90478ea None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:48.340271 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03735625-9d96-4046-8967-1870b90478ea None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:48.341531 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03735625-9d96-4046-8967-1870b90478ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:48.373091 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:41:48.378592 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-03735625-9d96-4046-8967-1870b90478ea None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:41:48.379819 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-03735625-9d96-4046-8967-1870b90478ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:41:48.425797 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 12/26] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:41:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:41:48.426810 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc64eb8d-572a-414f-a490-bd9d2e21d62c None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:41:48.512655 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 15/27] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:41:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:41:48.608929 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc64eb8d-572a-414f-a490-bd9d2e21d62c None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:41:48.636107 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c044d5-30a1-4303-9ca6-0ca3709922bd None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:48.636394 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c044d5-30a1-4303-9ca6-0ca3709922bd None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:48.636922 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c044d5-30a1-4303-9ca6-0ca3709922bd None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:48.639020 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 16/28] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:41:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:41:48.644393 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4f8c6-a7f3-495f-86a6-90d28d9e40fa None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:48.644926 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4f8c6-a7f3-495f-86a6-90d28d9e40fa None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:48.645427 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4f8c6-a7f3-495f-86a6-90d28d9e40fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:48.660755 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ba6d0-b823-455d-866d-3570579ac7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:41:48.661495 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ba6d0-b823-455d-866d-3570579ac7ea None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:48.661712 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ba6d0-b823-455d-866d-3570579ac7ea None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:48.661991 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ba6d0-b823-455d-866d-3570579ac7ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:48.683035 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5ba6d0-b823-455d-866d-3570579ac7ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:41:48.683488 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-98a4f8c6-a7f3-495f-86a6-90d28d9e40fa None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:41:48.685289 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-98a4f8c6-a7f3-495f-86a6-90d28d9e40fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:41:48.689811 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-ce5ba6d0-b823-455d-866d-3570579ac7ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:41:48.689811 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:41:48.689811 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:41:48.689811 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:41:48.689811 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:41:48.689811 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:41:48.689811 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:41:48.689811 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:41:48.689811 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:41:48.689811 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:41:48.689811 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:41:48.689811 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:41:48.689811 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:41:48.689811 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:41:48.689811 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:41:48.689811 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:41:48.690722 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:41:48.690722 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:41:48.690722 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:41:48.690722 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:41:48.690722 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:41:48.690722 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:41:48.690722 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:41:48.690722 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:41:48.690722 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:41:48.690722 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:41:48.690722 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:41:48.690722 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:41:48.690722 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:41:48.690722 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:41:48.690722 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:41:48.690722 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:41:48.691504 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:41:48.691504 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:41:48.691504 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:41:48.691504 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:41:48.691504 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:41:48.691504 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:41:48.691504 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:41:48.691504 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:41:48.691504 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:41:48.691504 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:41:48.691504 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:41:48.691504 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:41:48.691504 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 13/29] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 7 15:41:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:41:48.696803 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ba6d0-b823-455d-866d-3570579ac7ea None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:41:48.784196 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:41:48.804454 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 17/30] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:41:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:41:48.881825 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a4f8c6-a7f3-495f-86a6-90d28d9e40fa None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:41:48.893868 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:41:48.900415 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ba6d0-b823-455d-866d-3570579ac7ea None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:41:48.969596 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47701610-d5d5-4691-88eb-b1357e132247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:41:48.970239 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47701610-d5d5-4691-88eb-b1357e132247 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:48.970524 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47701610-d5d5-4691-88eb-b1357e132247 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:48.970799 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47701610-d5d5-4691-88eb-b1357e132247 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:48.971474 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47701610-d5d5-4691-88eb-b1357e132247 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:41:48.971781 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47701610-d5d5-4691-88eb-b1357e132247 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:41:48.973183 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47701610-d5d5-4691-88eb-b1357e132247 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:41:48.998259 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 14/31] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:41:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:41:49.001691 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47701610-d5d5-4691-88eb-b1357e132247 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:41:49.081143 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a4f8c6-a7f3-495f-86a6-90d28d9e40fa None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:41:49.141222 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a395d26d-c734-4277-9c48-707282a6401a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:41:49.142126 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395d26d-c734-4277-9c48-707282a6401a None admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:49.142623 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395d26d-c734-4277-9c48-707282a6401a None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:49.143142 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395d26d-c734-4277-9c48-707282a6401a None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:49.144004 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a395d26d-c734-4277-9c48-707282a6401a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:41:49.145670 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a395d26d-c734-4277-9c48-707282a6401a None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:41:49.167989 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47701610-d5d5-4691-88eb-b1357e132247 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:41:49.170348 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:41:49.206937 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954563a1-ee84-4ce4-b919-dfb81be0a42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:41:49.207855 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954563a1-ee84-4ce4-b919-dfb81be0a42b None admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:49.208277 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954563a1-ee84-4ce4-b919-dfb81be0a42b None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:49.208691 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954563a1-ee84-4ce4-b919-dfb81be0a42b None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:49.209509 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954563a1-ee84-4ce4-b919-dfb81be0a42b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:41:49.211066 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954563a1-ee84-4ce4-b919-dfb81be0a42b None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:41:49.285883 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 18/32] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Sep 7 15:41:48 2022] POST /identity/v3/roles => generated 225 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 15:41:49.286934 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a395d26d-c734-4277-9c48-707282a6401a None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:41:49.340026 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 15/33] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Sep 7 15:41:48 2022] POST /identity/v3/roles => generated 219 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:41:49.342214 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954563a1-ee84-4ce4-b919-dfb81be0a42b None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:41:49.412998 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:41:49.467221 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954563a1-ee84-4ce4-b919-dfb81be0a42b None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:41:49.508207 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a395d26d-c734-4277-9c48-707282a6401a None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:41:49.508937 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb26d0-ceaa-4cfb-abf2-8236d0517c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:41:49.509836 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb26d0-ceaa-4cfb-abf2-8236d0517c04 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:49.510351 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb26d0-ceaa-4cfb-abf2-8236d0517c04 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:49.510856 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb26d0-ceaa-4cfb-abf2-8236d0517c04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:49.536291 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb26d0-ceaa-4cfb-abf2-8236d0517c04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:41:49.538281 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb26d0-ceaa-4cfb-abf2-8236d0517c04 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:41:49.562692 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-afbb26d0-ceaa-4cfb-abf2-8236d0517c04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:41:49.562692 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:41:49.562692 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:41:49.562692 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:41:49.562692 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:41:49.562692 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:41:49.562692 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:41:49.562692 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:41:49.562692 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:41:49.562692 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:41:49.562692 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:41:49.562692 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:41:49.562692 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:41:49.562692 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:41:49.562692 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:41:49.562692 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:41:49.563644 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:41:49.563644 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:41:49.563644 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:41:49.563644 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:41:49.563644 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:41:49.563644 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:41:49.563644 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:41:49.563644 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:41:49.563644 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:41:49.563644 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:41:49.563644 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:41:49.563644 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:41:49.563644 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:41:49.563644 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:41:49.563644 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:41:49.563644 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:41:49.563644 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:41:49.564425 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:41:49.564425 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:41:49.564425 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:41:49.566905 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 16/34] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:41:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:41:49.568076 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53154d0-bb5b-431d-8196-fee07e4ead50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:41:49.568736 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53154d0-bb5b-431d-8196-fee07e4ead50 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:49.569022 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53154d0-bb5b-431d-8196-fee07e4ead50 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:49.569299 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53154d0-bb5b-431d-8196-fee07e4ead50 None admin] PATH_INFO: `/v3/users/939472ebcad74baeadd29e0d5a82843a` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:49.569583 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb48427-3eb1-4155-9393-09edc6585f27 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:49.570160 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb48427-3eb1-4155-9393-09edc6585f27 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:49.570604 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53154d0-bb5b-431d-8196-fee07e4ead50 None admin] RBAC: Authorizing `identity:get_user(user_id=939472ebcad74baeadd29e0d5a82843a)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:41:49.570853 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb48427-3eb1-4155-9393-09edc6585f27 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:49.572243 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53154d0-bb5b-431d-8196-fee07e4ead50 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:41:49.572856 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 17/35] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:41:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:41:49.573771 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb48427-3eb1-4155-9393-09edc6585f27 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:41:49.574169 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 19/36] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 7 15:41:49 2022] GET /identity/v3/users/939472ebcad74baeadd29e0d5a82843a => generated 247 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:41:49.580295 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53154d0-bb5b-431d-8196-fee07e4ead50 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:41:49.595465 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:41:49.715634 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53154d0-bb5b-431d-8196-fee07e4ead50 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:41:49.720227 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb48427-3eb1-4155-9393-09edc6585f27 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:41:49.753127 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:41:49.756380 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0073d9-38d0-4cd3-99bb-93bf873e07e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:41:49.757006 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0073d9-38d0-4cd3-99bb-93bf873e07e7 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:49.757293 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0073d9-38d0-4cd3-99bb-93bf873e07e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:49.757564 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0073d9-38d0-4cd3-99bb-93bf873e07e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:49.758224 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0073d9-38d0-4cd3-99bb-93bf873e07e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:41:49.758533 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0073d9-38d0-4cd3-99bb-93bf873e07e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:41:49.759403 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b7404-d418-4b9a-87c0-6f064e576be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:41:49.759918 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0073d9-38d0-4cd3-99bb-93bf873e07e7 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:41:49.760050 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b7404-d418-4b9a-87c0-6f064e576be6 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:49.760341 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b7404-d418-4b9a-87c0-6f064e576be6 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:49.760625 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b7404-d418-4b9a-87c0-6f064e576be6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:49.761841 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b7404-d418-4b9a-87c0-6f064e576be6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:41:49.763726 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b7404-d418-4b9a-87c0-6f064e576be6 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:41:49.765297 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 20/37] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:41:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:41:49.766513 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca6964-268f-440c-b2de-1889cb11e1c9 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:49.766803 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca6964-268f-440c-b2de-1889cb11e1c9 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:49.767488 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca6964-268f-440c-b2de-1889cb11e1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:49.772202 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 18/38] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:41:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:41:49.773566 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd237bd1-4ddf-4885-9679-d0a5b8672161 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:49.773852 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd237bd1-4ddf-4885-9679-d0a5b8672161 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:49.774124 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd237bd1-4ddf-4885-9679-d0a5b8672161 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:49.775337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 19/39] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:41:49.776004 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd237bd1-4ddf-4885-9679-d0a5b8672161 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:41:49.791706 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-62ca6964-268f-440c-b2de-1889cb11e1c9 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:41:49.793248 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-62ca6964-268f-440c-b2de-1889cb11e1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:41:49.846529 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:41:49.863177 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 21/40] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:41:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:41:49.863979 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca6964-268f-440c-b2de-1889cb11e1c9 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:41:49.880241 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd237bd1-4ddf-4885-9679-d0a5b8672161 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:41:49.920896 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48481f50-2998-4e6f-886e-7223380826d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:41:49.921847 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48481f50-2998-4e6f-886e-7223380826d3 None admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:49.922134 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48481f50-2998-4e6f-886e-7223380826d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:49.922442 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48481f50-2998-4e6f-886e-7223380826d3 None admin] PATH_INFO: `/v3/domains/default/users/939472ebcad74baeadd29e0d5a82843a/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:49.925849 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48481f50-2998-4e6f-886e-7223380826d3 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=939472ebcad74baeadd29e0d5a82843a, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:41:49.927943 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48481f50-2998-4e6f-886e-7223380826d3 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:41:49.946135 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 20/41] 10.222.0.16 () {58 vars in 1361 bytes} [Wed Sep 7 15:41:49 2022] PUT /identity/v3/domains/default/users/939472ebcad74baeadd29e0d5a82843a/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:41:49.947371 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee6e7c-dc69-4023-aa8b-28966cbc381c None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:49.947666 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee6e7c-dc69-4023-aa8b-28966cbc381c None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:49.947942 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee6e7c-dc69-4023-aa8b-28966cbc381c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:49.971378 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-eeee6e7c-dc69-4023-aa8b-28966cbc381c None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:41:49.973029 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-eeee6e7c-dc69-4023-aa8b-28966cbc381c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:41:50.003070 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca6964-268f-440c-b2de-1889cb11e1c9 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:41:50.049975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:41:50.054901 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6452a010-3ac7-4728-949c-ea93b7564305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:41:50.055664 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452a010-3ac7-4728-949c-ea93b7564305 None admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:50.058199 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452a010-3ac7-4728-949c-ea93b7564305 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:50.058199 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452a010-3ac7-4728-949c-ea93b7564305 None admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:50.058673 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6452a010-3ac7-4728-949c-ea93b7564305 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:41:50.061251 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6452a010-3ac7-4728-949c-ea93b7564305 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:41:50.113710 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 22/42] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Sep 7 15:41:49 2022] POST /identity/v3/projects => generated 301 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:41:50.116857 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 21/43] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:41:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:41:50.147387 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6452a010-3ac7-4728-949c-ea93b7564305 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:41:50.375736 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6452a010-3ac7-4728-949c-ea93b7564305 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:41:50.399407 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee6e7c-dc69-4023-aa8b-28966cbc381c None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:41:50.416414 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38a67e-41d5-4975-8b91-3949f151dcd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:41:50.417005 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38a67e-41d5-4975-8b91-3949f151dcd8 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:50.417289 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38a67e-41d5-4975-8b91-3949f151dcd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:50.417564 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38a67e-41d5-4975-8b91-3949f151dcd8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:50.419216 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de38a67e-41d5-4975-8b91-3949f151dcd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:41:50.420675 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de38a67e-41d5-4975-8b91-3949f151dcd8 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:41:50.422479 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 23/44] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:41:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:41:50.427594 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38a67e-41d5-4975-8b91-3949f151dcd8 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:41:50.464743 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:41:50.482830 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:41:50.514505 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee6e7c-dc69-4023-aa8b-28966cbc381c None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:41:50.542620 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38a67e-41d5-4975-8b91-3949f151dcd8 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:41:50.551202 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6c280-521c-473f-8d54-18835f50d1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:41:50.551823 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6c280-521c-473f-8d54-18835f50d1fb None admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:50.552395 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6c280-521c-473f-8d54-18835f50d1fb None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:50.552395 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6c280-521c-473f-8d54-18835f50d1fb None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:50.553053 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e6c280-521c-473f-8d54-18835f50d1fb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:41:50.554460 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e6c280-521c-473f-8d54-18835f50d1fb None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:41:50.571053 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 22/45] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Sep 7 15:41:50 2022] POST /identity/v3/roles => generated 223 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 15:41:50.580169 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f36b0-4b0d-4621-af03-4cdb19a1ab16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:41:50.580944 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f36b0-4b0d-4621-af03-4cdb19a1ab16 None admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:50.581293 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f36b0-4b0d-4621-af03-4cdb19a1ab16 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:50.581639 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f36b0-4b0d-4621-af03-4cdb19a1ab16 None admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:50.582443 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607f36b0-4b0d-4621-af03-4cdb19a1ab16 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:41:50.584039 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607f36b0-4b0d-4621-af03-4cdb19a1ab16 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:41:50.616000 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 24/46] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Sep 7 15:41:50 2022] POST /identity/v3/projects => generated 312 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 15:41:52.216100 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cafbf27-0c5c-481e-b4e3-fe1a3a7c36c4 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:52.216602 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cafbf27-0c5c-481e-b4e3-fe1a3a7c36c4 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:52.216682 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cafbf27-0c5c-481e-b4e3-fe1a3a7c36c4 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:52.218018 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 23/47] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:41:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:41:52.223400 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b733b-4a81-4c10-8304-eedb6fdd235d None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:52.223789 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b733b-4a81-4c10-8304-eedb6fdd235d None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:52.223965 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b733b-4a81-4c10-8304-eedb6fdd235d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:52.242625 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-446b733b-4a81-4c10-8304-eedb6fdd235d None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:41:52.243810 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-446b733b-4a81-4c10-8304-eedb6fdd235d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:41:52.312637 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 25/48] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:41:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:41:52.578019 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cafbf27-0c5c-481e-b4e3-fe1a3a7c36c4 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:41:52.680426 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cafbf27-0c5c-481e-b4e3-fe1a3a7c36c4 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:41:52.702903 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:41:52.718012 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f87d28e-176f-4e3d-8eb7-9ff225f52734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:41:52.718679 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87d28e-176f-4e3d-8eb7-9ff225f52734 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:52.718964 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87d28e-176f-4e3d-8eb7-9ff225f52734 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:52.719238 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87d28e-176f-4e3d-8eb7-9ff225f52734 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:52.729658 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f87d28e-176f-4e3d-8eb7-9ff225f52734 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:41:52.735314 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-1f87d28e-176f-4e3d-8eb7-9ff225f52734 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:41:52.735314 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:41:52.735314 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:41:52.735314 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:41:52.735314 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:41:52.735314 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:41:52.735314 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:41:52.735314 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:41:52.735314 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:41:52.735314 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:41:52.735314 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:41:52.735314 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:41:52.735314 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:41:52.735314 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:41:52.735314 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:41:52.735314 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:41:52.736404 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:41:52.736404 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:41:52.736404 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:41:52.736404 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:41:52.736404 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:41:52.736404 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:41:52.736404 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:41:52.736404 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:41:52.736404 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:41:52.736404 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:41:52.736404 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:41:52.736404 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:41:52.736404 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:41:52.736404 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:41:52.736404 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:41:52.736404 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:41:52.737172 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:41:52.737172 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:41:52.737172 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:41:52.737172 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:41:52.737172 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:41:52.737172 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:41:52.737172 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:41:52.737172 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:41:52.737172 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:41:52.737172 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:41:52.737172 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:41:52.737172 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:41:52.737172 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 24/49] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 7 15:41:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:41:52.742161 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b733b-4a81-4c10-8304-eedb6fdd235d None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:41:52.773006 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:41:52.801805 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d554ea-5d4b-477d-85a8-933d292b1483 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:52.802100 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d554ea-5d4b-477d-85a8-933d292b1483 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:52.802405 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d554ea-5d4b-477d-85a8-933d292b1483 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:52.803737 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 25/50] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:41:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:41:52.808507 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0a6ad-1300-4bb4-9f31-5c4080cdf0c0 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:52.808792 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0a6ad-1300-4bb4-9f31-5c4080cdf0c0 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:52.809069 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0a6ad-1300-4bb4-9f31-5c4080cdf0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:52.827043 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-b3c0a6ad-1300-4bb4-9f31-5c4080cdf0c0 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:41:52.828295 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-b3c0a6ad-1300-4bb4-9f31-5c4080cdf0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:41:52.846670 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b733b-4a81-4c10-8304-eedb6fdd235d None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:41:52.881012 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574038e2-21ae-4266-b8c0-ae6f64ec433f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:41:52.881635 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574038e2-21ae-4266-b8c0-ae6f64ec433f None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:52.881922 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574038e2-21ae-4266-b8c0-ae6f64ec433f None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:52.882226 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574038e2-21ae-4266-b8c0-ae6f64ec433f None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:52.882906 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574038e2-21ae-4266-b8c0-ae6f64ec433f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:41:52.883217 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574038e2-21ae-4266-b8c0-ae6f64ec433f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:41:52.884617 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574038e2-21ae-4266-b8c0-ae6f64ec433f None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:41:52.892839 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 26/51] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:41:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:41:52.896615 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 26/52] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:41:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:41:52.898671 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574038e2-21ae-4266-b8c0-ae6f64ec433f None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:41:52.990474 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:41:52.998243 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574038e2-21ae-4266-b8c0-ae6f64ec433f None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:41:53.032063 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b10f8-c860-43c2-bdd1-b8e3720d6040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:41:53.032708 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b10f8-c860-43c2-bdd1-b8e3720d6040 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:53.032995 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b10f8-c860-43c2-bdd1-b8e3720d6040 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:53.033281 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b10f8-c860-43c2-bdd1-b8e3720d6040 None admin] PATH_INFO: `/v3/users/939472ebcad74baeadd29e0d5a82843a` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:53.034487 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b10f8-c860-43c2-bdd1-b8e3720d6040 None admin] RBAC: Authorizing `identity:get_user(user_id=939472ebcad74baeadd29e0d5a82843a)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:41:53.035939 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b10f8-c860-43c2-bdd1-b8e3720d6040 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:41:53.037692 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 27/53] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 7 15:41:52 2022] GET /identity/v3/users/939472ebcad74baeadd29e0d5a82843a => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:41:53.043050 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0a6ad-1300-4bb4-9f31-5c4080cdf0c0 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:41:53.179179 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b10f8-c860-43c2-bdd1-b8e3720d6040 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:41:53.245303 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0a6ad-1300-4bb4-9f31-5c4080cdf0c0 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:41:53.257023 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:41:53.280580 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b10f8-c860-43c2-bdd1-b8e3720d6040 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:41:53.281073 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a51ab4-8863-4737-adf7-ccdbb89822d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:41:53.281417 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a51ab4-8863-4737-adf7-ccdbb89822d9 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:53.281734 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a51ab4-8863-4737-adf7-ccdbb89822d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:53.282018 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a51ab4-8863-4737-adf7-ccdbb89822d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:53.283171 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a51ab4-8863-4737-adf7-ccdbb89822d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:41:53.285000 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a51ab4-8863-4737-adf7-ccdbb89822d9 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:41:53.286609 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 27/54] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:41:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:41:53.292559 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a51ab4-8863-4737-adf7-ccdbb89822d9 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:41:53.314820 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b825fc-f956-4098-bb50-d00bc26db49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:41:53.315473 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b825fc-f956-4098-bb50-d00bc26db49c None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:53.315768 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b825fc-f956-4098-bb50-d00bc26db49c None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:53.316052 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b825fc-f956-4098-bb50-d00bc26db49c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:53.317242 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b825fc-f956-4098-bb50-d00bc26db49c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:41:53.319854 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b825fc-f956-4098-bb50-d00bc26db49c None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:41:53.322951 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 28/55] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:41:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:41:53.329140 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b825fc-f956-4098-bb50-d00bc26db49c None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:41:53.362124 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:41:53.394419 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a51ab4-8863-4737-adf7-ccdbb89822d9 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:41:53.428024 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618fa98c-40ce-45df-80a6-f8e470d0fda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:41:53.428635 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fa98c-40ce-45df-80a6-f8e470d0fda0 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:53.428916 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fa98c-40ce-45df-80a6-f8e470d0fda0 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:53.429249 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fa98c-40ce-45df-80a6-f8e470d0fda0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:53.429906 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618fa98c-40ce-45df-80a6-f8e470d0fda0 None admin] RBAC: Adding query filter params (role.id=61605ebf17e643258730e55bf6db15ad, scope.domain.id=default, user.id=939472ebcad74baeadd29e0d5a82843a) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:41:53.430241 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618fa98c-40ce-45df-80a6-f8e470d0fda0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:41:53.431670 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618fa98c-40ce-45df-80a6-f8e470d0fda0 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:41:53.431888 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b825fc-f956-4098-bb50-d00bc26db49c None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:41:53.439850 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 28/56] 10.222.0.16 () {56 vars in 1322 bytes} [Wed Sep 7 15:41:53 2022] GET /identity/v3/role_assignments?user.id=939472ebcad74baeadd29e0d5a82843a&scope.domain.id=default&role.id=61605ebf17e643258730e55bf6db15ad => generated 530 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:41:53.468724 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead81c9-107e-47c5-8b06-fc553c559920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:41:53.469359 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead81c9-107e-47c5-8b06-fc553c559920 None admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:53.469644 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead81c9-107e-47c5-8b06-fc553c559920 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:53.469923 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead81c9-107e-47c5-8b06-fc553c559920 None admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:53.470637 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ead81c9-107e-47c5-8b06-fc553c559920 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:41:53.472128 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ead81c9-107e-47c5-8b06-fc553c559920 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:41:53.501301 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 29/57] 10.222.0.16 () {60 vars in 1140 bytes} [Wed Sep 7 15:41:53 2022] POST /identity/v3/projects => generated 298 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 15:41:55.671597 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7b544-6dff-4961-aa81-065935b3a23d None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:55.672112 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7b544-6dff-4961-aa81-065935b3a23d None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:55.672197 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7b544-6dff-4961-aa81-065935b3a23d None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:55.673485 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 29/58] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:41:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:41:55.678719 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c41a15-4ea4-44a4-b2f1-1b8cd4f36d8c None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:55.679123 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c41a15-4ea4-44a4-b2f1-1b8cd4f36d8c None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:55.679278 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c41a15-4ea4-44a4-b2f1-1b8cd4f36d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:55.697806 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-f9c41a15-4ea4-44a4-b2f1-1b8cd4f36d8c None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:41:55.699044 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-f9c41a15-4ea4-44a4-b2f1-1b8cd4f36d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:41:55.764082 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 30/59] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:41:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:41:56.032228 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7b544-6dff-4961-aa81-065935b3a23d None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:41:56.076242 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:41:56.132081 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7b544-6dff-4961-aa81-065935b3a23d None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:41:56.165159 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b0fd2-a47e-4c72-98e4-21ea90a7d8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:41:56.165782 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b0fd2-a47e-4c72-98e4-21ea90a7d8be None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:56.166062 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b0fd2-a47e-4c72-98e4-21ea90a7d8be None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:56.166376 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b0fd2-a47e-4c72-98e4-21ea90a7d8be None admin] PATH_INFO: `/v3/domains/default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:56.167479 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b0fd2-a47e-4c72-98e4-21ea90a7d8be None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:41:56.168931 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b0fd2-a47e-4c72-98e4-21ea90a7d8be None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:41:56.170498 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 30/60] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:41:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:41:56.176042 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c41a15-4ea4-44a4-b2f1-1b8cd4f36d8c None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:41:56.189849 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:41:56.280355 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c41a15-4ea4-44a4-b2f1-1b8cd4f36d8c None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:41:56.314818 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625bf71e-3c46-42a9-a4a9-d817408bb3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:41:56.315361 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bf71e-3c46-42a9-a4a9-d817408bb3b7 None admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:56.315645 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bf71e-3c46-42a9-a4a9-d817408bb3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:56.315923 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bf71e-3c46-42a9-a4a9-d817408bb3b7 None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:56.316587 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625bf71e-3c46-42a9-a4a9-d817408bb3b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:41:56.318043 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625bf71e-3c46-42a9-a4a9-d817408bb3b7 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:41:56.344230 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 31/61] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Sep 7 15:41:56 2022] POST /identity/v3/users => generated 275 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:41:59.633475 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a43b0e-6172-47a1-b06c-c7f07d0928ce None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:59.634544 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a43b0e-6172-47a1-b06c-c7f07d0928ce None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:59.635078 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a43b0e-6172-47a1-b06c-c7f07d0928ce None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:59.636892 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 31/62] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:41:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:41:59.649953 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a85909-3e1d-4c2a-b3fc-49189d9561ff None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:41:59.650870 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a85909-3e1d-4c2a-b3fc-49189d9561ff None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:41:59.651359 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a85909-3e1d-4c2a-b3fc-49189d9561ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:41:59.679191 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-c3a85909-3e1d-4c2a-b3fc-49189d9561ff None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:41:59.680773 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-c3a85909-3e1d-4c2a-b3fc-49189d9561ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:41:59.759681 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:41:59.771834 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 32/63] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:41:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:42:00.098421 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda71b7c-bbca-487d-b839-e62027fb7cc5 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:00.099024 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda71b7c-bbca-487d-b839-e62027fb7cc5 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:00.099485 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda71b7c-bbca-487d-b839-e62027fb7cc5 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:00.101260 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 32/64] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:42:00.107322 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae229c-6d19-4ea4-aee4-0d0ddbe1952d None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:00.107997 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae229c-6d19-4ea4-aee4-0d0ddbe1952d None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:00.108501 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae229c-6d19-4ea4-aee4-0d0ddbe1952d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:00.135224 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-b4ae229c-6d19-4ea4-aee4-0d0ddbe1952d None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:00.136764 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b4ae229c-6d19-4ea4-aee4-0d0ddbe1952d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:00.144397 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c079b-b61b-46bb-84ee-00262b0c9b3d None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:00.144983 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c079b-b61b-46bb-84ee-00262b0c9b3d None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:00.145507 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c079b-b61b-46bb-84ee-00262b0c9b3d None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:00.147313 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 33/65] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:42:00.152089 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de82f8-7585-4f0b-96c5-2877fbf76692 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:00.152391 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de82f8-7585-4f0b-96c5-2877fbf76692 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:00.153716 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de82f8-7585-4f0b-96c5-2877fbf76692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:00.178748 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-c6de82f8-7585-4f0b-96c5-2877fbf76692 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:00.180327 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-c6de82f8-7585-4f0b-96c5-2877fbf76692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:00.219950 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 33/66] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:42:00.226811 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae229c-6d19-4ea4-aee4-0d0ddbe1952d None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:00.319811 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 34/67] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:42:00.343463 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae229c-6d19-4ea4-aee4-0d0ddbe1952d None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:00.374491 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:00.389111 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7d960-ef5c-4308-a680-54c39a04d186 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:00.389701 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7d960-ef5c-4308-a680-54c39a04d186 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:00.389803 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1db4f5-883a-4dbe-89e1-c9de8013609a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:00.390353 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7d960-ef5c-4308-a680-54c39a04d186 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:00.390552 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1db4f5-883a-4dbe-89e1-c9de8013609a None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:00.390718 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1db4f5-883a-4dbe-89e1-c9de8013609a None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:00.390999 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1db4f5-883a-4dbe-89e1-c9de8013609a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:00.392459 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 35/68] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:42:00.397721 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc73bc9-7837-40b2-bead-f10a007740ac None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:00.398322 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc73bc9-7837-40b2-bead-f10a007740ac None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:00.398806 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc73bc9-7837-40b2-bead-f10a007740ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:00.410787 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1db4f5-883a-4dbe-89e1-c9de8013609a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:42:00.416008 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-6d1db4f5-883a-4dbe-89e1-c9de8013609a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:42:00.416008 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:00.416008 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:42:00.416008 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:42:00.416008 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:42:00.416008 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:42:00.416008 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:42:00.416008 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:42:00.416008 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:42:00.416008 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:42:00.416008 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:42:00.416008 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:42:00.416008 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:42:00.416008 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:42:00.416008 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:42:00.416008 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:42:00.416860 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:42:00.416860 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:42:00.416860 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:42:00.416860 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:42:00.416860 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:42:00.416860 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:42:00.416860 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:42:00.416860 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:42:00.416860 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:42:00.416860 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:42:00.416860 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:42:00.416860 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:42:00.416860 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:42:00.416860 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:42:00.416860 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:42:00.416860 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:42:00.417646 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:42:00.417646 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:42:00.417646 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:42:00.417646 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:42:00.417646 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:42:00.417646 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:42:00.417646 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:42:00.417646 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:42:00.417646 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:42:00.417646 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:42:00.417646 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:42:00.417646 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:42:00.417646 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 34/69] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:42:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:42:00.421659 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-3fc73bc9-7837-40b2-bead-f10a007740ac None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:00.423322 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1db4f5-883a-4dbe-89e1-c9de8013609a None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:00.423692 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-3fc73bc9-7837-40b2-bead-f10a007740ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:00.472440 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:00.508951 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 36/70] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:42:00.518647 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c787555-6409-4c9f-aeae-d3a6224d3516 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:00.519206 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c787555-6409-4c9f-aeae-d3a6224d3516 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:00.519714 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c787555-6409-4c9f-aeae-d3a6224d3516 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:00.521556 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 37/71] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:00 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:42:00.537427 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9bb668-458b-480e-9cc1-c26290824229 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:00.538031 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9bb668-458b-480e-9cc1-c26290824229 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:00.538547 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9bb668-458b-480e-9cc1-c26290824229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:00.564213 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-9f9bb668-458b-480e-9cc1-c26290824229 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:00.564859 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1db4f5-883a-4dbe-89e1-c9de8013609a None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:00.565988 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-9f9bb668-458b-480e-9cc1-c26290824229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:00.610646 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0495cd1f-ee54-4ae8-938d-e10fc3c71c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:00.611186 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495cd1f-ee54-4ae8-938d-e10fc3c71c07 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:00.611472 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495cd1f-ee54-4ae8-938d-e10fc3c71c07 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:00.611753 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495cd1f-ee54-4ae8-938d-e10fc3c71c07 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:00.612885 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0495cd1f-ee54-4ae8-938d-e10fc3c71c07 None admin] RBAC: Adding query filter params (name=member) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:00.613196 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0495cd1f-ee54-4ae8-938d-e10fc3c71c07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:00.615340 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0495cd1f-ee54-4ae8-938d-e10fc3c71c07 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:00.626624 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 35/72] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 7 15:42:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:42:00.631017 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0495cd1f-ee54-4ae8-938d-e10fc3c71c07 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:00.645738 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 38/73] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:42:00.646840 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9bb668-458b-480e-9cc1-c26290824229 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:00.698665 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:00.768455 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0495cd1f-ee54-4ae8-938d-e10fc3c71c07 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:00.771978 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:00.776318 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9bb668-458b-480e-9cc1-c26290824229 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:00.814006 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47cba2-384c-463e-a70d-e0e4d2c1bef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:00.815242 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47cba2-384c-463e-a70d-e0e4d2c1bef4 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:00.816141 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47cba2-384c-463e-a70d-e0e4d2c1bef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:00.816422 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47cba2-384c-463e-a70d-e0e4d2c1bef4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:00.820908 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af03c0f-d10d-43fe-bb93-9b066b13a8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:00.821552 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af03c0f-d10d-43fe-bb93-9b066b13a8ce None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:00.821834 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af03c0f-d10d-43fe-bb93-9b066b13a8ce None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:00.822112 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af03c0f-d10d-43fe-bb93-9b066b13a8ce None admin] PATH_INFO: `/v3/users/00b45084548b49ba9aed5a6091a253ce` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:00.827631 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e47cba2-384c-463e-a70d-e0e4d2c1bef4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:42:00.832901 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-2e47cba2-384c-463e-a70d-e0e4d2c1bef4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:42:00.832901 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:00.832901 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:42:00.832901 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:42:00.832901 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:42:00.832901 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:42:00.832901 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:42:00.832901 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:42:00.832901 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:42:00.832901 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:42:00.832901 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:42:00.832901 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:42:00.832901 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:42:00.832901 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:42:00.832901 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:42:00.832901 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:42:00.833761 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:42:00.833761 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:42:00.833761 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:42:00.833761 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:42:00.833761 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:42:00.833761 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:42:00.833761 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:42:00.833761 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:42:00.833761 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:42:00.833761 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:42:00.833761 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:42:00.833761 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:42:00.833761 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:42:00.833761 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:42:00.833761 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:42:00.833761 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:42:00.834558 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:42:00.834558 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:42:00.834558 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:42:00.834558 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:42:00.834558 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:42:00.834558 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:42:00.834558 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:42:00.834558 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:42:00.834558 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:42:00.834558 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:42:00.834558 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:42:00.834558 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:42:00.834558 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 36/74] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 7 15:42:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:42:00.835174 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47cba2-384c-463e-a70d-e0e4d2c1bef4 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:00.844684 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af03c0f-d10d-43fe-bb93-9b066b13a8ce None admin] RBAC: Authorizing `identity:get_user(user_id=00b45084548b49ba9aed5a6091a253ce)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:00.846147 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af03c0f-d10d-43fe-bb93-9b066b13a8ce None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:00.847841 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 39/75] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 7 15:42:00 2022] GET /identity/v3/users/00b45084548b49ba9aed5a6091a253ce => generated 275 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:00.848674 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af03c0f-d10d-43fe-bb93-9b066b13a8ce None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:00.945203 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47cba2-384c-463e-a70d-e0e4d2c1bef4 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:00.953637 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af03c0f-d10d-43fe-bb93-9b066b13a8ce None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:00.955469 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:00.980627 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da69b31-7c4b-4eda-a74e-7afc958f7501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:00.981748 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da69b31-7c4b-4eda-a74e-7afc958f7501 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:00.982030 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da69b31-7c4b-4eda-a74e-7afc958f7501 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:00.982334 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da69b31-7c4b-4eda-a74e-7afc958f7501 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:00.987531 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c13b72-7283-4f56-920e-5802f1254298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:00.988157 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c13b72-7283-4f56-920e-5802f1254298 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:00.988437 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c13b72-7283-4f56-920e-5802f1254298 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:00.988714 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c13b72-7283-4f56-920e-5802f1254298 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:00.989813 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c13b72-7283-4f56-920e-5802f1254298 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:00.991277 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c13b72-7283-4f56-920e-5802f1254298 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:00.992833 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 40/76] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:42:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:00.992967 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da69b31-7c4b-4eda-a74e-7afc958f7501 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:42:00.993586 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c13b72-7283-4f56-920e-5802f1254298 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:00.998554 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-1da69b31-7c4b-4eda-a74e-7afc958f7501 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 15:42:00.998554 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:00.998554 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:42:00.998554 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:42:00.998554 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:42:00.998554 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:42:00.998554 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:42:00.998554 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:42:00.998554 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:42:00.998554 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:42:00.998554 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:42:00.998554 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:42:00.998554 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:42:00.998554 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:42:00.998554 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:42:00.998554 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:42:00.999423 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:42:00.999423 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:42:00.999423 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:42:00.999423 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:42:00.999423 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:42:00.999423 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:42:00.999423 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:42:00.999423 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:42:00.999423 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:42:00.999423 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:42:00.999423 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:42:00.999423 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:42:00.999423 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:42:00.999423 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:42:00.999423 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:42:00.999423 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:42:01.000198 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:42:01.000198 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:42:01.000198 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:42:01.000198 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:42:01.000198 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:42:01.000198 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:42:01.000198 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:42:01.000198 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:42:01.000198 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:42:01.000198 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:42:01.000198 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 15:42:01.000198 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:42:01.000198 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 37/77] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 7 15:42:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:42:01.000823 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da69b31-7c4b-4eda-a74e-7afc958f7501 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:01.025561 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:01.099728 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da69b31-7c4b-4eda-a74e-7afc958f7501 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:01.101068 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c13b72-7283-4f56-920e-5802f1254298 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:01.133169 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67fc9c-a5d8-438d-b9f6-a5ef235f1130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:01.133775 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67fc9c-a5d8-438d-b9f6-a5ef235f1130 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:01.134058 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67fc9c-a5d8-438d-b9f6-a5ef235f1130 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:01.134371 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67fc9c-a5d8-438d-b9f6-a5ef235f1130 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:01.134592 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f6699-7e54-41a0-a6b7-17f91eb17a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:01.135202 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f6699-7e54-41a0-a6b7-17f91eb17a42 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:01.135489 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f6699-7e54-41a0-a6b7-17f91eb17a42 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:01.135768 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f6699-7e54-41a0-a6b7-17f91eb17a42 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:01.136429 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f6699-7e54-41a0-a6b7-17f91eb17a42 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:01.136738 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f6699-7e54-41a0-a6b7-17f91eb17a42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:01.138980 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f6699-7e54-41a0-a6b7-17f91eb17a42 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:01.147018 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 41/78] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:42:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:01.147804 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f6699-7e54-41a0-a6b7-17f91eb17a42 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:01.178085 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:01.208534 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b67fc9c-a5d8-438d-b9f6-a5ef235f1130 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:01.209950 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b67fc9c-a5d8-438d-b9f6-a5ef235f1130 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:01.236543 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:01.250458 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f6699-7e54-41a0-a6b7-17f91eb17a42 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:01.285499 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c9778f-12fd-4822-ad7d-0e8ab5a66e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:01.286134 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9778f-12fd-4822-ad7d-0e8ab5a66e40 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:01.286460 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9778f-12fd-4822-ad7d-0e8ab5a66e40 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:01.286739 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9778f-12fd-4822-ad7d-0e8ab5a66e40 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:01.296875 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c9778f-12fd-4822-ad7d-0e8ab5a66e40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:42:01.301817 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-72c9778f-12fd-4822-ad7d-0e8ab5a66e40 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:42:01.301817 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:01.301817 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:42:01.301817 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:42:01.301817 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:42:01.301817 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:42:01.301817 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:42:01.301817 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:42:01.301817 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:42:01.301817 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:42:01.301817 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:42:01.301817 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:42:01.301817 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:42:01.301817 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:42:01.301817 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:42:01.301817 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:42:01.302727 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:42:01.302727 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:42:01.302727 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:42:01.302727 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:42:01.302727 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:42:01.302727 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:42:01.302727 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:42:01.302727 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:42:01.302727 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:42:01.302727 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:42:01.302727 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:42:01.302727 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:42:01.302727 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:42:01.302727 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:42:01.302727 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:42:01.302727 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:42:01.303473 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:42:01.303473 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:42:01.303473 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:42:01.303473 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:42:01.303473 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:42:01.303473 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:42:01.303473 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:42:01.303473 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:42:01.303473 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:42:01.303473 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:42:01.303473 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:42:01.303473 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:42:01.303473 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 42/79] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:42:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:42:01.304103 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c9778f-12fd-4822-ad7d-0e8ab5a66e40 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:01.310936 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 38/80] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:42:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:42:01.311772 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67fc9c-a5d8-438d-b9f6-a5ef235f1130 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:01.380106 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:01.405548 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c9778f-12fd-4822-ad7d-0e8ab5a66e40 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:01.411758 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67fc9c-a5d8-438d-b9f6-a5ef235f1130 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:01.438788 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb368c4-261a-4364-b587-bddb8a880437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:01.439392 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb368c4-261a-4364-b587-bddb8a880437 None admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:01.439673 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb368c4-261a-4364-b587-bddb8a880437 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:01.439952 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb368c4-261a-4364-b587-bddb8a880437 None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:01.440595 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb368c4-261a-4364-b587-bddb8a880437 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:01.442043 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb368c4-261a-4364-b587-bddb8a880437 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:01.445144 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146faac-ede9-4209-9058-334ad9fc3750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:01.445754 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146faac-ede9-4209-9058-334ad9fc3750 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:01.446040 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146faac-ede9-4209-9058-334ad9fc3750 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:01.446356 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146faac-ede9-4209-9058-334ad9fc3750 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:01.447018 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9146faac-ede9-4209-9058-334ad9fc3750 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:01.447323 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9146faac-ede9-4209-9058-334ad9fc3750 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:01.448693 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9146faac-ede9-4209-9058-334ad9fc3750 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:01.456996 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 39/81] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:42:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:01.457784 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146faac-ede9-4209-9058-334ad9fc3750 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:01.472048 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 43/82] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Sep 7 15:42:01 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:42:01.472808 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb368c4-261a-4364-b587-bddb8a880437 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:01.486884 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:01.573899 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146faac-ede9-4209-9058-334ad9fc3750 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:01.605205 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb368c4-261a-4364-b587-bddb8a880437 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:01.607768 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:01.614535 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced30261-1e92-469c-bdc7-c50319dd40c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:01.615336 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced30261-1e92-469c-bdc7-c50319dd40c6 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:01.615622 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced30261-1e92-469c-bdc7-c50319dd40c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:01.615892 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced30261-1e92-469c-bdc7-c50319dd40c6 None admin] PATH_INFO: `/v3/users/939472ebcad74baeadd29e0d5a82843a` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:01.617202 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced30261-1e92-469c-bdc7-c50319dd40c6 None admin] RBAC: Authorizing `identity:get_user(user_id=939472ebcad74baeadd29e0d5a82843a)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:01.618835 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced30261-1e92-469c-bdc7-c50319dd40c6 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:01.625136 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 40/83] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 7 15:42:01 2022] GET /identity/v3/users/939472ebcad74baeadd29e0d5a82843a => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:01.625136 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced30261-1e92-469c-bdc7-c50319dd40c6 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:01.655459 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ef4d7-55f4-487a-ba73-5b4531e8dfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:01.656200 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ef4d7-55f4-487a-ba73-5b4531e8dfa9 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:01.656490 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ef4d7-55f4-487a-ba73-5b4531e8dfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:01.656773 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ef4d7-55f4-487a-ba73-5b4531e8dfa9 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:01.657440 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ef4d7-55f4-487a-ba73-5b4531e8dfa9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:01.657751 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ef4d7-55f4-487a-ba73-5b4531e8dfa9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:01.659259 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ef4d7-55f4-487a-ba73-5b4531e8dfa9 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:01.670816 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 44/84] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 7 15:42:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:01.671473 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ef4d7-55f4-487a-ba73-5b4531e8dfa9 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:01.744813 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced30261-1e92-469c-bdc7-c50319dd40c6 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:01.755228 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:01.795523 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ef906-fac3-4e3c-9a81-ca3ce0952eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:01.796165 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ef906-fac3-4e3c-9a81-ca3ce0952eb9 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:01.796451 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ef906-fac3-4e3c-9a81-ca3ce0952eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:01.796726 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ef906-fac3-4e3c-9a81-ca3ce0952eb9 None admin] PATH_INFO: `/v3/projects/6e5edf54975843879025d05c7e7a65d7` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:01.797919 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143ef906-fac3-4e3c-9a81-ca3ce0952eb9 None admin] RBAC: Authorizing `identity:get_project(project_id=6e5edf54975843879025d05c7e7a65d7)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:01.799401 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143ef906-fac3-4e3c-9a81-ca3ce0952eb9 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:01.799774 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ef4d7-55f4-487a-ba73-5b4531e8dfa9 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:01.801037 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 41/85] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 7 15:42:01 2022] GET /identity/v3/projects/6e5edf54975843879025d05c7e7a65d7 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:01.801891 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ef906-fac3-4e3c-9a81-ca3ce0952eb9 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:01.843463 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be3ef02-a432-4409-9aac-43f9b2601321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:01.844115 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3ef02-a432-4409-9aac-43f9b2601321 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:01.844397 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3ef02-a432-4409-9aac-43f9b2601321 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:01.844674 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3ef02-a432-4409-9aac-43f9b2601321 None admin] PATH_INFO: `/v3/users/00b45084548b49ba9aed5a6091a253ce` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:01.845850 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be3ef02-a432-4409-9aac-43f9b2601321 None admin] RBAC: Authorizing `identity:get_user(user_id=00b45084548b49ba9aed5a6091a253ce)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:01.847824 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be3ef02-a432-4409-9aac-43f9b2601321 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:01.849435 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 45/86] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 7 15:42:01 2022] GET /identity/v3/users/00b45084548b49ba9aed5a6091a253ce => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:01.850675 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be3ef02-a432-4409-9aac-43f9b2601321 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:01.888438 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:01.927422 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ef906-fac3-4e3c-9a81-ca3ce0952eb9 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:01.964961 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2783c5b-9a57-4d2e-9be4-5d5e2d67ec6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:01.966008 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2783c5b-9a57-4d2e-9be4-5d5e2d67ec6a None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:01.966513 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2783c5b-9a57-4d2e-9be4-5d5e2d67ec6a None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:01.966984 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2783c5b-9a57-4d2e-9be4-5d5e2d67ec6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:01.992626 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be3ef02-a432-4409-9aac-43f9b2601321 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:02.043296 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2783c5b-9a57-4d2e-9be4-5d5e2d67ec6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:02.045124 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2783c5b-9a57-4d2e-9be4-5d5e2d67ec6a None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:02.047976 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab71c2-400c-469c-bf98-4e591f913fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:02.049076 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab71c2-400c-469c-bf98-4e591f913fe8 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:02.049076 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab71c2-400c-469c-bf98-4e591f913fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:02.049349 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab71c2-400c-469c-bf98-4e591f913fe8 None admin] PATH_INFO: `/v3/users/00b45084548b49ba9aed5a6091a253ce` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:02.050520 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bab71c2-400c-469c-bf98-4e591f913fe8 None admin] RBAC: Authorizing `identity:get_user(user_id=00b45084548b49ba9aed5a6091a253ce)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:02.051986 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bab71c2-400c-469c-bf98-4e591f913fe8 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:02.053592 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 46/87] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 7 15:42:01 2022] GET /identity/v3/users/00b45084548b49ba9aed5a6091a253ce => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:02.054386 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab71c2-400c-469c-bf98-4e591f913fe8 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:02.057739 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:02.126871 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:02.171755 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab71c2-400c-469c-bf98-4e591f913fe8 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:02.175177 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 42/88] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:42:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:42:02.176339 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2783c5b-9a57-4d2e-9be4-5d5e2d67ec6a None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:02.208609 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51609f1c-b29e-491d-87ac-5a4a4fc86df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:02.209359 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51609f1c-b29e-491d-87ac-5a4a4fc86df2 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:02.209714 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51609f1c-b29e-491d-87ac-5a4a4fc86df2 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:02.210065 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51609f1c-b29e-491d-87ac-5a4a4fc86df2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:02.210886 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51609f1c-b29e-491d-87ac-5a4a4fc86df2 None admin] RBAC: Adding query filter params (role.id=d45e39b4ad4e4ce782ec649246438663, scope.project.id=6e5edf54975843879025d05c7e7a65d7, user.id=00b45084548b49ba9aed5a6091a253ce) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:02.211267 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51609f1c-b29e-491d-87ac-5a4a4fc86df2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:02.212917 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51609f1c-b29e-491d-87ac-5a4a4fc86df2 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:02.218881 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 47/89] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 7 15:42:02 2022] GET /identity/v3/role_assignments?user.id=00b45084548b49ba9aed5a6091a253ce&scope.project.id=6e5edf54975843879025d05c7e7a65d7&role.id=d45e39b4ad4e4ce782ec649246438663 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:02.219765 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51609f1c-b29e-491d-87ac-5a4a4fc86df2 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:02.309842 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2783c5b-9a57-4d2e-9be4-5d5e2d67ec6a None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:02.351729 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:02.356288 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae1a28-7ec8-4902-9b5f-2a271776e65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:02.357566 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae1a28-7ec8-4902-9b5f-2a271776e65e None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:02.358031 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae1a28-7ec8-4902-9b5f-2a271776e65e None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:02.358551 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae1a28-7ec8-4902-9b5f-2a271776e65e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:02.401264 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:02.434959 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51609f1c-b29e-491d-87ac-5a4a4fc86df2 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:02.445508 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae1a28-7ec8-4902-9b5f-2a271776e65e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:02.447410 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae1a28-7ec8-4902-9b5f-2a271776e65e None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:02.531804 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec06f83-93d3-450d-86ef-39bcec064892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:02.533999 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec06f83-93d3-450d-86ef-39bcec064892 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:02.534326 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec06f83-93d3-450d-86ef-39bcec064892 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:02.534610 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec06f83-93d3-450d-86ef-39bcec064892 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:02.616460 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 43/90] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:42:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:42:02.620199 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae1a28-7ec8-4902-9b5f-2a271776e65e None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:02.626459 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec06f83-93d3-450d-86ef-39bcec064892 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:02.628192 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec06f83-93d3-450d-86ef-39bcec064892 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:02.752792 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:02.754485 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:02.811667 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 48/91] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:42:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:42:02.813184 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec06f83-93d3-450d-86ef-39bcec064892 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:02.829969 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae1a28-7ec8-4902-9b5f-2a271776e65e None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:02.895200 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9450a4-ba8a-48b5-9000-0d91223fba1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:02.895771 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9450a4-ba8a-48b5-9000-0d91223fba1e None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:02.896058 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9450a4-ba8a-48b5-9000-0d91223fba1e None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:02.896341 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9450a4-ba8a-48b5-9000-0d91223fba1e None admin] PATH_INFO: `/v3/projects/6e5edf54975843879025d05c7e7a65d7` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:02.897507 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9450a4-ba8a-48b5-9000-0d91223fba1e None admin] RBAC: Authorizing `identity:get_project(project_id=6e5edf54975843879025d05c7e7a65d7)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:02.899000 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9450a4-ba8a-48b5-9000-0d91223fba1e None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:02.900638 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 44/92] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 7 15:42:02 2022] GET /identity/v3/projects/6e5edf54975843879025d05c7e7a65d7 => generated 298 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:02.901407 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9450a4-ba8a-48b5-9000-0d91223fba1e None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:02.962164 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec06f83-93d3-450d-86ef-39bcec064892 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:03.000422 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8970ef-11ca-43f0-ac68-e71d8ea69b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:03.001079 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8970ef-11ca-43f0-ac68-e71d8ea69b54 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:03.001366 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8970ef-11ca-43f0-ac68-e71d8ea69b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:03.001707 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8970ef-11ca-43f0-ac68-e71d8ea69b54 None admin] PATH_INFO: `/v3/projects/6e5edf54975843879025d05c7e7a65d7` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:03.002946 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8970ef-11ca-43f0-ac68-e71d8ea69b54 None admin] RBAC: Authorizing `identity:get_project(project_id=6e5edf54975843879025d05c7e7a65d7)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:03.004418 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8970ef-11ca-43f0-ac68-e71d8ea69b54 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:03.006207 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 49/93] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 7 15:42:02 2022] GET /identity/v3/projects/6e5edf54975843879025d05c7e7a65d7 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:03.006984 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8970ef-11ca-43f0-ac68-e71d8ea69b54 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:03.044693 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:03.116557 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8970ef-11ca-43f0-ac68-e71d8ea69b54 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:03.148422 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9450a4-ba8a-48b5-9000-0d91223fba1e None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:03.153478 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027d4d9-d692-4c52-bb06-ecd7eec4b3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:03.154151 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027d4d9-d692-4c52-bb06-ecd7eec4b3d6 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:03.154503 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027d4d9-d692-4c52-bb06-ecd7eec4b3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:03.154788 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027d4d9-d692-4c52-bb06-ecd7eec4b3d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:03.155647 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8027d4d9-d692-4c52-bb06-ecd7eec4b3d6 None admin] RBAC: Adding query filter params (role.id=61605ebf17e643258730e55bf6db15ad, scope.project.id=6e5edf54975843879025d05c7e7a65d7, user.id=939472ebcad74baeadd29e0d5a82843a) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:03.155963 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8027d4d9-d692-4c52-bb06-ecd7eec4b3d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:03.157427 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8027d4d9-d692-4c52-bb06-ecd7eec4b3d6 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:03.163800 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 50/94] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 7 15:42:03 2022] GET /identity/v3/role_assignments?user.id=939472ebcad74baeadd29e0d5a82843a&scope.project.id=6e5edf54975843879025d05c7e7a65d7&role.id=61605ebf17e643258730e55bf6db15ad => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:03.164615 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027d4d9-d692-4c52-bb06-ecd7eec4b3d6 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:03.228082 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb7f6a-b5a2-4d67-8d41-5fa058e3eefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:03.228713 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb7f6a-b5a2-4d67-8d41-5fa058e3eefd None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:03.229005 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb7f6a-b5a2-4d67-8d41-5fa058e3eefd None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:03.229280 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb7f6a-b5a2-4d67-8d41-5fa058e3eefd None admin] PATH_INFO: `/v3/projects/989d5612508c4db0bfb7444b2b2cf53a` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:03.230713 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fb7f6a-b5a2-4d67-8d41-5fa058e3eefd None admin] RBAC: Authorizing `identity:get_project(project_id=989d5612508c4db0bfb7444b2b2cf53a)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:03.232724 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fb7f6a-b5a2-4d67-8d41-5fa058e3eefd None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:03.234479 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 45/95] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 7 15:42:02 2022] GET /identity/v3/projects/989d5612508c4db0bfb7444b2b2cf53a => generated 312 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:03.240751 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb7f6a-b5a2-4d67-8d41-5fa058e3eefd None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:03.244749 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:03.281971 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:03.288241 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027d4d9-d692-4c52-bb06-ecd7eec4b3d6 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:03.327493 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ef0e0-fd46-4bf2-aa8b-1ebde22c98cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:03.328115 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ef0e0-fd46-4bf2-aa8b-1ebde22c98cc None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:03.328405 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ef0e0-fd46-4bf2-aa8b-1ebde22c98cc None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:03.328691 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ef0e0-fd46-4bf2-aa8b-1ebde22c98cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:03.329452 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ef0e0-fd46-4bf2-aa8b-1ebde22c98cc None admin] RBAC: Adding query filter params (role.id=ce978876ff724bf3b4101c9fd4d2d842, scope.project.id=6e5edf54975843879025d05c7e7a65d7, user.id=00b45084548b49ba9aed5a6091a253ce) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:03.329842 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ef0e0-fd46-4bf2-aa8b-1ebde22c98cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:03.331368 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ef0e0-fd46-4bf2-aa8b-1ebde22c98cc None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:03.337612 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 51/96] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 7 15:42:03 2022] GET /identity/v3/role_assignments?user.id=00b45084548b49ba9aed5a6091a253ce&scope.project.id=6e5edf54975843879025d05c7e7a65d7&role.id=ce978876ff724bf3b4101c9fd4d2d842 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:03.409709 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb7f6a-b5a2-4d67-8d41-5fa058e3eefd None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:03.460994 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf7fed-22b6-4a84-846f-e12e91e98598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:03.461628 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf7fed-22b6-4a84-846f-e12e91e98598 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:03.461917 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf7fed-22b6-4a84-846f-e12e91e98598 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:03.462219 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf7fed-22b6-4a84-846f-e12e91e98598 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:03.462982 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bf7fed-22b6-4a84-846f-e12e91e98598 None admin] RBAC: Adding query filter params (role.id=d45e39b4ad4e4ce782ec649246438663, scope.project.id=989d5612508c4db0bfb7444b2b2cf53a, user.id=00b45084548b49ba9aed5a6091a253ce) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:03.463301 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bf7fed-22b6-4a84-846f-e12e91e98598 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:03.464794 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bf7fed-22b6-4a84-846f-e12e91e98598 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:03.472007 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 46/97] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 7 15:42:03 2022] GET /identity/v3/role_assignments?user.id=00b45084548b49ba9aed5a6091a253ce&scope.project.id=989d5612508c4db0bfb7444b2b2cf53a&role.id=d45e39b4ad4e4ce782ec649246438663 => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:04.461956 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2086bd-c4e6-41b5-9df6-d3c49034066a None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:04.462494 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2086bd-c4e6-41b5-9df6-d3c49034066a None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:04.462565 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2086bd-c4e6-41b5-9df6-d3c49034066a None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:04.464205 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 52/98] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:42:04.476980 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72923a-c085-4c15-9d2b-95169df4b2cb None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:04.477501 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72923a-c085-4c15-9d2b-95169df4b2cb None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:04.477576 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72923a-c085-4c15-9d2b-95169df4b2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:04.500911 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-1e72923a-c085-4c15-9d2b-95169df4b2cb None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:04.502467 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-1e72923a-c085-4c15-9d2b-95169df4b2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:04.593451 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:04.604439 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 47/99] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:42:04.672609 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37cdfd-048b-4fe2-a985-db11379e03d7 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:04.673235 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37cdfd-048b-4fe2-a985-db11379e03d7 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:04.673710 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37cdfd-048b-4fe2-a985-db11379e03d7 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:04.675557 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 53/100] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:42:04.680649 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc7901-d01d-4e35-955d-b477566558b6 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:04.681252 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc7901-d01d-4e35-955d-b477566558b6 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:04.681780 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc7901-d01d-4e35-955d-b477566558b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:04.702940 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-5acc7901-d01d-4e35-955d-b477566558b6 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:04.704472 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-5acc7901-d01d-4e35-955d-b477566558b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:04.794408 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 48/101] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:42:05.045900 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f503d-2c19-4697-a1ab-13ea5b865e03 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:05.046472 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f503d-2c19-4697-a1ab-13ea5b865e03 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:05.046953 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f503d-2c19-4697-a1ab-13ea5b865e03 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:05.048746 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 54/102] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:42:05.053709 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19bc11-c8f2-4689-9807-1578e826b11c None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:05.054271 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19bc11-c8f2-4689-9807-1578e826b11c None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:05.054758 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19bc11-c8f2-4689-9807-1578e826b11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:05.074666 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f503d-2c19-4697-a1ab-13ea5b865e03 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:05.078143 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-3e19bc11-c8f2-4689-9807-1578e826b11c None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:05.080896 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-3e19bc11-c8f2-4689-9807-1578e826b11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:05.218063 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 49/103] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:42:05.244008 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f503d-2c19-4697-a1ab-13ea5b865e03 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:05.280928 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e78ee-2a8a-42f3-9ff7-1512435382a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:05.281946 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e78ee-2a8a-42f3-9ff7-1512435382a2 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:05.282549 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e78ee-2a8a-42f3-9ff7-1512435382a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:05.283020 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e78ee-2a8a-42f3-9ff7-1512435382a2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:05.294826 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e78ee-2a8a-42f3-9ff7-1512435382a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:42:05.300690 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-d83e78ee-2a8a-42f3-9ff7-1512435382a2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 15:42:05.300690 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:05.300690 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:42:05.300690 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:42:05.300690 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:42:05.300690 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:42:05.300690 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:42:05.300690 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:42:05.300690 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:42:05.300690 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:42:05.300690 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:42:05.300690 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:42:05.300690 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:42:05.300690 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:42:05.300690 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:42:05.300690 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:42:05.301550 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:42:05.301550 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:42:05.301550 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:42:05.301550 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:42:05.301550 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:42:05.301550 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:42:05.301550 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:42:05.301550 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:42:05.301550 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:42:05.301550 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:42:05.301550 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:42:05.301550 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:42:05.301550 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:42:05.301550 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:42:05.301550 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:42:05.301550 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:42:05.302380 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:42:05.302380 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:42:05.302380 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:42:05.302380 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:42:05.302380 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:42:05.302380 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:42:05.302380 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:42:05.302380 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:42:05.302380 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:42:05.302380 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:42:05.302380 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 15:42:05.302380 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:42:05.304589 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 55/104] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:42:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:42:05.310544 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19bc11-c8f2-4689-9807-1578e826b11c None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:05.322964 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e78ee-2a8a-42f3-9ff7-1512435382a2 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:05.373789 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:05.429329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:05.512224 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e78ee-2a8a-42f3-9ff7-1512435382a2 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:05.516422 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19bc11-c8f2-4689-9807-1578e826b11c None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:05.552777 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20d643-797d-4484-9744-a0201f2e45ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:05.553755 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20d643-797d-4484-9744-a0201f2e45ba None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:05.556879 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20d643-797d-4484-9744-a0201f2e45ba None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:05.557463 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20d643-797d-4484-9744-a0201f2e45ba None admin] PATH_INFO: `/v3/domains/default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:05.559149 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d20d643-797d-4484-9744-a0201f2e45ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:05.561821 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d20d643-797d-4484-9744-a0201f2e45ba None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:05.563873 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 56/105] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:42:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:05.564836 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20d643-797d-4484-9744-a0201f2e45ba None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:05.607667 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1102cdb-2e48-4369-9f91-e9287792a744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:05.608014 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1102cdb-2e48-4369-9f91-e9287792a744 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:05.608272 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1102cdb-2e48-4369-9f91-e9287792a744 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:05.608560 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1102cdb-2e48-4369-9f91-e9287792a744 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:05.609255 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1102cdb-2e48-4369-9f91-e9287792a744 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:05.609568 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1102cdb-2e48-4369-9f91-e9287792a744 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:05.611078 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1102cdb-2e48-4369-9f91-e9287792a744 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:05.632398 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 50/106] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 7 15:42:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:05.633247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1102cdb-2e48-4369-9f91-e9287792a744 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:05.670731 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:05.681063 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20d643-797d-4484-9744-a0201f2e45ba None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:05.747317 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54217e1-e6ea-4002-82ce-a4948fe42fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:05.748261 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54217e1-e6ea-4002-82ce-a4948fe42fd4 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:05.748551 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54217e1-e6ea-4002-82ce-a4948fe42fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:05.750056 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54217e1-e6ea-4002-82ce-a4948fe42fd4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:05.771756 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54217e1-e6ea-4002-82ce-a4948fe42fd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:42:05.778770 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-c54217e1-e6ea-4002-82ce-a4948fe42fd4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:42:05.778770 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:05.778770 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:42:05.778770 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:42:05.778770 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:42:05.778770 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:42:05.778770 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:42:05.778770 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:42:05.778770 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:42:05.778770 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:42:05.778770 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:42:05.778770 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:42:05.778770 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:42:05.778770 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:42:05.778770 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:42:05.778770 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:42:05.779729 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:42:05.779729 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:42:05.779729 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:42:05.779729 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:42:05.779729 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:42:05.779729 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:42:05.779729 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:42:05.779729 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:42:05.779729 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:42:05.779729 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:42:05.779729 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:42:05.779729 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:42:05.779729 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:42:05.779729 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:42:05.779729 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:42:05.779729 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:42:05.780850 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:42:05.780850 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:42:05.780850 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:42:05.780850 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:42:05.780850 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:42:05.780850 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:42:05.780850 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:42:05.780850 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:42:05.780850 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:42:05.780850 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:42:05.780850 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:42:05.780850 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:42:05.780850 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 57/107] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:42:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:42:05.783146 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54217e1-e6ea-4002-82ce-a4948fe42fd4 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:05.832058 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1102cdb-2e48-4369-9f91-e9287792a744 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:05.870264 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:05.896378 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da03bf-229e-4866-8d33-1c0d5b1e0a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:05.897006 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da03bf-229e-4866-8d33-1c0d5b1e0a81 None admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:05.897290 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da03bf-229e-4866-8d33-1c0d5b1e0a81 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:05.897595 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da03bf-229e-4866-8d33-1c0d5b1e0a81 None admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:05.898233 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da03bf-229e-4866-8d33-1c0d5b1e0a81 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:05.899792 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da03bf-229e-4866-8d33-1c0d5b1e0a81 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:05.932479 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54217e1-e6ea-4002-82ce-a4948fe42fd4 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:05.964394 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 51/108] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Sep 7 15:42:05 2022] POST /identity/v3/projects => generated 302 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:42:05.965358 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da03bf-229e-4866-8d33-1c0d5b1e0a81 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:05.975612 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fdec0f-30ad-4b10-8930-b46f23512234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:05.976799 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdec0f-30ad-4b10-8930-b46f23512234 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:05.977298 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdec0f-30ad-4b10-8930-b46f23512234 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:05.977779 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdec0f-30ad-4b10-8930-b46f23512234 None admin] PATH_INFO: `/v3/users/0cd5248dbbd44fb49ccfc944c366de6e` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:05.995457 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fdec0f-30ad-4b10-8930-b46f23512234 None admin] RBAC: Authorizing `identity:get_user(user_id=0cd5248dbbd44fb49ccfc944c366de6e)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:05.997604 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fdec0f-30ad-4b10-8930-b46f23512234 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:06.000038 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 58/109] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 7 15:42:05 2022] GET /identity/v3/users/0cd5248dbbd44fb49ccfc944c366de6e => generated 289 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:06.005845 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fdec0f-30ad-4b10-8930-b46f23512234 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:06.019942 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:06.125234 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fdec0f-30ad-4b10-8930-b46f23512234 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:06.166802 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c4afa-d02c-40a3-9ebb-6a5aab37000e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:06.167647 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c4afa-d02c-40a3-9ebb-6a5aab37000e None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:06.169487 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c4afa-d02c-40a3-9ebb-6a5aab37000e None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:06.169487 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c4afa-d02c-40a3-9ebb-6a5aab37000e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:06.182314 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da03bf-229e-4866-8d33-1c0d5b1e0a81 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:06.247631 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7c4afa-d02c-40a3-9ebb-6a5aab37000e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:06.249465 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7c4afa-d02c-40a3-9ebb-6a5aab37000e None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:06.255950 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d7f2d-698a-4147-933f-229f6d9c794b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:06.256800 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d7f2d-698a-4147-933f-229f6d9c794b None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:06.257223 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d7f2d-698a-4147-933f-229f6d9c794b None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:06.257662 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d7f2d-698a-4147-933f-229f6d9c794b None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:06.258495 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d7f2d-698a-4147-933f-229f6d9c794b None admin] RBAC: Adding query filter params (name=member) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:06.261435 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:06.262268 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d7f2d-698a-4147-933f-229f6d9c794b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:06.266526 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d7f2d-698a-4147-933f-229f6d9c794b None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:06.288255 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 52/110] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 7 15:42:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:06.289571 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652105f-e234-49ff-b96d-b9eeb5c3c783 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:06.289868 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652105f-e234-49ff-b96d-b9eeb5c3c783 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:06.290153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652105f-e234-49ff-b96d-b9eeb5c3c783 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:06.291519 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 53/111] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:42:06.297481 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ad747-26b7-4bac-9ddd-d1503bcb3f19 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:06.297797 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ad747-26b7-4bac-9ddd-d1503bcb3f19 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:06.298058 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ad747-26b7-4bac-9ddd-d1503bcb3f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:06.347336 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-354ad747-26b7-4bac-9ddd-d1503bcb3f19 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:06.348691 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-354ad747-26b7-4bac-9ddd-d1503bcb3f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:06.373051 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 59/112] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:42:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 07 15:42:06.373792 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c4afa-d02c-40a3-9ebb-6a5aab37000e None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:06.391771 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:06.445849 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 54/113] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:42:06.447084 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ad747-26b7-4bac-9ddd-d1503bcb3f19 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:06.498326 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c4afa-d02c-40a3-9ebb-6a5aab37000e None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:06.507694 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:06.537435 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da6687-9f0d-46a0-9309-24d6d0b56d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:06.538249 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da6687-9f0d-46a0-9309-24d6d0b56d2c None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:06.538465 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da6687-9f0d-46a0-9309-24d6d0b56d2c None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:06.538746 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da6687-9f0d-46a0-9309-24d6d0b56d2c None admin] PATH_INFO: `/v3/users/00b45084548b49ba9aed5a6091a253ce` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:06.540050 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70da6687-9f0d-46a0-9309-24d6d0b56d2c None admin] RBAC: Authorizing `identity:get_user(user_id=00b45084548b49ba9aed5a6091a253ce)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:06.541845 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70da6687-9f0d-46a0-9309-24d6d0b56d2c None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:06.544124 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 60/114] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 7 15:42:06 2022] GET /identity/v3/users/00b45084548b49ba9aed5a6091a253ce => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:06.551513 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da6687-9f0d-46a0-9309-24d6d0b56d2c None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:06.608178 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ad747-26b7-4bac-9ddd-d1503bcb3f19 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:06.667636 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95691d83-1de5-4494-b62f-ac4b33f096f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:06.669217 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95691d83-1de5-4494-b62f-ac4b33f096f4 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:06.669708 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95691d83-1de5-4494-b62f-ac4b33f096f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:06.670201 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95691d83-1de5-4494-b62f-ac4b33f096f4 None admin] PATH_INFO: `/v3/projects/6e5edf54975843879025d05c7e7a65d7` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:06.674928 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95691d83-1de5-4494-b62f-ac4b33f096f4 None admin] RBAC: Authorizing `identity:get_project(project_id=6e5edf54975843879025d05c7e7a65d7)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:06.676657 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95691d83-1de5-4494-b62f-ac4b33f096f4 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:06.678599 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 55/115] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 7 15:42:06 2022] GET /identity/v3/projects/6e5edf54975843879025d05c7e7a65d7 => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:06.684686 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95691d83-1de5-4494-b62f-ac4b33f096f4 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:06.686276 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da6687-9f0d-46a0-9309-24d6d0b56d2c None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:06.724656 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240f345-59dd-43c3-a604-9b3330276da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:06.725416 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240f345-59dd-43c3-a604-9b3330276da0 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:06.725745 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240f345-59dd-43c3-a604-9b3330276da0 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:06.726036 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240f345-59dd-43c3-a604-9b3330276da0 None admin] PATH_INFO: `/v3/projects/6e5edf54975843879025d05c7e7a65d7` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:06.727367 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1240f345-59dd-43c3-a604-9b3330276da0 None admin] RBAC: Authorizing `identity:get_project(project_id=6e5edf54975843879025d05c7e7a65d7)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:06.728852 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1240f345-59dd-43c3-a604-9b3330276da0 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:06.731005 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 61/116] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 7 15:42:06 2022] GET /identity/v3/projects/6e5edf54975843879025d05c7e7a65d7 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:06.734579 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:06.738854 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240f345-59dd-43c3-a604-9b3330276da0 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:06.797031 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:06.856873 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240f345-59dd-43c3-a604-9b3330276da0 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:06.869495 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95691d83-1de5-4494-b62f-ac4b33f096f4 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:06.896183 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e87ac9-8bbf-4530-a924-eb201e279100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:06.896900 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e87ac9-8bbf-4530-a924-eb201e279100 None admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:06.897151 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e87ac9-8bbf-4530-a924-eb201e279100 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:06.897430 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e87ac9-8bbf-4530-a924-eb201e279100 None admin] PATH_INFO: `/v3/projects/6e5edf54975843879025d05c7e7a65d7/users/00b45084548b49ba9aed5a6091a253ce/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:06.899425 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e87ac9-8bbf-4530-a924-eb201e279100 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e5edf54975843879025d05c7e7a65d7, user_id=00b45084548b49ba9aed5a6091a253ce, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:06.901107 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e87ac9-8bbf-4530-a924-eb201e279100 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:06.913119 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef2eaf0-539d-42cb-9698-ee2c6ee468d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:06.914239 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2eaf0-539d-42cb-9698-ee2c6ee468d3 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:06.914800 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2eaf0-539d-42cb-9698-ee2c6ee468d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:06.915103 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2eaf0-539d-42cb-9698-ee2c6ee468d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:06.915286 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 62/117] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 7 15:42:06 2022] PUT /identity/v3/projects/6e5edf54975843879025d05c7e7a65d7/users/00b45084548b49ba9aed5a6091a253ce/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 15:42:06.916175 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef2eaf0-539d-42cb-9698-ee2c6ee468d3 None admin] RBAC: Adding query filter params (role.id=903d756c82454add946529986655408d, scope.project.id=6e5edf54975843879025d05c7e7a65d7, user.id=0cd5248dbbd44fb49ccfc944c366de6e) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:06.916494 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef2eaf0-539d-42cb-9698-ee2c6ee468d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:06.918021 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef2eaf0-539d-42cb-9698-ee2c6ee468d3 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:06.926288 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 56/118] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 7 15:42:06 2022] GET /identity/v3/role_assignments?user.id=0cd5248dbbd44fb49ccfc944c366de6e&scope.project.id=6e5edf54975843879025d05c7e7a65d7&role.id=903d756c82454add946529986655408d => generated 259 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:42:06.926513 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efefd605-67cd-4a14-a780-48d1b9cd2bac None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:06.926871 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efefd605-67cd-4a14-a780-48d1b9cd2bac None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:06.927157 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efefd605-67cd-4a14-a780-48d1b9cd2bac None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:06.928752 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 63/119] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:06 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:42:06.931231 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efefd605-67cd-4a14-a780-48d1b9cd2bac None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:06.932384 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102856b6-7650-4e95-a8a6-5e4698f147e4 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:06.932993 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102856b6-7650-4e95-a8a6-5e4698f147e4 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:06.933502 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102856b6-7650-4e95-a8a6-5e4698f147e4 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:06.936798 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 57/120] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:42:06.939819 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583218f-3df8-45d0-aab8-4d1c519c7c85 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:06.941583 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583218f-3df8-45d0-aab8-4d1c519c7c85 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:06.942269 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583218f-3df8-45d0-aab8-4d1c519c7c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:06.968139 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-b583218f-3df8-45d0-aab8-4d1c519c7c85 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:06.969790 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b583218f-3df8-45d0-aab8-4d1c519c7c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:07.104944 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 58/121] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:42:07.106748 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f82d8a-f93b-4850-8b5e-2f3fd68d61a5 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:07.107051 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f82d8a-f93b-4850-8b5e-2f3fd68d61a5 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:07.107391 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f82d8a-f93b-4850-8b5e-2f3fd68d61a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:07.135529 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efefd605-67cd-4a14-a780-48d1b9cd2bac None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:07.147906 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-17f82d8a-f93b-4850-8b5e-2f3fd68d61a5 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:07.149130 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-17f82d8a-f93b-4850-8b5e-2f3fd68d61a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:07.158587 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:07.192152 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:07.215048 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b7527-281f-4ea8-8ab2-8f6ceddd1390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:07.216388 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b7527-281f-4ea8-8ab2-8f6ceddd1390 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:07.216926 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b7527-281f-4ea8-8ab2-8f6ceddd1390 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:07.217304 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b7527-281f-4ea8-8ab2-8f6ceddd1390 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:07.242028 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b7527-281f-4ea8-8ab2-8f6ceddd1390 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:42:07.255324 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-140b7527-281f-4ea8-8ab2-8f6ceddd1390 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:42:07.255324 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:07.255324 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:42:07.255324 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:42:07.255324 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:42:07.255324 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:42:07.255324 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:42:07.255324 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:42:07.255324 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:42:07.255324 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:42:07.255324 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:42:07.255324 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:42:07.255324 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:42:07.255324 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:42:07.255324 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:42:07.255324 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:42:07.256241 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:42:07.256241 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:42:07.256241 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:42:07.256241 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:42:07.256241 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:42:07.256241 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:42:07.256241 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:42:07.256241 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:42:07.256241 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:42:07.256241 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:42:07.256241 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:42:07.256241 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:42:07.256241 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:42:07.256241 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:42:07.256241 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:42:07.256241 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:42:07.257521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:42:07.257521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:42:07.257521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:42:07.257521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:42:07.257521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:42:07.257521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:42:07.257521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:42:07.257521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:42:07.257521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:42:07.257521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:42:07.257521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:42:07.257521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:42:07.257521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 64/122] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 7 15:42:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:42:07.266372 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b7527-281f-4ea8-8ab2-8f6ceddd1390 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:07.291779 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 59/123] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:42:07.400181 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b7527-281f-4ea8-8ab2-8f6ceddd1390 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:07.454617 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20258f17-e8cf-448d-9d6f-d82a09b0cc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:07.455165 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20258f17-e8cf-448d-9d6f-d82a09b0cc67 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:07.455453 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20258f17-e8cf-448d-9d6f-d82a09b0cc67 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:07.455731 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20258f17-e8cf-448d-9d6f-d82a09b0cc67 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:07.456473 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20258f17-e8cf-448d-9d6f-d82a09b0cc67 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:07.456792 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20258f17-e8cf-448d-9d6f-d82a09b0cc67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:07.458217 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20258f17-e8cf-448d-9d6f-d82a09b0cc67 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:07.469641 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 65/124] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:42:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:42:07.477424 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f82d8a-f93b-4850-8b5e-2f3fd68d61a5 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:07.602899 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f82d8a-f93b-4850-8b5e-2f3fd68d61a5 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:07.624904 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20258f17-e8cf-448d-9d6f-d82a09b0cc67 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:07.663322 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99de23-43b1-4f23-a3dd-ce6417e3857b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:07.665741 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99de23-43b1-4f23-a3dd-ce6417e3857b None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:07.665741 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99de23-43b1-4f23-a3dd-ce6417e3857b None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:07.667602 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99de23-43b1-4f23-a3dd-ce6417e3857b None admin] PATH_INFO: `/v3/users/939472ebcad74baeadd29e0d5a82843a` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:07.670974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa99de23-43b1-4f23-a3dd-ce6417e3857b None admin] RBAC: Authorizing `identity:get_user(user_id=939472ebcad74baeadd29e0d5a82843a)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:07.672842 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa99de23-43b1-4f23-a3dd-ce6417e3857b None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:07.674408 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 60/125] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 7 15:42:07 2022] GET /identity/v3/users/939472ebcad74baeadd29e0d5a82843a => generated 247 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:07.679952 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:07.704808 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99de23-43b1-4f23-a3dd-ce6417e3857b None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:07.763684 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:07.795884 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20258f17-e8cf-448d-9d6f-d82a09b0cc67 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:07.846593 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e93d3-d01f-4d62-a93e-c9d198e73317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:07.847598 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e93d3-d01f-4d62-a93e-c9d198e73317 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:07.848087 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e93d3-d01f-4d62-a93e-c9d198e73317 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:07.848527 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e93d3-d01f-4d62-a93e-c9d198e73317 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:07.869238 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e93d3-d01f-4d62-a93e-c9d198e73317 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:42:07.878431 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-eb2e93d3-d01f-4d62-a93e-c9d198e73317 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 15:42:07.878431 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:07.878431 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:42:07.878431 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:42:07.878431 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:42:07.878431 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:42:07.878431 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:42:07.878431 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:42:07.878431 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:42:07.878431 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:42:07.878431 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:42:07.878431 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:42:07.878431 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:42:07.878431 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:42:07.878431 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:42:07.878431 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:42:07.879320 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:42:07.879320 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:42:07.879320 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:42:07.879320 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:42:07.879320 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:42:07.879320 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:42:07.879320 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:42:07.879320 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:42:07.879320 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:42:07.879320 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:42:07.879320 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:42:07.879320 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:42:07.879320 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:42:07.879320 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:42:07.879320 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:42:07.879320 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:42:07.880079 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:42:07.880079 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:42:07.880079 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:42:07.880079 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:42:07.880079 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:42:07.880079 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:42:07.880079 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:42:07.880079 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:42:07.880079 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:42:07.880079 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:42:07.880079 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 15:42:07.880079 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:42:07.886390 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 66/126] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 7 15:42:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:42:07.887438 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e93d3-d01f-4d62-a93e-c9d198e73317 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:07.904658 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99de23-43b1-4f23-a3dd-ce6417e3857b None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:07.950960 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ce77e-be60-4001-8e4c-c4443a57bd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:07.952652 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ce77e-be60-4001-8e4c-c4443a57bd75 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:07.953243 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ce77e-be60-4001-8e4c-c4443a57bd75 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:07.953943 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ce77e-be60-4001-8e4c-c4443a57bd75 None admin] PATH_INFO: `/v3/projects/6e5edf54975843879025d05c7e7a65d7` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:07.956345 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ce77e-be60-4001-8e4c-c4443a57bd75 None admin] RBAC: Authorizing `identity:get_project(project_id=6e5edf54975843879025d05c7e7a65d7)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:07.959971 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ce77e-be60-4001-8e4c-c4443a57bd75 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:07.963732 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 61/127] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 7 15:42:07 2022] GET /identity/v3/projects/6e5edf54975843879025d05c7e7a65d7 => generated 298 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:42:07.970398 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ce77e-be60-4001-8e4c-c4443a57bd75 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:08.096860 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:08.109071 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ce77e-be60-4001-8e4c-c4443a57bd75 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:08.141080 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:08.149517 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b250a-f14a-4490-b892-4242ae6f46fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:08.150388 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b250a-f14a-4490-b892-4242ae6f46fa None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:08.150809 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b250a-f14a-4490-b892-4242ae6f46fa None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:08.151354 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b250a-f14a-4490-b892-4242ae6f46fa None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:08.152294 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305b250a-f14a-4490-b892-4242ae6f46fa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:08.152752 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305b250a-f14a-4490-b892-4242ae6f46fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:08.154671 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305b250a-f14a-4490-b892-4242ae6f46fa None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:08.169209 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 62/128] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:42:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:08.170349 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b250a-f14a-4490-b892-4242ae6f46fa None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:08.200672 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e93d3-d01f-4d62-a93e-c9d198e73317 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:08.283695 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b250a-f14a-4490-b892-4242ae6f46fa None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:08.320864 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ccc3f-11d7-45af-85ca-60459d61068f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:08.321766 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ccc3f-11d7-45af-85ca-60459d61068f None admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:08.322207 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ccc3f-11d7-45af-85ca-60459d61068f None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:08.322649 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ccc3f-11d7-45af-85ca-60459d61068f None admin] PATH_INFO: `/v3/projects/6e5edf54975843879025d05c7e7a65d7/users/939472ebcad74baeadd29e0d5a82843a/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:08.323489 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190e8ad-8a7c-42d6-bd3b-1b406272e2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:08.324142 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190e8ad-8a7c-42d6-bd3b-1b406272e2f4 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:08.324421 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190e8ad-8a7c-42d6-bd3b-1b406272e2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:08.324701 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190e8ad-8a7c-42d6-bd3b-1b406272e2f4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:08.326004 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0ccc3f-11d7-45af-85ca-60459d61068f None admin] RBAC: Authorizing `identity:create_grant(project_id=6e5edf54975843879025d05c7e7a65d7, user_id=939472ebcad74baeadd29e0d5a82843a, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:08.327601 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0ccc3f-11d7-45af-85ca-60459d61068f None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:08.344561 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3190e8ad-8a7c-42d6-bd3b-1b406272e2f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:42:08.350948 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-3190e8ad-8a7c-42d6-bd3b-1b406272e2f4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:42:08.350948 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:08.350948 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:42:08.350948 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:42:08.350948 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:42:08.350948 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:42:08.350948 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:42:08.350948 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:42:08.350948 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:42:08.350948 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:42:08.350948 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:42:08.350948 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:42:08.350948 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:42:08.350948 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:42:08.350948 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:42:08.350948 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:42:08.352255 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:42:08.352255 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:42:08.352255 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:42:08.352255 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:42:08.352255 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:42:08.352255 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:42:08.352255 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:42:08.352255 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:42:08.352255 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:42:08.352255 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:42:08.352255 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:42:08.352255 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:42:08.352255 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:42:08.352255 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:42:08.352255 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:42:08.352255 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:42:08.353265 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:42:08.353265 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:42:08.353265 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:42:08.353265 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:42:08.353265 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:42:08.353265 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:42:08.353265 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:42:08.353265 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:42:08.353265 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:42:08.353265 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:42:08.353265 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:42:08.353265 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:42:08.353265 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 67/129] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:42:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 465 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:42:08.353265 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190e8ad-8a7c-42d6-bd3b-1b406272e2f4 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:08.363670 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 63/130] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 7 15:42:08 2022] PUT /identity/v3/projects/6e5edf54975843879025d05c7e7a65d7/users/939472ebcad74baeadd29e0d5a82843a/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:42:08.364694 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ccc3f-11d7-45af-85ca-60459d61068f None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:08.407385 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:08.600795 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ccc3f-11d7-45af-85ca-60459d61068f None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:08.618086 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190e8ad-8a7c-42d6-bd3b-1b406272e2f4 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:08.661980 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03813fee-849d-474d-9c0b-8e36f0ff5798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:08.662645 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03813fee-849d-474d-9c0b-8e36f0ff5798 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:08.662937 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03813fee-849d-474d-9c0b-8e36f0ff5798 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:08.663224 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03813fee-849d-474d-9c0b-8e36f0ff5798 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:08.664057 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03813fee-849d-474d-9c0b-8e36f0ff5798 None admin] RBAC: Adding query filter params (name=member) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:08.664597 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03813fee-849d-474d-9c0b-8e36f0ff5798 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:08.665755 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03813fee-849d-474d-9c0b-8e36f0ff5798 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:08.687817 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 64/131] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 7 15:42:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:08.693856 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03813fee-849d-474d-9c0b-8e36f0ff5798 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:08.728089 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2258400-6272-45e5-bc13-84b785c044dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:08.728808 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2258400-6272-45e5-bc13-84b785c044dc None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:08.729039 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2258400-6272-45e5-bc13-84b785c044dc None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:08.729323 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2258400-6272-45e5-bc13-84b785c044dc None admin] PATH_INFO: `/v3/users/00b45084548b49ba9aed5a6091a253ce` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:08.735067 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2258400-6272-45e5-bc13-84b785c044dc None admin] RBAC: Authorizing `identity:get_user(user_id=00b45084548b49ba9aed5a6091a253ce)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:08.736701 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2258400-6272-45e5-bc13-84b785c044dc None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:08.738458 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 68/132] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 7 15:42:08 2022] GET /identity/v3/users/00b45084548b49ba9aed5a6091a253ce => generated 275 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:08.744621 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2258400-6272-45e5-bc13-84b785c044dc None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:08.776249 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:08.842559 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:08.892699 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03813fee-849d-474d-9c0b-8e36f0ff5798 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:08.940221 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2258400-6272-45e5-bc13-84b785c044dc None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:08.967406 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae93a7-ecdd-4f11-9994-d579ba3fdf00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:08.968112 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae93a7-ecdd-4f11-9994-d579ba3fdf00 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:08.968412 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae93a7-ecdd-4f11-9994-d579ba3fdf00 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:08.968690 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae93a7-ecdd-4f11-9994-d579ba3fdf00 None admin] PATH_INFO: `/v3/users/00b45084548b49ba9aed5a6091a253ce` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:08.970649 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ae93a7-ecdd-4f11-9994-d579ba3fdf00 None admin] RBAC: Authorizing `identity:get_user(user_id=00b45084548b49ba9aed5a6091a253ce)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:08.972332 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ae93a7-ecdd-4f11-9994-d579ba3fdf00 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:08.974136 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 65/133] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 7 15:42:08 2022] GET /identity/v3/users/00b45084548b49ba9aed5a6091a253ce => generated 275 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:42:08.979385 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae93a7-ecdd-4f11-9994-d579ba3fdf00 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:09.013178 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813404a-67f8-49a9-8bf4-063994d8360b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:09.013904 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813404a-67f8-49a9-8bf4-063994d8360b None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:09.014261 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813404a-67f8-49a9-8bf4-063994d8360b None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:09.014546 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813404a-67f8-49a9-8bf4-063994d8360b None admin] PATH_INFO: `/v3/projects/6e5edf54975843879025d05c7e7a65d7` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:09.016449 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0813404a-67f8-49a9-8bf4-063994d8360b None admin] RBAC: Authorizing `identity:get_project(project_id=6e5edf54975843879025d05c7e7a65d7)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:09.017912 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0813404a-67f8-49a9-8bf4-063994d8360b None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:09.019582 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 69/134] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 7 15:42:08 2022] GET /identity/v3/projects/6e5edf54975843879025d05c7e7a65d7 => generated 298 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:42:09.026337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813404a-67f8-49a9-8bf4-063994d8360b None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:09.166812 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:09.178973 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae93a7-ecdd-4f11-9994-d579ba3fdf00 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:09.208927 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813404a-67f8-49a9-8bf4-063994d8360b None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:09.241226 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e84479-0f49-4b7f-b368-8e6b4f454616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:09.241869 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e84479-0f49-4b7f-b368-8e6b4f454616 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:09.242155 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e84479-0f49-4b7f-b368-8e6b4f454616 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:09.242459 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e84479-0f49-4b7f-b368-8e6b4f454616 None admin] PATH_INFO: `/v3/projects/989d5612508c4db0bfb7444b2b2cf53a` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:09.243598 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e84479-0f49-4b7f-b368-8e6b4f454616 None admin] RBAC: Authorizing `identity:get_project(project_id=989d5612508c4db0bfb7444b2b2cf53a)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:09.245107 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e84479-0f49-4b7f-b368-8e6b4f454616 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:09.248219 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 66/135] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 7 15:42:08 2022] GET /identity/v3/projects/989d5612508c4db0bfb7444b2b2cf53a => generated 312 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:09.252854 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e84479-0f49-4b7f-b368-8e6b4f454616 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:09.275339 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:09.277284 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67207715-901c-487d-948a-94978f4b0814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:09.277970 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67207715-901c-487d-948a-94978f4b0814 None admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:09.278813 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67207715-901c-487d-948a-94978f4b0814 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:09.279267 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67207715-901c-487d-948a-94978f4b0814 None admin] PATH_INFO: `/v3/projects/6e5edf54975843879025d05c7e7a65d7/users/00b45084548b49ba9aed5a6091a253ce/roles/ce978876ff724bf3b4101c9fd4d2d842` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:09.283098 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67207715-901c-487d-948a-94978f4b0814 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e5edf54975843879025d05c7e7a65d7, user_id=00b45084548b49ba9aed5a6091a253ce, role_id=ce978876ff724bf3b4101c9fd4d2d842)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:09.285475 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67207715-901c-487d-948a-94978f4b0814 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:09.309086 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 70/136] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 7 15:42:09 2022] PUT /identity/v3/projects/6e5edf54975843879025d05c7e7a65d7/users/00b45084548b49ba9aed5a6091a253ce/roles/ce978876ff724bf3b4101c9fd4d2d842 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:42:09.377962 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2753c-4301-492c-85c5-d01aa1716c68 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:09.378295 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2753c-4301-492c-85c5-d01aa1716c68 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:09.378561 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2753c-4301-492c-85c5-d01aa1716c68 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:09.380348 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 71/137] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:42:09.389138 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d8e77-484c-4770-9159-37eda06b6b5c None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:09.389457 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d8e77-484c-4770-9159-37eda06b6b5c None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:09.389692 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d8e77-484c-4770-9159-37eda06b6b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:09.427379 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-624d8e77-484c-4770-9159-37eda06b6b5c None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:09.428549 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-624d8e77-484c-4770-9159-37eda06b6b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:09.432771 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e84479-0f49-4b7f-b368-8e6b4f454616 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:09.507966 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a70c60-6e5b-4d68-9bfc-41a2303550c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:09.509143 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a70c60-6e5b-4d68-9bfc-41a2303550c3 None admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:09.509590 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a70c60-6e5b-4d68-9bfc-41a2303550c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:09.509890 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a70c60-6e5b-4d68-9bfc-41a2303550c3 None admin] PATH_INFO: `/v3/projects/989d5612508c4db0bfb7444b2b2cf53a/users/00b45084548b49ba9aed5a6091a253ce/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:09.512128 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a70c60-6e5b-4d68-9bfc-41a2303550c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=989d5612508c4db0bfb7444b2b2cf53a, user_id=00b45084548b49ba9aed5a6091a253ce, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:09.513969 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a70c60-6e5b-4d68-9bfc-41a2303550c3 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:09.549212 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 67/138] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 7 15:42:09 2022] PUT /identity/v3/projects/989d5612508c4db0bfb7444b2b2cf53a/users/00b45084548b49ba9aed5a6091a253ce/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 15:42:09.596003 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 72/139] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:42:09.980202 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f1941-eb5c-49d8-beb9-98b8b699faf0 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:09.981990 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f1941-eb5c-49d8-beb9-98b8b699faf0 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:09.982493 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f1941-eb5c-49d8-beb9-98b8b699faf0 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:09.984024 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 68/140] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:42:09.989911 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc4300-00c8-43e5-9c68-df2d105ee62d None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:09.990769 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc4300-00c8-43e5-9c68-df2d105ee62d None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:09.991241 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc4300-00c8-43e5-9c68-df2d105ee62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:10.016193 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-c8fc4300-00c8-43e5-9c68-df2d105ee62d None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:10.017712 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-c8fc4300-00c8-43e5-9c68-df2d105ee62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:10.117458 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 73/141] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:42:10.230940 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f1941-eb5c-49d8-beb9-98b8b699faf0 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:10.314558 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:10.331037 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233640c-8b1c-49b4-a1c8-df32bbdf9e4e None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:10.331335 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233640c-8b1c-49b4-a1c8-df32bbdf9e4e None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:10.331592 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233640c-8b1c-49b4-a1c8-df32bbdf9e4e None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:10.333070 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 74/142] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:42:10.349120 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d9aa0-2c02-44bf-8632-48989be85d85 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:10.349427 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d9aa0-2c02-44bf-8632-48989be85d85 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:10.349688 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d9aa0-2c02-44bf-8632-48989be85d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:10.360422 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f1941-eb5c-49d8-beb9-98b8b699faf0 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:10.363554 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:10.387224 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-976d9aa0-2c02-44bf-8632-48989be85d85 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:10.389423 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-976d9aa0-2c02-44bf-8632-48989be85d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:10.408075 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db96df-eb1b-44c0-95a6-ed75c8f53466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:10.408841 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db96df-eb1b-44c0-95a6-ed75c8f53466 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:10.409120 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db96df-eb1b-44c0-95a6-ed75c8f53466 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:10.409390 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db96df-eb1b-44c0-95a6-ed75c8f53466 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:10.410648 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db96df-eb1b-44c0-95a6-ed75c8f53466 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:10.412086 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db96df-eb1b-44c0-95a6-ed75c8f53466 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:10.413664 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 69/143] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:42:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:10.419951 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db96df-eb1b-44c0-95a6-ed75c8f53466 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:10.530930 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db96df-eb1b-44c0-95a6-ed75c8f53466 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:10.564784 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 75/144] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:42:10.567565 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07efed-09ac-4db4-a5be-ca912eaa6dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:10.568178 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07efed-09ac-4db4-a5be-ca912eaa6dc9 None admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:10.568456 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07efed-09ac-4db4-a5be-ca912eaa6dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:10.568727 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07efed-09ac-4db4-a5be-ca912eaa6dc9 None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:10.569376 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad07efed-09ac-4db4-a5be-ca912eaa6dc9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:10.570903 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad07efed-09ac-4db4-a5be-ca912eaa6dc9 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:10.583482 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:10.597678 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 70/145] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Sep 7 15:42:10 2022] POST /identity/v3/users => generated 283 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 15:42:10.698798 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d9aa0-2c02-44bf-8632-48989be85d85 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:10.825807 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d9aa0-2c02-44bf-8632-48989be85d85 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:10.866263 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:10.874272 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219bc20f-67cf-4e0c-8153-1e1aab9cfc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:10.874919 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219bc20f-67cf-4e0c-8153-1e1aab9cfc31 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:10.875196 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219bc20f-67cf-4e0c-8153-1e1aab9cfc31 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:10.875467 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219bc20f-67cf-4e0c-8153-1e1aab9cfc31 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:10.889662 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219bc20f-67cf-4e0c-8153-1e1aab9cfc31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:42:10.894541 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-219bc20f-67cf-4e0c-8153-1e1aab9cfc31 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 15:42:10.894541 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:10.894541 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:42:10.894541 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:42:10.894541 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:42:10.894541 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:42:10.894541 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:42:10.894541 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:42:10.894541 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:42:10.894541 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:42:10.894541 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:42:10.894541 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:42:10.894541 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:42:10.894541 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:42:10.894541 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:42:10.894541 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:42:10.896618 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:42:10.896618 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:42:10.896618 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:42:10.896618 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:42:10.896618 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:42:10.896618 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:42:10.896618 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:42:10.896618 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:42:10.896618 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:42:10.896618 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:42:10.896618 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:42:10.896618 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:42:10.896618 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:42:10.896618 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:42:10.896618 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:42:10.896618 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:42:10.898507 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:42:10.898507 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:42:10.898507 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:42:10.898507 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:42:10.898507 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:42:10.898507 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:42:10.898507 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:42:10.898507 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:42:10.898507 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:42:10.898507 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:42:10.898507 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 15:42:10.898507 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:42:10.898507 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 76/146] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:42:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:42:10.906225 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07efed-09ac-4db4-a5be-ca912eaa6dc9 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:10.968693 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219bc20f-67cf-4e0c-8153-1e1aab9cfc31 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:11.078315 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07efed-09ac-4db4-a5be-ca912eaa6dc9 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:11.139151 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b8f4b2-9546-4b3a-92a6-b05e45f6f27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:11.140094 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8f4b2-9546-4b3a-92a6-b05e45f6f27a None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:11.140391 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8f4b2-9546-4b3a-92a6-b05e45f6f27a None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:11.140677 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8f4b2-9546-4b3a-92a6-b05e45f6f27a None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:11.141357 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b8f4b2-9546-4b3a-92a6-b05e45f6f27a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:11.141664 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b8f4b2-9546-4b3a-92a6-b05e45f6f27a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:11.143115 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b8f4b2-9546-4b3a-92a6-b05e45f6f27a None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:11.152644 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 71/147] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 7 15:42:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:11.158931 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b8f4b2-9546-4b3a-92a6-b05e45f6f27a None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:11.178009 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219bc20f-67cf-4e0c-8153-1e1aab9cfc31 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:11.242812 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f27845-fe7c-4069-8690-a38682536184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:11.243462 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f27845-fe7c-4069-8690-a38682536184 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:11.243746 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f27845-fe7c-4069-8690-a38682536184 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:11.244023 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f27845-fe7c-4069-8690-a38682536184 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:11.255092 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f27845-fe7c-4069-8690-a38682536184 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:42:11.262105 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-75f27845-fe7c-4069-8690-a38682536184 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:42:11.262105 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:11.262105 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:42:11.262105 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:42:11.262105 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:42:11.262105 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:42:11.262105 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:42:11.262105 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:42:11.262105 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:42:11.262105 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:42:11.262105 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:42:11.262105 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:42:11.262105 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:42:11.262105 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:42:11.262105 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:42:11.262105 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:42:11.263517 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:42:11.263517 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:42:11.263517 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:42:11.263517 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:42:11.263517 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:42:11.263517 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:42:11.263517 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:42:11.263517 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:42:11.263517 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:42:11.263517 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:42:11.263517 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:42:11.263517 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:42:11.263517 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:42:11.263517 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:42:11.263517 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:42:11.263517 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:42:11.264284 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:42:11.264284 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:42:11.264284 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:42:11.264284 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:42:11.264284 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:42:11.264284 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:42:11.264284 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:42:11.264284 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:42:11.264284 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:42:11.264284 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:42:11.264284 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:42:11.264284 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:42:11.264284 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 77/148] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:42:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:42:11.269557 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f27845-fe7c-4069-8690-a38682536184 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:11.270566 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:11.327737 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b8f4b2-9546-4b3a-92a6-b05e45f6f27a None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:11.383889 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:11.393341 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047104f0-928d-4123-ac57-5ff8bf304190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:11.393996 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047104f0-928d-4123-ac57-5ff8bf304190 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:11.394306 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047104f0-928d-4123-ac57-5ff8bf304190 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:11.394588 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047104f0-928d-4123-ac57-5ff8bf304190 None admin] PATH_INFO: `/v3/users/0cd5248dbbd44fb49ccfc944c366de6e` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:11.398846 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047104f0-928d-4123-ac57-5ff8bf304190 None admin] RBAC: Authorizing `identity:get_user(user_id=0cd5248dbbd44fb49ccfc944c366de6e)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:11.400312 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047104f0-928d-4123-ac57-5ff8bf304190 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:11.410544 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 72/149] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 7 15:42:11 2022] GET /identity/v3/users/0cd5248dbbd44fb49ccfc944c366de6e => generated 289 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:11.431971 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047104f0-928d-4123-ac57-5ff8bf304190 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:11.461337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f27845-fe7c-4069-8690-a38682536184 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:11.511008 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0244e-37c3-4f1a-b913-de85b9d14050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:11.511644 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0244e-37c3-4f1a-b913-de85b9d14050 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:11.511926 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0244e-37c3-4f1a-b913-de85b9d14050 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:11.512203 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0244e-37c3-4f1a-b913-de85b9d14050 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:11.513269 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec0244e-37c3-4f1a-b913-de85b9d14050 None admin] RBAC: Adding query filter params (name=member) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:11.513757 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec0244e-37c3-4f1a-b913-de85b9d14050 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:11.515226 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec0244e-37c3-4f1a-b913-de85b9d14050 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:11.532133 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 78/150] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 7 15:42:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:11.539227 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0244e-37c3-4f1a-b913-de85b9d14050 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:11.569465 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047104f0-928d-4123-ac57-5ff8bf304190 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:11.612458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:11.625439 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92a72f-1558-4a9e-b23a-7976754ffac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:11.626439 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92a72f-1558-4a9e-b23a-7976754ffac5 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:11.627161 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92a72f-1558-4a9e-b23a-7976754ffac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:11.628045 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92a72f-1558-4a9e-b23a-7976754ffac5 None admin] PATH_INFO: `/v3/projects/6e5edf54975843879025d05c7e7a65d7` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:11.629907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d92a72f-1558-4a9e-b23a-7976754ffac5 None admin] RBAC: Authorizing `identity:get_project(project_id=6e5edf54975843879025d05c7e7a65d7)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:11.632331 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d92a72f-1558-4a9e-b23a-7976754ffac5 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:11.634883 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 73/151] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 7 15:42:11 2022] GET /identity/v3/projects/6e5edf54975843879025d05c7e7a65d7 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:11.642231 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92a72f-1558-4a9e-b23a-7976754ffac5 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:11.701988 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0244e-37c3-4f1a-b913-de85b9d14050 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:11.730276 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:11.771138 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750b846-5315-476c-9721-588e7e65cfa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:11.771793 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750b846-5315-476c-9721-588e7e65cfa6 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:11.772076 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750b846-5315-476c-9721-588e7e65cfa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:11.772353 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750b846-5315-476c-9721-588e7e65cfa6 None admin] PATH_INFO: `/v3/users/00b45084548b49ba9aed5a6091a253ce` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:11.774473 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9750b846-5315-476c-9721-588e7e65cfa6 None admin] RBAC: Authorizing `identity:get_user(user_id=00b45084548b49ba9aed5a6091a253ce)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:11.775935 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9750b846-5315-476c-9721-588e7e65cfa6 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:11.779367 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 79/152] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 7 15:42:11 2022] GET /identity/v3/users/00b45084548b49ba9aed5a6091a253ce => generated 275 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:11.787493 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750b846-5315-476c-9721-588e7e65cfa6 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:11.851907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92a72f-1558-4a9e-b23a-7976754ffac5 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:11.925991 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f9cab-0597-4c62-b509-8e7d8fa0f97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:11.926615 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f9cab-0597-4c62-b509-8e7d8fa0f97b None admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:11.926896 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f9cab-0597-4c62-b509-8e7d8fa0f97b None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:11.927168 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f9cab-0597-4c62-b509-8e7d8fa0f97b None admin] PATH_INFO: `/v3/projects/6e5edf54975843879025d05c7e7a65d7/users/0cd5248dbbd44fb49ccfc944c366de6e/roles/903d756c82454add946529986655408d` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:11.931455 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331f9cab-0597-4c62-b509-8e7d8fa0f97b None admin] RBAC: Authorizing `identity:create_grant(project_id=6e5edf54975843879025d05c7e7a65d7, user_id=0cd5248dbbd44fb49ccfc944c366de6e, role_id=903d756c82454add946529986655408d)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:11.932933 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331f9cab-0597-4c62-b509-8e7d8fa0f97b None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:11.958853 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 74/153] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 7 15:42:11 2022] PUT /identity/v3/projects/6e5edf54975843879025d05c7e7a65d7/users/0cd5248dbbd44fb49ccfc944c366de6e/roles/903d756c82454add946529986655408d => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 15:42:11.992680 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750b846-5315-476c-9721-588e7e65cfa6 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:12.056157 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de16d21b-afab-4143-b838-10f0e9e31382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:12.057143 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16d21b-afab-4143-b838-10f0e9e31382 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:12.057624 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16d21b-afab-4143-b838-10f0e9e31382 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:12.058101 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16d21b-afab-4143-b838-10f0e9e31382 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:12.129744 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:12.142204 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e5d27-6406-44d9-8e4b-5507a3f3da48 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:12.142204 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e5d27-6406-44d9-8e4b-5507a3f3da48 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:12.142204 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e5d27-6406-44d9-8e4b-5507a3f3da48 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:12.142204 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 75/154] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:42:12.149347 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ed74f-53aa-457f-8cd3-05516ab0073e None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:12.149673 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ed74f-53aa-457f-8cd3-05516ab0073e None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:12.149910 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ed74f-53aa-457f-8cd3-05516ab0073e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:12.161438 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de16d21b-afab-4143-b838-10f0e9e31382 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:12.167531 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de16d21b-afab-4143-b838-10f0e9e31382 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:12.194575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-9e3ed74f-53aa-457f-8cd3-05516ab0073e None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:12.195739 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-9e3ed74f-53aa-457f-8cd3-05516ab0073e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:12.300937 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:12.313033 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 80/155] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:42:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:42:12.319993 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de16d21b-afab-4143-b838-10f0e9e31382 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:12.342704 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 76/156] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:42:12.415615 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:12.439260 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de16d21b-afab-4143-b838-10f0e9e31382 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:12.476058 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b45db-8674-4e4c-98c0-e1a89f8c578b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:12.476634 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b45db-8674-4e4c-98c0-e1a89f8c578b None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:12.476918 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b45db-8674-4e4c-98c0-e1a89f8c578b None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:12.477193 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b45db-8674-4e4c-98c0-e1a89f8c578b None admin] PATH_INFO: `/v3/projects/6e5edf54975843879025d05c7e7a65d7` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:12.478388 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b45db-8674-4e4c-98c0-e1a89f8c578b None admin] RBAC: Authorizing `identity:get_project(project_id=6e5edf54975843879025d05c7e7a65d7)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:12.479848 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b45db-8674-4e4c-98c0-e1a89f8c578b None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:12.481807 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 81/157] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 7 15:42:12 2022] GET /identity/v3/projects/6e5edf54975843879025d05c7e7a65d7 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:42:12.487895 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ed74f-53aa-457f-8cd3-05516ab0073e None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:12.554520 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2fadee-5922-4542-ba6b-473fe6af51f1 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:12.555399 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2fadee-5922-4542-ba6b-473fe6af51f1 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:12.555921 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2fadee-5922-4542-ba6b-473fe6af51f1 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:12.558294 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 82/158] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:42:12.566391 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf76735-9ce3-474b-a735-664f84aaef88 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:12.566969 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf76735-9ce3-474b-a735-664f84aaef88 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:12.567685 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf76735-9ce3-474b-a735-664f84aaef88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:12.614358 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-bdf76735-9ce3-474b-a735-664f84aaef88 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:12.615896 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-bdf76735-9ce3-474b-a735-664f84aaef88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:12.642395 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ed74f-53aa-457f-8cd3-05516ab0073e None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:12.681904 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d8d693-cc1f-40a9-bfbf-b502a4740f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:12.683015 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8d693-cc1f-40a9-bfbf-b502a4740f23 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:12.683442 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8d693-cc1f-40a9-bfbf-b502a4740f23 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:12.684014 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8d693-cc1f-40a9-bfbf-b502a4740f23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:12.684979 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d8d693-cc1f-40a9-bfbf-b502a4740f23 None admin] RBAC: Adding query filter params (role.id=d45e39b4ad4e4ce782ec649246438663, scope.project.id=6e5edf54975843879025d05c7e7a65d7, user.id=00b45084548b49ba9aed5a6091a253ce) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:12.685444 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d8d693-cc1f-40a9-bfbf-b502a4740f23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:12.687427 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d8d693-cc1f-40a9-bfbf-b502a4740f23 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:12.694656 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 77/159] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 7 15:42:12 2022] GET /identity/v3/role_assignments?user.id=00b45084548b49ba9aed5a6091a253ce&scope.project.id=6e5edf54975843879025d05c7e7a65d7&role.id=d45e39b4ad4e4ce782ec649246438663 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:12.745514 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 83/160] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:42:12.850347 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d8d693-cc1f-40a9-bfbf-b502a4740f23 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:12.907800 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:12.976777 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d8d693-cc1f-40a9-bfbf-b502a4740f23 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:13.023566 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b1d66-dbb0-4a75-b6a6-94c39b449082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:13.024477 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b1d66-dbb0-4a75-b6a6-94c39b449082 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:13.024913 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b1d66-dbb0-4a75-b6a6-94c39b449082 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:13.025341 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b1d66-dbb0-4a75-b6a6-94c39b449082 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:13.059217 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b1d66-dbb0-4a75-b6a6-94c39b449082 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:42:13.065416 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-6f9b1d66-dbb0-4a75-b6a6-94c39b449082 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:42:13.065416 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:13.065416 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:42:13.065416 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:42:13.065416 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:42:13.065416 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:42:13.065416 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:42:13.065416 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:42:13.065416 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:42:13.065416 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:42:13.065416 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:42:13.065416 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:42:13.065416 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:42:13.065416 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:42:13.065416 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:42:13.065416 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:42:13.070680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:42:13.070680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:42:13.070680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:42:13.070680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:42:13.070680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:42:13.070680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:42:13.070680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:42:13.070680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:42:13.070680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:42:13.070680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:42:13.070680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:42:13.070680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:42:13.070680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:42:13.070680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:42:13.070680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:42:13.070680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:42:13.071700 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:42:13.071700 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:42:13.071700 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:42:13.071700 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:42:13.071700 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:42:13.071700 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:42:13.071700 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:42:13.071700 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:42:13.071700 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:42:13.071700 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:42:13.071700 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:42:13.071700 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:42:13.073834 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 78/161] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 7 15:42:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:42:13.080600 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf76735-9ce3-474b-a735-664f84aaef88 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:13.171147 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:13.196307 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf76735-9ce3-474b-a735-664f84aaef88 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:13.244512 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2e73d-e1cf-4ca4-8875-9b36f1774500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:13.245411 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2e73d-e1cf-4ca4-8875-9b36f1774500 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:13.245857 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2e73d-e1cf-4ca4-8875-9b36f1774500 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:13.246307 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2e73d-e1cf-4ca4-8875-9b36f1774500 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:13.247677 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2e73d-e1cf-4ca4-8875-9b36f1774500 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:13.248137 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2e73d-e1cf-4ca4-8875-9b36f1774500 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:13.249714 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2e73d-e1cf-4ca4-8875-9b36f1774500 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:13.259790 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 84/162] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:42:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:13.266110 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b1d66-dbb0-4a75-b6a6-94c39b449082 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:13.398201 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b1d66-dbb0-4a75-b6a6-94c39b449082 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:13.410529 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:13.414726 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2e73d-e1cf-4ca4-8875-9b36f1774500 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:13.478624 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e5669-ccb4-4490-8858-48875965494b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:13.479632 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e5669-ccb4-4490-8858-48875965494b None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:13.480123 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e5669-ccb4-4490-8858-48875965494b None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:13.480689 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e5669-ccb4-4490-8858-48875965494b None admin] PATH_INFO: `/v3/users/939472ebcad74baeadd29e0d5a82843a` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:13.486912 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13e5669-ccb4-4490-8858-48875965494b None admin] RBAC: Authorizing `identity:get_user(user_id=939472ebcad74baeadd29e0d5a82843a)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:13.488733 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13e5669-ccb4-4490-8858-48875965494b None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:13.490694 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 79/163] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 7 15:42:13 2022] GET /identity/v3/users/939472ebcad74baeadd29e0d5a82843a => generated 247 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:13.492060 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6a038-ff34-4d7a-b9b1-cb9ad838579d None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:13.492554 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6a038-ff34-4d7a-b9b1-cb9ad838579d None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:13.493125 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6a038-ff34-4d7a-b9b1-cb9ad838579d None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:13.494636 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 80/164] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:42:13.500578 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c9cf7-99e8-4ef9-8558-03b6d831c990 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:13.501127 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c9cf7-99e8-4ef9-8558-03b6d831c990 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:13.501606 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c9cf7-99e8-4ef9-8558-03b6d831c990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:13.535500 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-e56c9cf7-99e8-4ef9-8558-03b6d831c990 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:13.537077 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-e56c9cf7-99e8-4ef9-8558-03b6d831c990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:13.572247 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2e73d-e1cf-4ca4-8875-9b36f1774500 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:13.621227 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610ec6e-99f3-4d50-8260-3bf940809242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:13.622441 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610ec6e-99f3-4d50-8260-3bf940809242 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:13.622740 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610ec6e-99f3-4d50-8260-3bf940809242 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:13.623016 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610ec6e-99f3-4d50-8260-3bf940809242 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:13.634730 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c610ec6e-99f3-4d50-8260-3bf940809242 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:42:13.642079 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-c610ec6e-99f3-4d50-8260-3bf940809242 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 15:42:13.642079 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:13.642079 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:42:13.642079 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:42:13.642079 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:42:13.642079 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:42:13.642079 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:42:13.642079 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:42:13.642079 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:42:13.642079 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:42:13.642079 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:42:13.642079 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:42:13.642079 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:42:13.642079 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:42:13.642079 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:42:13.642079 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:42:13.643009 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:42:13.643009 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:42:13.643009 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:42:13.643009 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:42:13.643009 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:42:13.643009 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:42:13.643009 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:42:13.643009 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:42:13.643009 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:42:13.643009 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:42:13.643009 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:42:13.643009 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:42:13.643009 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:42:13.643009 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:42:13.643009 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:42:13.643009 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:42:13.644018 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:42:13.644018 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:42:13.644018 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:42:13.644018 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:42:13.644018 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:42:13.644018 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:42:13.644018 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:42:13.644018 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:42:13.644018 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:42:13.644018 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:42:13.644018 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 15:42:13.644018 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:42:13.647409 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 85/165] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 7 15:42:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:42:13.648526 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610ec6e-99f3-4d50-8260-3bf940809242 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:13.655133 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:13.811746 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 81/166] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:42:13.813373 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c9cf7-99e8-4ef9-8558-03b6d831c990 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:13.838545 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610ec6e-99f3-4d50-8260-3bf940809242 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:13.916388 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4fc54-0a89-4c4e-ac9c-3d11905af523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:13.916940 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4fc54-0a89-4c4e-ac9c-3d11905af523 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:13.917217 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4fc54-0a89-4c4e-ac9c-3d11905af523 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:13.917497 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4fc54-0a89-4c4e-ac9c-3d11905af523 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:14.015720 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c9cf7-99e8-4ef9-8558-03b6d831c990 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:14.030265 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:14.100741 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4fc54-0a89-4c4e-ac9c-3d11905af523 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:14.103710 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4fc54-0a89-4c4e-ac9c-3d11905af523 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:14.110489 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:14.123584 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a34c33-17f4-43d9-8ec4-426c9b70b570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:14.124300 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a34c33-17f4-43d9-8ec4-426c9b70b570 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:14.124638 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a34c33-17f4-43d9-8ec4-426c9b70b570 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:14.124995 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a34c33-17f4-43d9-8ec4-426c9b70b570 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:14.125736 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a34c33-17f4-43d9-8ec4-426c9b70b570 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:14.126105 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a34c33-17f4-43d9-8ec4-426c9b70b570 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:14.127570 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a34c33-17f4-43d9-8ec4-426c9b70b570 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:14.149727 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 82/167] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:42:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:14.155513 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a34c33-17f4-43d9-8ec4-426c9b70b570 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:14.315492 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 86/168] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:42:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 667 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:42:14.317742 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4fc54-0a89-4c4e-ac9c-3d11905af523 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:14.346579 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a34c33-17f4-43d9-8ec4-426c9b70b570 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:14.412942 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfa4d5-c7e1-4661-a5bb-0e97719f5736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:14.413579 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfa4d5-c7e1-4661-a5bb-0e97719f5736 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:14.413856 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfa4d5-c7e1-4661-a5bb-0e97719f5736 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:14.414121 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfa4d5-c7e1-4661-a5bb-0e97719f5736 None admin] PATH_INFO: `/v3/users/00b45084548b49ba9aed5a6091a253ce` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:14.416228 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddfa4d5-c7e1-4661-a5bb-0e97719f5736 None admin] RBAC: Authorizing `identity:get_user(user_id=00b45084548b49ba9aed5a6091a253ce)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:14.417754 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddfa4d5-c7e1-4661-a5bb-0e97719f5736 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:14.420143 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 83/169] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 7 15:42:14 2022] GET /identity/v3/users/00b45084548b49ba9aed5a6091a253ce => generated 275 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:14.422313 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfa4d5-c7e1-4661-a5bb-0e97719f5736 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:14.490773 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:14.506539 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4fc54-0a89-4c4e-ac9c-3d11905af523 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:14.508571 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:14.576566 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25b89c-47b8-4a23-acd6-aed5d362fcf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:14.577090 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25b89c-47b8-4a23-acd6-aed5d362fcf0 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:14.577364 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25b89c-47b8-4a23-acd6-aed5d362fcf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:14.577633 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25b89c-47b8-4a23-acd6-aed5d362fcf0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:14.600641 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b25b89c-47b8-4a23-acd6-aed5d362fcf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:42:14.612569 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-7b25b89c-47b8-4a23-acd6-aed5d362fcf0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:42:14.612569 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:14.612569 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:42:14.612569 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:42:14.612569 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:42:14.612569 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:42:14.612569 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:42:14.612569 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:42:14.612569 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:42:14.612569 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:42:14.612569 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:42:14.612569 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:42:14.612569 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:42:14.612569 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:42:14.612569 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:42:14.612569 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:42:14.613495 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:42:14.613495 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:42:14.613495 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:42:14.613495 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:42:14.613495 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:42:14.613495 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:42:14.613495 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:42:14.613495 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:42:14.613495 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:42:14.613495 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:42:14.613495 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:42:14.613495 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:42:14.613495 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:42:14.613495 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:42:14.613495 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:42:14.613495 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:42:14.614337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:42:14.614337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:42:14.614337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:42:14.614337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:42:14.614337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:42:14.614337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:42:14.614337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:42:14.614337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:42:14.614337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:42:14.614337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:42:14.614337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:42:14.614337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:42:14.614337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 87/170] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:42:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:42:14.618639 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25b89c-47b8-4a23-acd6-aed5d362fcf0 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:14.619269 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfa4d5-c7e1-4661-a5bb-0e97719f5736 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:14.694975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe60aec-a770-4cda-8e12-7c67a1d4eac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:14.695629 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe60aec-a770-4cda-8e12-7c67a1d4eac4 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:14.695911 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe60aec-a770-4cda-8e12-7c67a1d4eac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:14.696184 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe60aec-a770-4cda-8e12-7c67a1d4eac4 None admin] PATH_INFO: `/v3/projects/6e5edf54975843879025d05c7e7a65d7` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:14.698408 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe60aec-a770-4cda-8e12-7c67a1d4eac4 None admin] RBAC: Authorizing `identity:get_project(project_id=6e5edf54975843879025d05c7e7a65d7)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:14.699953 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe60aec-a770-4cda-8e12-7c67a1d4eac4 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:14.701774 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 84/171] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 7 15:42:14 2022] GET /identity/v3/projects/6e5edf54975843879025d05c7e7a65d7 => generated 298 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:14.703534 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe60aec-a770-4cda-8e12-7c67a1d4eac4 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:14.839742 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25b89c-47b8-4a23-acd6-aed5d362fcf0 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:14.843874 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe60aec-a770-4cda-8e12-7c67a1d4eac4 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:14.846204 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:14.890870 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aef10e-d86d-44cd-876e-081b9e574064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:14.891485 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aef10e-d86d-44cd-876e-081b9e574064 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:14.891768 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aef10e-d86d-44cd-876e-081b9e574064 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:14.892044 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aef10e-d86d-44cd-876e-081b9e574064 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:14.897853 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9b022-98ad-4354-8782-8357f5de9d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:14.898502 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9b022-98ad-4354-8782-8357f5de9d86 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:14.898786 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9b022-98ad-4354-8782-8357f5de9d86 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:14.899062 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9b022-98ad-4354-8782-8357f5de9d86 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:14.899736 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb9b022-98ad-4354-8782-8357f5de9d86 None admin] RBAC: Adding query filter params (name=member) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:14.900041 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb9b022-98ad-4354-8782-8357f5de9d86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:14.901433 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb9b022-98ad-4354-8782-8357f5de9d86 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:14.919187 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 85/172] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 7 15:42:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:14.920014 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9b022-98ad-4354-8782-8357f5de9d86 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:14.939471 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:15.009425 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aef10e-d86d-44cd-876e-081b9e574064 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:15.011310 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aef10e-d86d-44cd-876e-081b9e574064 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:15.214215 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9b022-98ad-4354-8782-8357f5de9d86 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:15.269331 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 88/173] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:42:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 655 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:42:15.270582 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aef10e-d86d-44cd-876e-081b9e574064 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:15.283858 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54fd92-bd10-44f6-841d-58b941690f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:15.284483 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54fd92-bd10-44f6-841d-58b941690f48 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:15.284760 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54fd92-bd10-44f6-841d-58b941690f48 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:15.285030 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54fd92-bd10-44f6-841d-58b941690f48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:15.285763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c54fd92-bd10-44f6-841d-58b941690f48 None admin] RBAC: Adding query filter params (role.id=61605ebf17e643258730e55bf6db15ad, scope.project.id=6e5edf54975843879025d05c7e7a65d7, user.id=939472ebcad74baeadd29e0d5a82843a) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:15.286131 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c54fd92-bd10-44f6-841d-58b941690f48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:15.289311 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c54fd92-bd10-44f6-841d-58b941690f48 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:15.299354 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 86/174] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 7 15:42:14 2022] GET /identity/v3/role_assignments?user.id=939472ebcad74baeadd29e0d5a82843a&scope.project.id=6e5edf54975843879025d05c7e7a65d7&role.id=61605ebf17e643258730e55bf6db15ad => generated 608 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:15.300150 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54fd92-bd10-44f6-841d-58b941690f48 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:15.381921 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:15.401274 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:15.491026 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aef10e-d86d-44cd-876e-081b9e574064 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:15.555561 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4084971-a2c5-4b2a-a5d1-aad3d1c0fc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:15.556398 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4084971-a2c5-4b2a-a5d1-aad3d1c0fc2f None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:15.556522 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4084971-a2c5-4b2a-a5d1-aad3d1c0fc2f None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:15.556749 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4084971-a2c5-4b2a-a5d1-aad3d1c0fc2f None admin] PATH_INFO: `/v3/users/00b45084548b49ba9aed5a6091a253ce` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:15.558283 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4084971-a2c5-4b2a-a5d1-aad3d1c0fc2f None admin] RBAC: Authorizing `identity:get_user(user_id=00b45084548b49ba9aed5a6091a253ce)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:15.560758 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4084971-a2c5-4b2a-a5d1-aad3d1c0fc2f None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:15.562753 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 89/175] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 7 15:42:15 2022] GET /identity/v3/users/00b45084548b49ba9aed5a6091a253ce => generated 275 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:15.565148 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c7e55-0ac6-4bbb-b6cf-c03726b3a9cd None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:15.565433 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c7e55-0ac6-4bbb-b6cf-c03726b3a9cd None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:15.565708 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c7e55-0ac6-4bbb-b6cf-c03726b3a9cd None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:15.567479 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 90/176] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:42:15.573154 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa65184-602d-48be-af01-9efc6bf818ff None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:15.573441 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa65184-602d-48be-af01-9efc6bf818ff None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:15.573711 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa65184-602d-48be-af01-9efc6bf818ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:15.593789 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54fd92-bd10-44f6-841d-58b941690f48 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:15.609191 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-efa65184-602d-48be-af01-9efc6bf818ff None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:15.610435 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-efa65184-602d-48be-af01-9efc6bf818ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:15.660178 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118411ce-1e8e-4fdf-9719-da95af34eaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:15.660819 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118411ce-1e8e-4fdf-9719-da95af34eaaf None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:15.661096 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118411ce-1e8e-4fdf-9719-da95af34eaaf None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:15.661373 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118411ce-1e8e-4fdf-9719-da95af34eaaf None admin] PATH_INFO: `/v3/projects/6e5edf54975843879025d05c7e7a65d7` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:15.662618 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118411ce-1e8e-4fdf-9719-da95af34eaaf None admin] RBAC: Authorizing `identity:get_project(project_id=6e5edf54975843879025d05c7e7a65d7)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:15.664069 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118411ce-1e8e-4fdf-9719-da95af34eaaf None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:15.665687 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 87/177] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 7 15:42:15 2022] GET /identity/v3/projects/6e5edf54975843879025d05c7e7a65d7 => generated 298 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:15.667490 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118411ce-1e8e-4fdf-9719-da95af34eaaf None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:15.733232 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 91/178] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:42:15.734225 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa65184-602d-48be-af01-9efc6bf818ff None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:15.813684 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:15.817424 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118411ce-1e8e-4fdf-9719-da95af34eaaf None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:15.823676 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:15.873975 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa65184-602d-48be-af01-9efc6bf818ff None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:15.875130 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169cdd53-88ac-48f1-b057-ddd2c1e40dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:15.875776 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169cdd53-88ac-48f1-b057-ddd2c1e40dd5 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:15.876068 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169cdd53-88ac-48f1-b057-ddd2c1e40dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:15.876349 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169cdd53-88ac-48f1-b057-ddd2c1e40dd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:15.922037 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc0d34-d378-4d8f-8c1a-7601b8694465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:15.922966 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc0d34-d378-4d8f-8c1a-7601b8694465 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:15.923436 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc0d34-d378-4d8f-8c1a-7601b8694465 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:15.923854 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc0d34-d378-4d8f-8c1a-7601b8694465 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:15.924829 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fc0d34-d378-4d8f-8c1a-7601b8694465 None admin] RBAC: Adding query filter params (role.id=ce978876ff724bf3b4101c9fd4d2d842, scope.project.id=6e5edf54975843879025d05c7e7a65d7, user.id=00b45084548b49ba9aed5a6091a253ce) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:15.925434 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fc0d34-d378-4d8f-8c1a-7601b8694465 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:15.927068 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fc0d34-d378-4d8f-8c1a-7601b8694465 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:15.933689 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 92/179] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 7 15:42:15 2022] GET /identity/v3/role_assignments?user.id=00b45084548b49ba9aed5a6091a253ce&scope.project.id=6e5edf54975843879025d05c7e7a65d7&role.id=ce978876ff724bf3b4101c9fd4d2d842 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:15.936009 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71711273-3c5d-4598-9cac-050b5b3cdb28 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:15.936466 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71711273-3c5d-4598-9cac-050b5b3cdb28 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:15.936884 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71711273-3c5d-4598-9cac-050b5b3cdb28 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:15.938574 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 93/180] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:42:15.944169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a65659-af87-4114-8bde-da8f707d8578 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:15.944650 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a65659-af87-4114-8bde-da8f707d8578 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:15.945083 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a65659-af87-4114-8bde-da8f707d8578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:15.974807 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-70a65659-af87-4114-8bde-da8f707d8578 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:15.976329 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-70a65659-af87-4114-8bde-da8f707d8578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:15.980622 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169cdd53-88ac-48f1-b057-ddd2c1e40dd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:15.991221 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169cdd53-88ac-48f1-b057-ddd2c1e40dd5 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:16.103437 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 94/181] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:42:16.105765 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf5826-46a0-4c71-984a-3a6091acf93c None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:16.106980 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf5826-46a0-4c71-984a-3a6091acf93c None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:16.107252 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf5826-46a0-4c71-984a-3a6091acf93c None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:16.111997 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 95/182] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:42:16.120249 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548500b-6964-47ac-b014-5be6f69c4aa0 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:16.120572 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548500b-6964-47ac-b014-5be6f69c4aa0 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:16.120811 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548500b-6964-47ac-b014-5be6f69c4aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:16.149175 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-c548500b-6964-47ac-b014-5be6f69c4aa0 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:16.150445 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-c548500b-6964-47ac-b014-5be6f69c4aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:16.187976 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:16.193050 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 88/183] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:42:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:42:16.193975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169cdd53-88ac-48f1-b057-ddd2c1e40dd5 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:16.209262 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:16.230559 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 96/184] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:42:16.232281 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc0568-9c42-4e60-ada1-18355af1f009 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:16.232582 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc0568-9c42-4e60-ada1-18355af1f009 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:16.232866 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc0568-9c42-4e60-ada1-18355af1f009 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:16.234142 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 97/185] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:42:16.235778 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc0568-9c42-4e60-ada1-18355af1f009 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:16.307722 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169cdd53-88ac-48f1-b057-ddd2c1e40dd5 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:16.347312 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc0568-9c42-4e60-ada1-18355af1f009 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:16.347691 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b26ca2-fd64-4dca-b070-2d138ff065a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:16.348339 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b26ca2-fd64-4dca-b070-2d138ff065a5 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:16.348623 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b26ca2-fd64-4dca-b070-2d138ff065a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:16.349004 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b26ca2-fd64-4dca-b070-2d138ff065a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:16.367021 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b26ca2-fd64-4dca-b070-2d138ff065a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:42:16.373181 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-d7b26ca2-fd64-4dca-b070-2d138ff065a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:42:16.373181 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:16.373181 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:42:16.373181 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:42:16.373181 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:42:16.373181 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:42:16.373181 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:42:16.373181 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:42:16.373181 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:42:16.373181 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:42:16.373181 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:42:16.373181 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:42:16.373181 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:42:16.373181 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:42:16.373181 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:42:16.373181 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:42:16.374053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:42:16.374053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:42:16.374053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:42:16.374053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:42:16.374053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:42:16.374053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:42:16.374053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:42:16.374053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:42:16.374053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:42:16.374053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:42:16.374053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:42:16.374053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:42:16.374053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:42:16.374053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:42:16.374053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:42:16.374053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:42:16.374870 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:42:16.374870 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:42:16.374870 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:42:16.374870 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:42:16.374870 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:42:16.374870 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:42:16.374870 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:42:16.374870 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:42:16.374870 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:42:16.374870 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:42:16.374870 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:42:16.374870 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:42:16.374870 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 89/186] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 7 15:42:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:42:16.376377 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d2fb6-55a9-4fc4-8a69-4917cf052d13 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:16.376669 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d2fb6-55a9-4fc4-8a69-4917cf052d13 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:16.376949 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d2fb6-55a9-4fc4-8a69-4917cf052d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:16.397793 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-f72d2fb6-55a9-4fc4-8a69-4917cf052d13 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:16.399054 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-f72d2fb6-55a9-4fc4-8a69-4917cf052d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:16.400360 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd6e09a-12c2-4bab-bf83-875ea52592dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:16.401255 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd6e09a-12c2-4bab-bf83-875ea52592dd None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:16.401739 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd6e09a-12c2-4bab-bf83-875ea52592dd None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:16.402249 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd6e09a-12c2-4bab-bf83-875ea52592dd None admin] PATH_INFO: `/v3/projects/989d5612508c4db0bfb7444b2b2cf53a` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:16.406230 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd6e09a-12c2-4bab-bf83-875ea52592dd None admin] RBAC: Authorizing `identity:get_project(project_id=989d5612508c4db0bfb7444b2b2cf53a)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:16.407895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd6e09a-12c2-4bab-bf83-875ea52592dd None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:16.410042 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 98/187] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 7 15:42:16 2022] GET /identity/v3/projects/989d5612508c4db0bfb7444b2b2cf53a => generated 312 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:16.410993 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd6e09a-12c2-4bab-bf83-875ea52592dd None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:16.471963 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:16.475103 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:16.488297 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 90/188] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:42:16.489117 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d2fb6-55a9-4fc4-8a69-4917cf052d13 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:16.542002 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd6e09a-12c2-4bab-bf83-875ea52592dd None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:16.580625 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0715ae-e58f-47fb-b50c-6e2c77214ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:16.581341 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0715ae-e58f-47fb-b50c-6e2c77214ad1 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:16.581618 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0715ae-e58f-47fb-b50c-6e2c77214ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:16.581886 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0715ae-e58f-47fb-b50c-6e2c77214ad1 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:16.582565 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0715ae-e58f-47fb-b50c-6e2c77214ad1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:16.582866 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0715ae-e58f-47fb-b50c-6e2c77214ad1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:16.584357 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0715ae-e58f-47fb-b50c-6e2c77214ad1 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:16.593802 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 99/189] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:42:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:16.593802 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0715ae-e58f-47fb-b50c-6e2c77214ad1 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:16.610133 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d2fb6-55a9-4fc4-8a69-4917cf052d13 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:16.645653 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac8f4a-a6df-45cd-b37b-ed5392db6b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:16.646194 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac8f4a-a6df-45cd-b37b-ed5392db6b1d None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:16.646690 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac8f4a-a6df-45cd-b37b-ed5392db6b1d None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:16.646794 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac8f4a-a6df-45cd-b37b-ed5392db6b1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:16.647467 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac8f4a-a6df-45cd-b37b-ed5392db6b1d None admin] RBAC: Adding query filter params (role.id=d45e39b4ad4e4ce782ec649246438663, scope.project.id=989d5612508c4db0bfb7444b2b2cf53a, user.id=00b45084548b49ba9aed5a6091a253ce) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:16.647775 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac8f4a-a6df-45cd-b37b-ed5392db6b1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:16.649211 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac8f4a-a6df-45cd-b37b-ed5392db6b1d None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:16.666222 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 91/190] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 7 15:42:16 2022] GET /identity/v3/role_assignments?user.id=00b45084548b49ba9aed5a6091a253ce&scope.project.id=989d5612508c4db0bfb7444b2b2cf53a&role.id=d45e39b4ad4e4ce782ec649246438663 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:16.666222 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac8f4a-a6df-45cd-b37b-ed5392db6b1d None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:16.726395 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:16.736890 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0715ae-e58f-47fb-b50c-6e2c77214ad1 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:16.759610 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:16.784046 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0256fc-3b09-40f5-974d-92269d0ab873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:16.784294 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac8f4a-a6df-45cd-b37b-ed5392db6b1d None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:16.784699 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0256fc-3b09-40f5-974d-92269d0ab873 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:16.784979 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0256fc-3b09-40f5-974d-92269d0ab873 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:16.785250 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0256fc-3b09-40f5-974d-92269d0ab873 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:16.799516 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0256fc-3b09-40f5-974d-92269d0ab873 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:42:16.805087 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-8e0256fc-3b09-40f5-974d-92269d0ab873 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 15:42:16.805087 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:16.805087 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:42:16.805087 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:42:16.805087 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:42:16.805087 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:42:16.805087 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:42:16.805087 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:42:16.805087 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:42:16.805087 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:42:16.805087 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:42:16.805087 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:42:16.805087 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:42:16.805087 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:42:16.805087 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:42:16.805087 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:42:16.806056 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:42:16.806056 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:42:16.806056 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:42:16.806056 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:42:16.806056 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:42:16.806056 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:42:16.806056 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:42:16.806056 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:42:16.806056 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:42:16.806056 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:42:16.806056 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:42:16.806056 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:42:16.806056 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:42:16.806056 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:42:16.806056 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:42:16.806056 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:42:16.813732 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:42:16.813732 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:42:16.813732 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:42:16.813732 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:42:16.813732 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:42:16.813732 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:42:16.813732 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:42:16.813732 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:42:16.813732 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:42:16.813732 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:42:16.813732 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 15:42:16.813732 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:42:16.813732 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 100/191] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:42:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:42:16.813732 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0256fc-3b09-40f5-974d-92269d0ab873 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:16.833286 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04c22b4-b336-4179-934f-22b2ba14688c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:16.833948 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c22b4-b336-4179-934f-22b2ba14688c None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:16.834514 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c22b4-b336-4179-934f-22b2ba14688c None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:16.834865 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c22b4-b336-4179-934f-22b2ba14688c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:16.848902 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04c22b4-b336-4179-934f-22b2ba14688c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:42:16.854476 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-a04c22b4-b336-4179-934f-22b2ba14688c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 15:42:16.854476 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:16.854476 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:42:16.854476 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:42:16.854476 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:42:16.854476 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:42:16.854476 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:42:16.854476 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:42:16.854476 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:42:16.854476 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:42:16.854476 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:42:16.854476 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:42:16.854476 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:42:16.854476 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:42:16.854476 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:42:16.854476 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:42:16.855370 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:42:16.855370 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:42:16.855370 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:42:16.855370 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:42:16.855370 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:42:16.855370 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:42:16.855370 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:42:16.855370 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:42:16.855370 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:42:16.855370 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:42:16.855370 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:42:16.855370 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:42:16.855370 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:42:16.855370 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:42:16.855370 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:42:16.855370 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:42:16.856493 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:42:16.856493 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:42:16.856493 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:42:16.856493 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:42:16.856493 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:42:16.856493 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:42:16.856493 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:42:16.856493 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:42:16.856493 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:42:16.856493 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:42:16.856493 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 15:42:16.856493 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:42:16.856493 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 92/192] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 7 15:42:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:42:16.857636 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04c22b4-b336-4179-934f-22b2ba14688c None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:16.931009 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0256fc-3b09-40f5-974d-92269d0ab873 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:16.967285 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e061d4ef-5cab-4666-b00a-aef1fd5d61b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:16.967921 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061d4ef-5cab-4666-b00a-aef1fd5d61b3 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:16.968200 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061d4ef-5cab-4666-b00a-aef1fd5d61b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:16.968476 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061d4ef-5cab-4666-b00a-aef1fd5d61b3 None admin] PATH_INFO: `/v3/users/0f7457330c2f419ba73e987e07015188` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:16.970473 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04c22b4-b336-4179-934f-22b2ba14688c None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:16.981743 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e061d4ef-5cab-4666-b00a-aef1fd5d61b3 None admin] RBAC: Authorizing `identity:get_user(user_id=0f7457330c2f419ba73e987e07015188)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:16.983257 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e061d4ef-5cab-4666-b00a-aef1fd5d61b3 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:16.983890 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:16.985182 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 101/193] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 7 15:42:16 2022] GET /identity/v3/users/0f7457330c2f419ba73e987e07015188 => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:16.985957 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e061d4ef-5cab-4666-b00a-aef1fd5d61b3 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:17.006139 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c7ca5-114f-4a33-a4b1-8b46c70ddeb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:17.006805 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c7ca5-114f-4a33-a4b1-8b46c70ddeb5 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:17.007083 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c7ca5-114f-4a33-a4b1-8b46c70ddeb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:17.007355 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c7ca5-114f-4a33-a4b1-8b46c70ddeb5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:17.008525 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c7ca5-114f-4a33-a4b1-8b46c70ddeb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:17.009968 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c7ca5-114f-4a33-a4b1-8b46c70ddeb5 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:17.011556 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 93/194] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:42:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:17.012305 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c7ca5-114f-4a33-a4b1-8b46c70ddeb5 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:17.023403 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:17.093310 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e061d4ef-5cab-4666-b00a-aef1fd5d61b3 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:17.115882 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c7ca5-114f-4a33-a4b1-8b46c70ddeb5 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:17.129275 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d223d67-0ca2-4893-b529-a02c08d5ca03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:17.129891 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d223d67-0ca2-4893-b529-a02c08d5ca03 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:17.130170 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d223d67-0ca2-4893-b529-a02c08d5ca03 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:17.130466 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d223d67-0ca2-4893-b529-a02c08d5ca03 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:17.131125 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d223d67-0ca2-4893-b529-a02c08d5ca03 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:17.131429 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d223d67-0ca2-4893-b529-a02c08d5ca03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:17.132794 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d223d67-0ca2-4893-b529-a02c08d5ca03 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:17.141160 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 102/195] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 7 15:42:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:17.141937 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d223d67-0ca2-4893-b529-a02c08d5ca03 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:17.156746 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad39f2-4b15-44e3-841e-e3a867abe966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:17.157358 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad39f2-4b15-44e3-841e-e3a867abe966 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:17.157639 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad39f2-4b15-44e3-841e-e3a867abe966 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:17.157912 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad39f2-4b15-44e3-841e-e3a867abe966 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:17.158603 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad39f2-4b15-44e3-841e-e3a867abe966 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:17.158928 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad39f2-4b15-44e3-841e-e3a867abe966 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:17.160268 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad39f2-4b15-44e3-841e-e3a867abe966 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:17.168064 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 94/196] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:42:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:17.169026 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad39f2-4b15-44e3-841e-e3a867abe966 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:17.212184 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:17.235410 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:17.242876 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d223d67-0ca2-4893-b529-a02c08d5ca03 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:17.269061 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad39f2-4b15-44e3-841e-e3a867abe966 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:17.275995 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b86f1-809a-425c-9f4d-592cef989a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:17.276597 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b86f1-809a-425c-9f4d-592cef989a1f None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:17.276875 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b86f1-809a-425c-9f4d-592cef989a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:17.277146 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b86f1-809a-425c-9f4d-592cef989a1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:17.302099 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd98999-a2a3-4999-a7db-bb9606ae6af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:17.302730 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd98999-a2a3-4999-a7db-bb9606ae6af3 None admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:17.303013 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd98999-a2a3-4999-a7db-bb9606ae6af3 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:17.303294 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd98999-a2a3-4999-a7db-bb9606ae6af3 None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:17.303943 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd98999-a2a3-4999-a7db-bb9606ae6af3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:17.305375 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd98999-a2a3-4999-a7db-bb9606ae6af3 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:17.326147 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 95/197] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Sep 7 15:42:17 2022] POST /identity/v3/users => generated 297 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:42:17.327067 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd98999-a2a3-4999-a7db-bb9606ae6af3 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:17.354949 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b86f1-809a-425c-9f4d-592cef989a1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:17.357532 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b86f1-809a-425c-9f4d-592cef989a1f None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:17.441905 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:17.446013 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd98999-a2a3-4999-a7db-bb9606ae6af3 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:17.470750 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:17.482286 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 103/198] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:42:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:42:17.482286 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b86f1-809a-425c-9f4d-592cef989a1f None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:17.493458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e8e86-b83e-4a07-a26f-b63ced99d4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:17.494109 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e8e86-b83e-4a07-a26f-b63ced99d4e2 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:17.494424 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e8e86-b83e-4a07-a26f-b63ced99d4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:17.494701 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e8e86-b83e-4a07-a26f-b63ced99d4e2 None admin] PATH_INFO: `/v3/users/0cd5248dbbd44fb49ccfc944c366de6e` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:17.495953 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e8e86-b83e-4a07-a26f-b63ced99d4e2 None admin] RBAC: Authorizing `identity:get_user(user_id=0cd5248dbbd44fb49ccfc944c366de6e)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:17.497912 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e8e86-b83e-4a07-a26f-b63ced99d4e2 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:17.499545 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 96/199] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 7 15:42:17 2022] GET /identity/v3/users/0cd5248dbbd44fb49ccfc944c366de6e => generated 289 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:17.500472 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e8e86-b83e-4a07-a26f-b63ced99d4e2 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:17.615290 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b86f1-809a-425c-9f4d-592cef989a1f None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:17.623856 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e8e86-b83e-4a07-a26f-b63ced99d4e2 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:17.660601 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c2be5-3c1f-495b-acf9-6bbcebb5996c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:17.661292 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c2be5-3c1f-495b-acf9-6bbcebb5996c None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:17.661526 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c2be5-3c1f-495b-acf9-6bbcebb5996c None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:17.661793 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c2be5-3c1f-495b-acf9-6bbcebb5996c None admin] PATH_INFO: `/v3/users/0f7457330c2f419ba73e987e07015188` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:17.662951 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c2be5-3c1f-495b-acf9-6bbcebb5996c None admin] RBAC: Authorizing `identity:get_user(user_id=0f7457330c2f419ba73e987e07015188)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:17.663514 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9d541-5179-4b0c-b39a-2a8ace6d819b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:17.664151 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9d541-5179-4b0c-b39a-2a8ace6d819b None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:17.664433 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9d541-5179-4b0c-b39a-2a8ace6d819b None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:17.664529 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c2be5-3c1f-495b-acf9-6bbcebb5996c None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:17.664707 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9d541-5179-4b0c-b39a-2a8ace6d819b None admin] PATH_INFO: `/v3/projects/d428d47056754be5930f84ee53d099af` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:17.665843 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c9d541-5179-4b0c-b39a-2a8ace6d819b None admin] RBAC: Authorizing `identity:get_project(project_id=d428d47056754be5930f84ee53d099af)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:17.666473 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 104/200] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 7 15:42:17 2022] GET /identity/v3/users/0f7457330c2f419ba73e987e07015188 => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:17.667311 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c9d541-5179-4b0c-b39a-2a8ace6d819b None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:17.667475 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c2be5-3c1f-495b-acf9-6bbcebb5996c None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:17.669431 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 97/201] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 7 15:42:17 2022] GET /identity/v3/projects/d428d47056754be5930f84ee53d099af => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:17.671840 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9d541-5179-4b0c-b39a-2a8ace6d819b None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:17.712652 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:17.740813 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:17.783941 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c2be5-3c1f-495b-acf9-6bbcebb5996c None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:17.801215 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9d541-5179-4b0c-b39a-2a8ace6d819b None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:17.826946 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc2639b-a5c9-4726-abf4-3bb124eeae71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:17.827684 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2639b-a5c9-4726-abf4-3bb124eeae71 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:17.828033 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2639b-a5c9-4726-abf4-3bb124eeae71 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:17.828378 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2639b-a5c9-4726-abf4-3bb124eeae71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:17.847147 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84bfbf-408a-4128-b725-9dbf7de98242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:17.848023 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84bfbf-408a-4128-b725-9dbf7de98242 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:17.848307 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84bfbf-408a-4128-b725-9dbf7de98242 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:17.848976 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84bfbf-408a-4128-b725-9dbf7de98242 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:17.905160 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc2639b-a5c9-4726-abf4-3bb124eeae71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:17.906847 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc2639b-a5c9-4726-abf4-3bb124eeae71 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:17.949595 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84bfbf-408a-4128-b725-9dbf7de98242 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:17.951950 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84bfbf-408a-4128-b725-9dbf7de98242 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:17.975765 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:18.024036 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:18.027551 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 105/202] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:42:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:42:18.029203 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc2639b-a5c9-4726-abf4-3bb124eeae71 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:18.098261 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 98/203] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:42:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:42:18.099573 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84bfbf-408a-4128-b725-9dbf7de98242 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:18.166572 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc2639b-a5c9-4726-abf4-3bb124eeae71 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:18.212714 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a17e97-516b-4954-9fae-2f0aeea777a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:18.214233 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a17e97-516b-4954-9fae-2f0aeea777a6 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:18.215001 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a17e97-516b-4954-9fae-2f0aeea777a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:18.215542 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a17e97-516b-4954-9fae-2f0aeea777a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:18.218074 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a17e97-516b-4954-9fae-2f0aeea777a6 None admin] RBAC: Adding query filter params (role.id=61605ebf17e643258730e55bf6db15ad, scope.project.id=d428d47056754be5930f84ee53d099af, user.id=0f7457330c2f419ba73e987e07015188) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:18.218902 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a17e97-516b-4954-9fae-2f0aeea777a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:18.221375 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a17e97-516b-4954-9fae-2f0aeea777a6 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:18.227141 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84bfbf-408a-4128-b725-9dbf7de98242 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:18.230698 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 106/204] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 7 15:42:18 2022] GET /identity/v3/role_assignments?user.id=0f7457330c2f419ba73e987e07015188&scope.project.id=d428d47056754be5930f84ee53d099af&role.id=61605ebf17e643258730e55bf6db15ad => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:18.232386 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a17e97-516b-4954-9fae-2f0aeea777a6 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:18.269763 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:18.331082 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5086b2ff-5e4b-4374-9ec3-846e918cf4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:18.331657 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086b2ff-5e4b-4374-9ec3-846e918cf4a1 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:18.331942 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086b2ff-5e4b-4374-9ec3-846e918cf4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:18.332224 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086b2ff-5e4b-4374-9ec3-846e918cf4a1 None admin] PATH_INFO: `/v3/projects/6e5edf54975843879025d05c7e7a65d7` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:18.333469 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5086b2ff-5e4b-4374-9ec3-846e918cf4a1 None admin] RBAC: Authorizing `identity:get_project(project_id=6e5edf54975843879025d05c7e7a65d7)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:18.335284 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5086b2ff-5e4b-4374-9ec3-846e918cf4a1 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:18.336760 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 99/205] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 7 15:42:18 2022] GET /identity/v3/projects/6e5edf54975843879025d05c7e7a65d7 => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:18.343223 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5086b2ff-5e4b-4374-9ec3-846e918cf4a1 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:18.348875 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:18.369058 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a17e97-516b-4954-9fae-2f0aeea777a6 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:18.417835 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b844b-d998-4db1-abd2-61bdf604e7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:18.419977 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b844b-d998-4db1-abd2-61bdf604e7c6 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:18.420823 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b844b-d998-4db1-abd2-61bdf604e7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:18.421307 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b844b-d998-4db1-abd2-61bdf604e7c6 None admin] PATH_INFO: `/v3/projects/d428d47056754be5930f84ee53d099af` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:18.422800 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46b844b-d998-4db1-abd2-61bdf604e7c6 None admin] RBAC: Authorizing `identity:get_project(project_id=d428d47056754be5930f84ee53d099af)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:18.425258 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46b844b-d998-4db1-abd2-61bdf604e7c6 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:18.427913 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 107/206] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 7 15:42:18 2022] GET /identity/v3/projects/d428d47056754be5930f84ee53d099af => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:18.434570 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b844b-d998-4db1-abd2-61bdf604e7c6 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:18.549130 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5086b2ff-5e4b-4374-9ec3-846e918cf4a1 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:18.563142 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:18.572964 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b844b-d998-4db1-abd2-61bdf604e7c6 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:18.589141 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff858b-c2b4-40bd-bc2b-c3a6a5c23515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:18.589765 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff858b-c2b4-40bd-bc2b-c3a6a5c23515 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:18.590122 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff858b-c2b4-40bd-bc2b-c3a6a5c23515 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:18.591172 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff858b-c2b4-40bd-bc2b-c3a6a5c23515 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:18.591985 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff858b-c2b4-40bd-bc2b-c3a6a5c23515 None admin] RBAC: Adding query filter params (role.id=903d756c82454add946529986655408d, scope.project.id=6e5edf54975843879025d05c7e7a65d7, user.id=0cd5248dbbd44fb49ccfc944c366de6e) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:18.592372 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff858b-c2b4-40bd-bc2b-c3a6a5c23515 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:18.594655 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff858b-c2b4-40bd-bc2b-c3a6a5c23515 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:18.608960 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 100/207] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 7 15:42:18 2022] GET /identity/v3/role_assignments?user.id=0cd5248dbbd44fb49ccfc944c366de6e&scope.project.id=6e5edf54975843879025d05c7e7a65d7&role.id=903d756c82454add946529986655408d => generated 608 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:42:18.624845 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed22bf2a-b8a7-4308-8503-8b705805bbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:18.625584 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22bf2a-b8a7-4308-8503-8b705805bbdd None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:18.625874 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22bf2a-b8a7-4308-8503-8b705805bbdd None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:18.626151 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22bf2a-b8a7-4308-8503-8b705805bbdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:18.626966 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed22bf2a-b8a7-4308-8503-8b705805bbdd None admin] RBAC: Adding query filter params (role.id=ce978876ff724bf3b4101c9fd4d2d842, scope.project.id=d428d47056754be5930f84ee53d099af, user.id=0f7457330c2f419ba73e987e07015188) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:18.627281 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed22bf2a-b8a7-4308-8503-8b705805bbdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:18.628803 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed22bf2a-b8a7-4308-8503-8b705805bbdd None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:18.634888 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 108/208] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 7 15:42:18 2022] GET /identity/v3/role_assignments?user.id=0f7457330c2f419ba73e987e07015188&scope.project.id=d428d47056754be5930f84ee53d099af&role.id=ce978876ff724bf3b4101c9fd4d2d842 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:19.711964 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce13705-c5c0-4a17-ac42-b56fc3c42690 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:19.712538 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce13705-c5c0-4a17-ac42-b56fc3c42690 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:19.712538 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce13705-c5c0-4a17-ac42-b56fc3c42690 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:19.714070 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 101/209] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:42:19.720600 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad5aae-fad2-495c-811e-86a786d99e8f None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:19.721041 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad5aae-fad2-495c-811e-86a786d99e8f None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:19.721144 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad5aae-fad2-495c-811e-86a786d99e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:19.740138 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-8fad5aae-fad2-495c-811e-86a786d99e8f None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:19.741309 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-8fad5aae-fad2-495c-811e-86a786d99e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:19.808359 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 109/210] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:42:19.815669 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb5016-e0cd-4f0b-928c-85efee6c36bd None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:19.816231 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb5016-e0cd-4f0b-928c-85efee6c36bd None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:19.816712 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb5016-e0cd-4f0b-928c-85efee6c36bd None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:19.818273 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 102/211] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:42:19.823543 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c32eb-bdae-47ec-8bbd-2a370dea03b4 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:19.824056 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c32eb-bdae-47ec-8bbd-2a370dea03b4 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:19.824530 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c32eb-bdae-47ec-8bbd-2a370dea03b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:19.844555 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-d70c32eb-bdae-47ec-8bbd-2a370dea03b4 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:19.846049 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-d70c32eb-bdae-47ec-8bbd-2a370dea03b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:19.920953 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 110/212] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:42:20.081454 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb5016-e0cd-4f0b-928c-85efee6c36bd None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:20.151852 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:20.188839 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb5016-e0cd-4f0b-928c-85efee6c36bd None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:20.203599 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c32eb-bdae-47ec-8bbd-2a370dea03b4 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:20.225703 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:20.231734 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da6437-f642-4edc-9f52-3f62869aa95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:20.232600 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da6437-f642-4edc-9f52-3f62869aa95c None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:20.232887 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da6437-f642-4edc-9f52-3f62869aa95c None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:20.233163 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da6437-f642-4edc-9f52-3f62869aa95c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:20.247917 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19da6437-f642-4edc-9f52-3f62869aa95c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:42:20.254434 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-19da6437-f642-4edc-9f52-3f62869aa95c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:42:20.254434 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:20.254434 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:42:20.254434 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:42:20.254434 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:42:20.254434 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:42:20.254434 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:42:20.254434 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:42:20.254434 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:42:20.254434 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:42:20.254434 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:42:20.254434 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:42:20.254434 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:42:20.254434 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:42:20.254434 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:42:20.254434 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:42:20.255303 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:42:20.255303 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:42:20.255303 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:42:20.255303 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:42:20.255303 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:42:20.255303 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:42:20.255303 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:42:20.255303 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:42:20.255303 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:42:20.255303 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:42:20.255303 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:42:20.255303 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:42:20.255303 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:42:20.255303 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:42:20.255303 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:42:20.255303 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:42:20.256085 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:42:20.256085 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:42:20.256085 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:42:20.256085 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:42:20.256085 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:42:20.256085 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:42:20.256085 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:42:20.256085 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:42:20.256085 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:42:20.256085 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:42:20.256085 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:42:20.256085 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:42:20.258989 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 103/213] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:42:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:42:20.264913 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da6437-f642-4edc-9f52-3f62869aa95c None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:20.323767 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c32eb-bdae-47ec-8bbd-2a370dea03b4 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:20.362692 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02c5b2-ad7a-4cf1-bb4f-bfc4990f93a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:20.363439 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02c5b2-ad7a-4cf1-bb4f-bfc4990f93a1 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:20.364008 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02c5b2-ad7a-4cf1-bb4f-bfc4990f93a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:20.364204 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02c5b2-ad7a-4cf1-bb4f-bfc4990f93a1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:20.365428 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae02c5b2-ad7a-4cf1-bb4f-bfc4990f93a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:20.367126 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae02c5b2-ad7a-4cf1-bb4f-bfc4990f93a1 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:20.368811 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 111/214] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:42:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:20.373803 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da6437-f642-4edc-9f52-3f62869aa95c None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:20.375279 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02c5b2-ad7a-4cf1-bb4f-bfc4990f93a1 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:20.402624 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:20.413072 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09dae4a-fe1f-4ce1-9802-91857fb27154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:20.414023 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09dae4a-fe1f-4ce1-9802-91857fb27154 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:20.414553 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09dae4a-fe1f-4ce1-9802-91857fb27154 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:20.414983 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09dae4a-fe1f-4ce1-9802-91857fb27154 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:20.415791 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09dae4a-fe1f-4ce1-9802-91857fb27154 None admin] RBAC: Adding query filter params (name=member) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:20.416233 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09dae4a-fe1f-4ce1-9802-91857fb27154 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:20.418020 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09dae4a-fe1f-4ce1-9802-91857fb27154 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:20.432808 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 104/215] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 7 15:42:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:20.434018 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09dae4a-fe1f-4ce1-9802-91857fb27154 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:20.469921 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:20.486887 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02c5b2-ad7a-4cf1-bb4f-bfc4990f93a1 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:20.523936 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f04346-6577-4252-b69e-0727a62f380c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:20.524727 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f04346-6577-4252-b69e-0727a62f380c None admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:20.525111 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f04346-6577-4252-b69e-0727a62f380c None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:20.525496 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f04346-6577-4252-b69e-0727a62f380c None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:20.526326 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f04346-6577-4252-b69e-0727a62f380c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:20.528400 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f04346-6577-4252-b69e-0727a62f380c None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:20.548923 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09dae4a-fe1f-4ce1-9802-91857fb27154 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:20.555528 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 112/216] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Sep 7 15:42:20 2022] POST /identity/v3/users => generated 297 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:42:20.594270 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493968d-e480-46c2-891b-02c8a0d62d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:20.595355 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493968d-e480-46c2-891b-02c8a0d62d51 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:20.595956 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493968d-e480-46c2-891b-02c8a0d62d51 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:20.596551 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493968d-e480-46c2-891b-02c8a0d62d51 None admin] PATH_INFO: `/v3/users/6c1338b2fbe646bc99d2222c0de6a576` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:20.614068 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493968d-e480-46c2-891b-02c8a0d62d51 None admin] RBAC: Authorizing `identity:get_user(user_id=6c1338b2fbe646bc99d2222c0de6a576)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:20.615960 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493968d-e480-46c2-891b-02c8a0d62d51 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:20.617969 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 105/217] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 7 15:42:20 2022] GET /identity/v3/users/6c1338b2fbe646bc99d2222c0de6a576 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:20.628571 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f04346-6577-4252-b69e-0727a62f380c None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:20.754282 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f04346-6577-4252-b69e-0727a62f380c None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:20.792357 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c0b0b-61a0-49b0-8404-67dd01fc4f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:20.793039 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c0b0b-61a0-49b0-8404-67dd01fc4f66 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:20.793329 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c0b0b-61a0-49b0-8404-67dd01fc4f66 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:20.793612 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c0b0b-61a0-49b0-8404-67dd01fc4f66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:20.808100 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:20.834198 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4eebf-5f1a-48a7-92a9-b4c285225b23 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:20.834717 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4eebf-5f1a-48a7-92a9-b4c285225b23 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:20.835038 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4eebf-5f1a-48a7-92a9-b4c285225b23 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:20.837468 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 106/218] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:42:20.843523 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c1cd1-bfb4-4e44-8be5-a290aa2c8a52 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:20.843906 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c1cd1-bfb4-4e44-8be5-a290aa2c8a52 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:20.844257 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c1cd1-bfb4-4e44-8be5-a290aa2c8a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:20.864707 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-465c1cd1-bfb4-4e44-8be5-a290aa2c8a52 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:20.866033 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-465c1cd1-bfb4-4e44-8be5-a290aa2c8a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:20.880982 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c0b0b-61a0-49b0-8404-67dd01fc4f66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:20.882541 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c0b0b-61a0-49b0-8404-67dd01fc4f66 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:20.935766 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:20.972141 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 107/219] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:42:21.009495 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 113/220] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:42:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:42:21.015059 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465c1cd1-bfb4-4e44-8be5-a290aa2c8a52 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:21.020951 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f9277-8c03-47f9-957c-586d8f194170 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:21.021517 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f9277-8c03-47f9-957c-586d8f194170 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:21.022028 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f9277-8c03-47f9-957c-586d8f194170 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:21.023581 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 114/221] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:42:21.029761 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352cfa8-b994-4d08-9409-2c29971d64ee None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:21.030379 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352cfa8-b994-4d08-9409-2c29971d64ee None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:21.030869 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352cfa8-b994-4d08-9409-2c29971d64ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:21.054172 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-7352cfa8-b994-4d08-9409-2c29971d64ee None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:21.055450 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-7352cfa8-b994-4d08-9409-2c29971d64ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:21.101039 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:21.139440 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 115/222] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:42:21.144128 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465c1cd1-bfb4-4e44-8be5-a290aa2c8a52 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:21.182801 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b498ee2-c72c-4661-9bfa-7d6cf0270194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:21.183442 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b498ee2-c72c-4661-9bfa-7d6cf0270194 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:21.183729 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b498ee2-c72c-4661-9bfa-7d6cf0270194 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:21.184006 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b498ee2-c72c-4661-9bfa-7d6cf0270194 None admin] PATH_INFO: `/v3/projects/d428d47056754be5930f84ee53d099af` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:21.186022 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b498ee2-c72c-4661-9bfa-7d6cf0270194 None admin] RBAC: Authorizing `identity:get_project(project_id=d428d47056754be5930f84ee53d099af)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:21.187510 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b498ee2-c72c-4661-9bfa-7d6cf0270194 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:21.189463 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 108/223] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 7 15:42:21 2022] GET /identity/v3/projects/d428d47056754be5930f84ee53d099af => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:21.195183 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352cfa8-b994-4d08-9409-2c29971d64ee None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:21.309030 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b498ee2-c72c-4661-9bfa-7d6cf0270194 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:21.346535 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352cfa8-b994-4d08-9409-2c29971d64ee None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:21.393806 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:21.413324 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d67f49-4084-4635-a1cd-11b1b9fe5b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:21.414202 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d67f49-4084-4635-a1cd-11b1b9fe5b3e None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:21.414624 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d67f49-4084-4635-a1cd-11b1b9fe5b3e None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:21.415343 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d67f49-4084-4635-a1cd-11b1b9fe5b3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:21.416308 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d67f49-4084-4635-a1cd-11b1b9fe5b3e None admin] RBAC: Adding query filter params (role.id=d45e39b4ad4e4ce782ec649246438663, scope.project.id=d428d47056754be5930f84ee53d099af, user.id=6c1338b2fbe646bc99d2222c0de6a576) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:21.416759 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d67f49-4084-4635-a1cd-11b1b9fe5b3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:21.420276 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d67f49-4084-4635-a1cd-11b1b9fe5b3e None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:21.428061 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 116/224] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 7 15:42:21 2022] GET /identity/v3/role_assignments?user.id=6c1338b2fbe646bc99d2222c0de6a576&scope.project.id=d428d47056754be5930f84ee53d099af&role.id=d45e39b4ad4e4ce782ec649246438663 => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:21.455341 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d67f49-4084-4635-a1cd-11b1b9fe5b3e None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:21.506081 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b498ee2-c72c-4661-9bfa-7d6cf0270194 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:21.522881 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:21.582112 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f2213-f268-4e47-b8ed-42deb8231cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:21.583053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f2213-f268-4e47-b8ed-42deb8231cda None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:21.583507 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f2213-f268-4e47-b8ed-42deb8231cda None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:21.583984 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f2213-f268-4e47-b8ed-42deb8231cda None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:21.597810 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9f2213-f268-4e47-b8ed-42deb8231cda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:42:21.602940 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-7b9f2213-f268-4e47-b8ed-42deb8231cda None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:42:21.602940 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:21.602940 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:42:21.602940 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:42:21.602940 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:42:21.602940 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:42:21.602940 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:42:21.602940 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:42:21.602940 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:42:21.602940 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:42:21.602940 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:42:21.602940 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:42:21.602940 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:42:21.602940 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:42:21.602940 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:42:21.602940 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:42:21.604065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:42:21.604065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:42:21.604065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:42:21.604065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:42:21.604065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:42:21.604065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:42:21.604065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:42:21.604065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:42:21.604065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:42:21.604065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:42:21.604065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:42:21.604065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:42:21.604065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:42:21.604065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:42:21.604065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:42:21.604065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:42:21.605204 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:42:21.605204 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:42:21.605204 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:42:21.605204 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:42:21.605204 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:42:21.605204 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:42:21.605204 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:42:21.605204 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:42:21.605204 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:42:21.605204 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:42:21.605204 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:42:21.605204 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:42:21.605204 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 109/225] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 7 15:42:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:42:21.614279 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f2213-f268-4e47-b8ed-42deb8231cda None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:21.655711 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d67f49-4084-4635-a1cd-11b1b9fe5b3e None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:21.738957 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a80b7-b180-4496-a09a-73478e68514b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:21.739605 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a80b7-b180-4496-a09a-73478e68514b None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:21.739887 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a80b7-b180-4496-a09a-73478e68514b None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:21.740159 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a80b7-b180-4496-a09a-73478e68514b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:21.758143 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f2213-f268-4e47-b8ed-42deb8231cda None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:21.764863 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636a80b7-b180-4496-a09a-73478e68514b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:42:21.770575 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-636a80b7-b180-4496-a09a-73478e68514b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 15:42:21.770575 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:21.770575 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:42:21.770575 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:42:21.770575 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:42:21.770575 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:42:21.770575 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:42:21.770575 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:42:21.770575 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:42:21.770575 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:42:21.770575 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:42:21.770575 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:42:21.770575 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:42:21.770575 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:42:21.770575 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:42:21.770575 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:42:21.771555 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:42:21.771555 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:42:21.771555 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:42:21.771555 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:42:21.771555 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:42:21.771555 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:42:21.771555 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:42:21.771555 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:42:21.771555 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:42:21.771555 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:42:21.771555 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:42:21.771555 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:42:21.771555 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:42:21.771555 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:42:21.771555 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:42:21.771555 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:42:21.772357 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:42:21.772357 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:42:21.772357 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:42:21.772357 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:42:21.772357 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:42:21.772357 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:42:21.772357 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:42:21.772357 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:42:21.772357 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:42:21.772357 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:42:21.772357 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 15:42:21.772357 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:42:21.772955 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:21.781296 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 117/226] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 7 15:42:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:42:21.782295 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a80b7-b180-4496-a09a-73478e68514b None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:21.830849 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8a8894-150c-476c-81ea-e1bc914c7531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:21.831467 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a8894-150c-476c-81ea-e1bc914c7531 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:21.831749 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a8894-150c-476c-81ea-e1bc914c7531 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:21.832031 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a8894-150c-476c-81ea-e1bc914c7531 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:21.832702 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8a8894-150c-476c-81ea-e1bc914c7531 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:21.833005 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8a8894-150c-476c-81ea-e1bc914c7531 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:21.834434 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8a8894-150c-476c-81ea-e1bc914c7531 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:21.852268 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 110/227] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:42:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:21.858409 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8a8894-150c-476c-81ea-e1bc914c7531 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:21.913633 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:21.920536 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a80b7-b180-4496-a09a-73478e68514b None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:21.955590 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4277d9b-3210-4cfa-94b9-2782004029bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:21.956216 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4277d9b-3210-4cfa-94b9-2782004029bb None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:21.956492 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4277d9b-3210-4cfa-94b9-2782004029bb None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:21.956759 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4277d9b-3210-4cfa-94b9-2782004029bb None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:21.957420 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4277d9b-3210-4cfa-94b9-2782004029bb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:21.957784 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4277d9b-3210-4cfa-94b9-2782004029bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:21.959334 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4277d9b-3210-4cfa-94b9-2782004029bb None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:21.973999 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 118/228] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:42:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:21.979638 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4277d9b-3210-4cfa-94b9-2782004029bb None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:22.076737 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8a8894-150c-476c-81ea-e1bc914c7531 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:22.119620 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04584e6-3067-463e-86c8-3d5f090921f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:22.120279 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04584e6-3067-463e-86c8-3d5f090921f3 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:22.120557 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04584e6-3067-463e-86c8-3d5f090921f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:22.120830 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04584e6-3067-463e-86c8-3d5f090921f3 None admin] PATH_INFO: `/v3/users/0f7457330c2f419ba73e987e07015188` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:22.122082 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04584e6-3067-463e-86c8-3d5f090921f3 None admin] RBAC: Authorizing `identity:get_user(user_id=0f7457330c2f419ba73e987e07015188)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:22.123547 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04584e6-3067-463e-86c8-3d5f090921f3 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:22.125123 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 111/229] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 7 15:42:21 2022] GET /identity/v3/users/0f7457330c2f419ba73e987e07015188 => generated 283 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:22.131312 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04584e6-3067-463e-86c8-3d5f090921f3 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:22.180678 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:22.184177 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4277d9b-3210-4cfa-94b9-2782004029bb None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:22.268655 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a168a1-7ab4-4fa0-b2d1-2dbb64d84174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:22.270630 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a168a1-7ab4-4fa0-b2d1-2dbb64d84174 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:22.272093 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a168a1-7ab4-4fa0-b2d1-2dbb64d84174 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:22.273151 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a168a1-7ab4-4fa0-b2d1-2dbb64d84174 None admin] PATH_INFO: `/v3/users/0f7457330c2f419ba73e987e07015188` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:22.274687 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a168a1-7ab4-4fa0-b2d1-2dbb64d84174 None admin] RBAC: Authorizing `identity:get_user(user_id=0f7457330c2f419ba73e987e07015188)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:22.276700 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04584e6-3067-463e-86c8-3d5f090921f3 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:22.280053 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a168a1-7ab4-4fa0-b2d1-2dbb64d84174 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:22.281907 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 119/230] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 7 15:42:21 2022] GET /identity/v3/users/0f7457330c2f419ba73e987e07015188 => generated 283 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:42:22.287566 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a168a1-7ab4-4fa0-b2d1-2dbb64d84174 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:22.320850 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:22.367830 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f9054-57c1-40c5-9cb7-f1daecbfa68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:22.368489 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f9054-57c1-40c5-9cb7-f1daecbfa68a None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:22.368764 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f9054-57c1-40c5-9cb7-f1daecbfa68a None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:22.369045 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f9054-57c1-40c5-9cb7-f1daecbfa68a None admin] PATH_INFO: `/v3/projects/d428d47056754be5930f84ee53d099af` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:22.374893 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f9054-57c1-40c5-9cb7-f1daecbfa68a None admin] RBAC: Authorizing `identity:get_project(project_id=d428d47056754be5930f84ee53d099af)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:22.376390 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f9054-57c1-40c5-9cb7-f1daecbfa68a None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:22.378391 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 112/231] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 7 15:42:22 2022] GET /identity/v3/projects/d428d47056754be5930f84ee53d099af => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:42:22.383726 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f9054-57c1-40c5-9cb7-f1daecbfa68a None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:22.408916 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a168a1-7ab4-4fa0-b2d1-2dbb64d84174 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:22.450066 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9398b-b01f-4b09-950e-b2025c506357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:22.451288 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9398b-b01f-4b09-950e-b2025c506357 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:22.451774 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9398b-b01f-4b09-950e-b2025c506357 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:22.452251 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9398b-b01f-4b09-950e-b2025c506357 None admin] PATH_INFO: `/v3/projects/d428d47056754be5930f84ee53d099af` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:22.453746 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf9398b-b01f-4b09-950e-b2025c506357 None admin] RBAC: Authorizing `identity:get_project(project_id=d428d47056754be5930f84ee53d099af)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:22.455524 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf9398b-b01f-4b09-950e-b2025c506357 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:22.457806 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 120/232] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 7 15:42:22 2022] GET /identity/v3/projects/d428d47056754be5930f84ee53d099af => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:22.463987 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9398b-b01f-4b09-950e-b2025c506357 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:22.568825 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:22.575364 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f9054-57c1-40c5-9cb7-f1daecbfa68a None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:22.577177 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:22.578880 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9398b-b01f-4b09-950e-b2025c506357 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:22.615907 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ae686-f6a9-475b-b520-2efcade102d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:22.616915 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ae686-f6a9-475b-b520-2efcade102d9 None admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:22.617398 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ae686-f6a9-475b-b520-2efcade102d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:22.617872 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ae686-f6a9-475b-b520-2efcade102d9 None admin] PATH_INFO: `/v3/projects/d428d47056754be5930f84ee53d099af/users/0f7457330c2f419ba73e987e07015188/roles/ce978876ff724bf3b4101c9fd4d2d842` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:22.620304 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272ae686-f6a9-475b-b520-2efcade102d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=d428d47056754be5930f84ee53d099af, user_id=0f7457330c2f419ba73e987e07015188, role_id=ce978876ff724bf3b4101c9fd4d2d842)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:22.622552 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272ae686-f6a9-475b-b520-2efcade102d9 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:22.637668 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 121/233] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 7 15:42:22 2022] PUT /identity/v3/projects/d428d47056754be5930f84ee53d099af/users/0f7457330c2f419ba73e987e07015188/roles/ce978876ff724bf3b4101c9fd4d2d842 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 15:42:22.647915 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e91c878-8640-41f1-a0ff-6414eb02168a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:22.649052 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91c878-8640-41f1-a0ff-6414eb02168a None admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:22.649552 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91c878-8640-41f1-a0ff-6414eb02168a None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:22.650106 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91c878-8640-41f1-a0ff-6414eb02168a None admin] PATH_INFO: `/v3/projects/d428d47056754be5930f84ee53d099af/users/0f7457330c2f419ba73e987e07015188/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:22.652494 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91c878-8640-41f1-a0ff-6414eb02168a None admin] RBAC: Authorizing `identity:create_grant(project_id=d428d47056754be5930f84ee53d099af, user_id=0f7457330c2f419ba73e987e07015188, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:22.654824 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91c878-8640-41f1-a0ff-6414eb02168a None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:22.678002 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 113/234] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 7 15:42:22 2022] PUT /identity/v3/projects/d428d47056754be5930f84ee53d099af/users/0f7457330c2f419ba73e987e07015188/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 15:42:23.307039 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde6a8e-a221-436a-b6b3-7f2b4f6e4995 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:23.307984 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde6a8e-a221-436a-b6b3-7f2b4f6e4995 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:23.308480 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde6a8e-a221-436a-b6b3-7f2b4f6e4995 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:23.310823 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 122/235] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:42:23.316523 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a7de7-88a3-47e2-9911-10437acbe02e None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:23.317398 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a7de7-88a3-47e2-9911-10437acbe02e None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:23.317923 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a7de7-88a3-47e2-9911-10437acbe02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:23.343264 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-834a7de7-88a3-47e2-9911-10437acbe02e None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:23.344805 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-834a7de7-88a3-47e2-9911-10437acbe02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:23.422679 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 114/236] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:42:23.647971 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3f947-d956-43a5-babd-4cefcf521804 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:23.648626 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3f947-d956-43a5-babd-4cefcf521804 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:23.649115 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3f947-d956-43a5-babd-4cefcf521804 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:23.650980 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 123/237] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:42:23.656979 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ab378-ee1c-4ec4-8591-ee156ff72d1c None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:23.657558 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ab378-ee1c-4ec4-8591-ee156ff72d1c None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:23.658038 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ab378-ee1c-4ec4-8591-ee156ff72d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:23.683165 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-9f4ab378-ee1c-4ec4-8591-ee156ff72d1c None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:23.684967 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-9f4ab378-ee1c-4ec4-8591-ee156ff72d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:23.740005 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3f947-d956-43a5-babd-4cefcf521804 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:23.804013 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 115/238] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:42:23.875884 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3f947-d956-43a5-babd-4cefcf521804 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:23.913806 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3a2ab-52be-4fc3-9391-258159059358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:23.914420 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3a2ab-52be-4fc3-9391-258159059358 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:23.914707 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3a2ab-52be-4fc3-9391-258159059358 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:23.914984 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3a2ab-52be-4fc3-9391-258159059358 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:23.931915 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad3a2ab-52be-4fc3-9391-258159059358 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:42:23.938503 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-7ad3a2ab-52be-4fc3-9391-258159059358 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 15:42:23.938503 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:23.938503 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:42:23.938503 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:42:23.938503 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:42:23.938503 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:42:23.938503 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:42:23.938503 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:42:23.938503 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:42:23.938503 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:42:23.938503 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:42:23.938503 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:42:23.938503 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:42:23.938503 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:42:23.938503 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:42:23.938503 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:42:23.939421 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:42:23.939421 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:42:23.939421 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:42:23.939421 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:42:23.939421 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:42:23.939421 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:42:23.939421 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:42:23.939421 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:42:23.939421 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:42:23.939421 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:42:23.939421 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:42:23.939421 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:42:23.939421 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:42:23.939421 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:42:23.939421 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:42:23.939421 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:42:23.940233 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:42:23.940233 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:42:23.940233 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:42:23.940233 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:42:23.940233 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:42:23.940233 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:42:23.940233 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:42:23.940233 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:42:23.940233 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:42:23.940233 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:42:23.940233 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 15:42:23.940233 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:42:23.940233 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 124/239] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:42:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:42:23.948901 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ab378-ee1c-4ec4-8591-ee156ff72d1c None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:23.992387 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:24.091645 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ab378-ee1c-4ec4-8591-ee156ff72d1c None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:24.137132 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcde2a9-efad-4ffd-bab1-b2620751c6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:24.137872 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcde2a9-efad-4ffd-bab1-b2620751c6a5 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:24.138171 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcde2a9-efad-4ffd-bab1-b2620751c6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:24.138551 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcde2a9-efad-4ffd-bab1-b2620751c6a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:24.139277 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcde2a9-efad-4ffd-bab1-b2620751c6a5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:24.139588 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcde2a9-efad-4ffd-bab1-b2620751c6a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:24.140966 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcde2a9-efad-4ffd-bab1-b2620751c6a5 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:24.149520 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 116/240] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 7 15:42:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:24.156527 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3a2ab-52be-4fc3-9391-258159059358 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:24.186846 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:24.191461 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0977c-3343-4cd5-9375-4ed463381191 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:24.191749 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0977c-3343-4cd5-9375-4ed463381191 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:24.192112 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0977c-3343-4cd5-9375-4ed463381191 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:24.193584 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 117/241] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:42:24.199655 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26f973-e5ea-442c-996f-aabb3b6a3346 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:24.200034 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26f973-e5ea-442c-996f-aabb3b6a3346 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:24.201319 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26f973-e5ea-442c-996f-aabb3b6a3346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:24.227394 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-1d26f973-e5ea-442c-996f-aabb3b6a3346 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:24.229611 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-1d26f973-e5ea-442c-996f-aabb3b6a3346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:24.299883 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3a2ab-52be-4fc3-9391-258159059358 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:24.326553 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 118/242] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:42:24.328105 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d26f973-e5ea-442c-996f-aabb3b6a3346 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:24.341000 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb641fd-8c1b-4230-a514-704770dde224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:24.342335 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb641fd-8c1b-4230-a514-704770dde224 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:24.342761 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb641fd-8c1b-4230-a514-704770dde224 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:24.343180 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb641fd-8c1b-4230-a514-704770dde224 None admin] PATH_INFO: `/v3/users/5368662edf3f4f48bf095defd29df726` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:24.363907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:24.378466 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb641fd-8c1b-4230-a514-704770dde224 None admin] RBAC: Authorizing `identity:get_user(user_id=5368662edf3f4f48bf095defd29df726)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:24.380187 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb641fd-8c1b-4230-a514-704770dde224 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:24.384627 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 125/243] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 7 15:42:24 2022] GET /identity/v3/users/5368662edf3f4f48bf095defd29df726 => generated 297 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:24.390980 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb641fd-8c1b-4230-a514-704770dde224 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:24.502623 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:24.533161 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d26f973-e5ea-442c-996f-aabb3b6a3346 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:24.570289 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0516be03-f511-4864-b859-83df3e061b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:24.571530 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516be03-f511-4864-b859-83df3e061b5d None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:24.571950 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516be03-f511-4864-b859-83df3e061b5d None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:24.572351 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516be03-f511-4864-b859-83df3e061b5d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:24.573617 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0516be03-f511-4864-b859-83df3e061b5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:24.575840 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0516be03-f511-4864-b859-83df3e061b5d None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:24.578419 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 119/244] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:42:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:24.586350 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0516be03-f511-4864-b859-83df3e061b5d None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:24.603110 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb641fd-8c1b-4230-a514-704770dde224 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:24.653553 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d018223-306b-4250-97c8-c178a7e34d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:24.654733 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d018223-306b-4250-97c8-c178a7e34d6c None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:24.655062 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d018223-306b-4250-97c8-c178a7e34d6c None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:24.655340 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d018223-306b-4250-97c8-c178a7e34d6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:24.699493 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:24.720937 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0516be03-f511-4864-b859-83df3e061b5d None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:24.749961 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d018223-306b-4250-97c8-c178a7e34d6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:24.751672 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d018223-306b-4250-97c8-c178a7e34d6c None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:24.765753 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595317b-cba4-44b2-bf0c-e6e997be38c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:24.766346 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595317b-cba4-44b2-bf0c-e6e997be38c8 None admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:24.766625 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595317b-cba4-44b2-bf0c-e6e997be38c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:24.767148 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595317b-cba4-44b2-bf0c-e6e997be38c8 None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:24.767808 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2595317b-cba4-44b2-bf0c-e6e997be38c8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:24.770007 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2595317b-cba4-44b2-bf0c-e6e997be38c8 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:24.796929 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 120/245] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Sep 7 15:42:24 2022] POST /identity/v3/users => generated 293 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 15:42:24.803386 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595317b-cba4-44b2-bf0c-e6e997be38c8 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:24.833245 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:24.898216 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 126/246] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:42:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:42:24.914241 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d018223-306b-4250-97c8-c178a7e34d6c None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:24.952349 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595317b-cba4-44b2-bf0c-e6e997be38c8 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:24.993222 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ddcd14-9e0f-45c1-80c6-02168d7d7214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:24.994280 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ddcd14-9e0f-45c1-80c6-02168d7d7214 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:24.994845 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ddcd14-9e0f-45c1-80c6-02168d7d7214 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:24.995517 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ddcd14-9e0f-45c1-80c6-02168d7d7214 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:25.009252 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ddcd14-9e0f-45c1-80c6-02168d7d7214 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:42:25.016195 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-92ddcd14-9e0f-45c1-80c6-02168d7d7214 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:42:25.016195 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:25.016195 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:42:25.016195 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:42:25.016195 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:42:25.016195 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:42:25.016195 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:42:25.016195 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:42:25.016195 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:42:25.016195 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:42:25.016195 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:42:25.016195 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:42:25.016195 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:42:25.016195 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:42:25.016195 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:42:25.016195 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:42:25.017198 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:42:25.017198 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:42:25.017198 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:42:25.017198 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:42:25.017198 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:42:25.017198 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:42:25.017198 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:42:25.017198 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:42:25.017198 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:42:25.017198 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:42:25.017198 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:42:25.017198 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:42:25.017198 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:42:25.017198 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:42:25.017198 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:42:25.017198 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:42:25.017986 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:42:25.017986 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:42:25.017986 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:42:25.017986 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:42:25.017986 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:42:25.017986 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:42:25.017986 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:42:25.017986 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:42:25.017986 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:42:25.017986 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:42:25.017986 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:42:25.017986 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:42:25.019969 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 121/247] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:42:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:42:25.020351 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:25.026273 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ddcd14-9e0f-45c1-80c6-02168d7d7214 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:25.133091 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d018223-306b-4250-97c8-c178a7e34d6c None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:25.160439 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ddcd14-9e0f-45c1-80c6-02168d7d7214 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:25.180294 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda04d57-3373-4844-be08-2e778bd3d1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:25.180941 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda04d57-3373-4844-be08-2e778bd3d1d3 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:25.181217 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda04d57-3373-4844-be08-2e778bd3d1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:25.181488 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda04d57-3373-4844-be08-2e778bd3d1d3 None admin] PATH_INFO: `/v3/projects/d428d47056754be5930f84ee53d099af` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:25.182651 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda04d57-3373-4844-be08-2e778bd3d1d3 None admin] RBAC: Authorizing `identity:get_project(project_id=d428d47056754be5930f84ee53d099af)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:25.185167 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda04d57-3373-4844-be08-2e778bd3d1d3 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:25.187495 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 127/248] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 7 15:42:24 2022] GET /identity/v3/projects/d428d47056754be5930f84ee53d099af => generated 302 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:42:25.193855 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda04d57-3373-4844-be08-2e778bd3d1d3 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:25.215321 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170a0ac-b030-4906-8847-c71e406171ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:25.216212 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170a0ac-b030-4906-8847-c71e406171ad None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:25.216556 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170a0ac-b030-4906-8847-c71e406171ad None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:25.216838 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170a0ac-b030-4906-8847-c71e406171ad None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:25.217953 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a170a0ac-b030-4906-8847-c71e406171ad None admin] RBAC: Adding query filter params (name=member) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:25.218285 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a170a0ac-b030-4906-8847-c71e406171ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:25.220139 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a170a0ac-b030-4906-8847-c71e406171ad None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:25.237848 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 122/249] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 7 15:42:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:25.244800 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170a0ac-b030-4906-8847-c71e406171ad None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:25.264344 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:25.338875 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:25.359848 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda04d57-3373-4844-be08-2e778bd3d1d3 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:25.403610 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170a0ac-b030-4906-8847-c71e406171ad None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:25.416820 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874abd8-30f2-4075-9f9c-ea4d5eb36511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:25.417125 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874abd8-30f2-4075-9f9c-ea4d5eb36511 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:25.418228 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874abd8-30f2-4075-9f9c-ea4d5eb36511 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:25.418228 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874abd8-30f2-4075-9f9c-ea4d5eb36511 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:25.419069 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3874abd8-30f2-4075-9f9c-ea4d5eb36511 None admin] RBAC: Adding query filter params (role.id=903d756c82454add946529986655408d, scope.project.id=d428d47056754be5930f84ee53d099af, user.id=5368662edf3f4f48bf095defd29df726) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:25.419384 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3874abd8-30f2-4075-9f9c-ea4d5eb36511 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:25.420998 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3874abd8-30f2-4075-9f9c-ea4d5eb36511 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:25.430326 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 128/250] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 7 15:42:25 2022] GET /identity/v3/role_assignments?user.id=5368662edf3f4f48bf095defd29df726&scope.project.id=d428d47056754be5930f84ee53d099af&role.id=903d756c82454add946529986655408d => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:42:25.431792 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461f5a4-52ff-470c-b4f2-44d3e56c5873 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:25.432039 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461f5a4-52ff-470c-b4f2-44d3e56c5873 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:25.432319 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461f5a4-52ff-470c-b4f2-44d3e56c5873 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:25.433551 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 129/251] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:42:25.435151 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f5b2e-0b8a-4790-86fa-c6f6646acc26 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:25.435440 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f5b2e-0b8a-4790-86fa-c6f6646acc26 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:25.435717 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f5b2e-0b8a-4790-86fa-c6f6646acc26 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:25.437285 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 130/252] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:42:25.441312 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0837196-ea15-49d7-9575-102997e2fa72 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:25.441595 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0837196-ea15-49d7-9575-102997e2fa72 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:25.441875 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0837196-ea15-49d7-9575-102997e2fa72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:25.455566 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01b403-7fb2-4a84-b70a-49a740417289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:25.456557 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01b403-7fb2-4a84-b70a-49a740417289 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:25.457022 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01b403-7fb2-4a84-b70a-49a740417289 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:25.457294 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01b403-7fb2-4a84-b70a-49a740417289 None admin] PATH_INFO: `/v3/users/6c1338b2fbe646bc99d2222c0de6a576` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:25.458559 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c01b403-7fb2-4a84-b70a-49a740417289 None admin] RBAC: Authorizing `identity:get_user(user_id=6c1338b2fbe646bc99d2222c0de6a576)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:25.460039 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c01b403-7fb2-4a84-b70a-49a740417289 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:25.462029 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 123/253] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 7 15:42:25 2022] GET /identity/v3/users/6c1338b2fbe646bc99d2222c0de6a576 => generated 297 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:25.463425 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c626b9-f59b-4855-8bc7-c5c1a8552f4b None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:25.463540 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-a0837196-ea15-49d7-9575-102997e2fa72 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:25.463703 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c626b9-f59b-4855-8bc7-c5c1a8552f4b None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:25.463968 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c626b9-f59b-4855-8bc7-c5c1a8552f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:25.464703 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-a0837196-ea15-49d7-9575-102997e2fa72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:25.486540 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-25c626b9-f59b-4855-8bc7-c5c1a8552f4b None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:25.487757 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-25c626b9-f59b-4855-8bc7-c5c1a8552f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:25.558009 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 131/254] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:42:25.559793 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0837196-ea15-49d7-9575-102997e2fa72 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:25.603531 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 124/255] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:42:25.625904 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:25.700248 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0837196-ea15-49d7-9575-102997e2fa72 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:25.751786 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b31a8-600c-4f12-ac49-40c26ef13324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:25.752444 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b31a8-600c-4f12-ac49-40c26ef13324 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:25.752723 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b31a8-600c-4f12-ac49-40c26ef13324 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:25.752997 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b31a8-600c-4f12-ac49-40c26ef13324 None admin] PATH_INFO: `/v3/projects/d428d47056754be5930f84ee53d099af` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:25.754133 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b31a8-600c-4f12-ac49-40c26ef13324 None admin] RBAC: Authorizing `identity:get_project(project_id=d428d47056754be5930f84ee53d099af)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:25.755693 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b31a8-600c-4f12-ac49-40c26ef13324 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:25.757734 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 132/256] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 7 15:42:25 2022] GET /identity/v3/projects/d428d47056754be5930f84ee53d099af => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:25.763745 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c626b9-f59b-4855-8bc7-c5c1a8552f4b None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:25.837488 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:25.886098 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c626b9-f59b-4855-8bc7-c5c1a8552f4b None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:25.922930 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85640c00-0bcd-404b-baa0-8f600f8dfdae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:25.923600 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85640c00-0bcd-404b-baa0-8f600f8dfdae None admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:25.923880 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85640c00-0bcd-404b-baa0-8f600f8dfdae None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:25.924155 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85640c00-0bcd-404b-baa0-8f600f8dfdae None admin] PATH_INFO: `/v3/projects/d428d47056754be5930f84ee53d099af/users/6c1338b2fbe646bc99d2222c0de6a576/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:25.926079 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85640c00-0bcd-404b-baa0-8f600f8dfdae None admin] RBAC: Authorizing `identity:create_grant(project_id=d428d47056754be5930f84ee53d099af, user_id=6c1338b2fbe646bc99d2222c0de6a576, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:25.927582 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85640c00-0bcd-404b-baa0-8f600f8dfdae None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:25.942750 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 125/257] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 7 15:42:25 2022] PUT /identity/v3/projects/d428d47056754be5930f84ee53d099af/users/6c1338b2fbe646bc99d2222c0de6a576/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:42:26.000891 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b31a8-600c-4f12-ac49-40c26ef13324 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:26.037868 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85640c00-0bcd-404b-baa0-8f600f8dfdae None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:26.169986 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b31a8-600c-4f12-ac49-40c26ef13324 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:26.171764 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:26.254787 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f596ce7-8f6c-47e2-bee5-e2647c927fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:26.255444 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f596ce7-8f6c-47e2-bee5-e2647c927fab None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:26.255840 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f596ce7-8f6c-47e2-bee5-e2647c927fab None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:26.256177 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f596ce7-8f6c-47e2-bee5-e2647c927fab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:26.270808 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f596ce7-8f6c-47e2-bee5-e2647c927fab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:42:26.276112 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-3f596ce7-8f6c-47e2-bee5-e2647c927fab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:42:26.276112 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:26.276112 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:42:26.276112 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:42:26.276112 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:42:26.276112 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:42:26.276112 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:42:26.276112 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:42:26.276112 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:42:26.276112 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:42:26.276112 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:42:26.276112 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:42:26.276112 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:42:26.276112 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:42:26.276112 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:42:26.276112 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:42:26.277053 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:42:26.277053 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:42:26.277053 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:42:26.277053 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:42:26.277053 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:42:26.277053 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:42:26.277053 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:42:26.277053 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:42:26.277053 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:42:26.277053 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:42:26.277053 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:42:26.277053 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:42:26.277053 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:42:26.277053 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:42:26.277053 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:42:26.277053 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:42:26.277858 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:42:26.277858 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:42:26.277858 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:42:26.277858 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:42:26.277858 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:42:26.277858 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:42:26.277858 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:42:26.277858 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:42:26.277858 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:42:26.277858 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:42:26.277858 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:42:26.277858 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:42:26.282433 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 133/258] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 7 15:42:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:42:26.284328 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f596ce7-8f6c-47e2-bee5-e2647c927fab None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:26.297523 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85640c00-0bcd-404b-baa0-8f600f8dfdae None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:26.325253 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:26.354926 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67665c0c-d915-485e-b094-364aaa778490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:26.355715 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67665c0c-d915-485e-b094-364aaa778490 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:26.355967 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67665c0c-d915-485e-b094-364aaa778490 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:26.356395 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67665c0c-d915-485e-b094-364aaa778490 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:26.375168 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67665c0c-d915-485e-b094-364aaa778490 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:42:26.380536 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-67665c0c-d915-485e-b094-364aaa778490 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 15:42:26.380536 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:26.380536 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:42:26.380536 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:42:26.380536 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:42:26.380536 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:42:26.380536 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:42:26.380536 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:42:26.380536 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:42:26.380536 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:42:26.380536 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:42:26.380536 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:42:26.380536 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:42:26.380536 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:42:26.380536 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:42:26.380536 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:42:26.383053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:42:26.383053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:42:26.383053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:42:26.383053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:42:26.383053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:42:26.383053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:42:26.383053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:42:26.383053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:42:26.383053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:42:26.383053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:42:26.383053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:42:26.383053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:42:26.383053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:42:26.383053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:42:26.383053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:42:26.383053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:42:26.384974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:42:26.384974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:42:26.384974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:42:26.384974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:42:26.384974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:42:26.384974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:42:26.384974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:42:26.384974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:42:26.384974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:42:26.384974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:42:26.384974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 15:42:26.384974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:42:26.384974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 126/259] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 7 15:42:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:42:26.391187 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67665c0c-d915-485e-b094-364aaa778490 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:26.422866 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f596ce7-8f6c-47e2-bee5-e2647c927fab None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:26.479669 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe4117-7ba3-4692-a3d7-b9e3c962f8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:26.480315 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe4117-7ba3-4692-a3d7-b9e3c962f8e9 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:26.480594 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe4117-7ba3-4692-a3d7-b9e3c962f8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:26.480867 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe4117-7ba3-4692-a3d7-b9e3c962f8e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:26.482164 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe4117-7ba3-4692-a3d7-b9e3c962f8e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:26.482512 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe4117-7ba3-4692-a3d7-b9e3c962f8e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:26.484079 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe4117-7ba3-4692-a3d7-b9e3c962f8e9 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:26.507220 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 134/260] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:42:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:42:26.514795 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe4117-7ba3-4692-a3d7-b9e3c962f8e9 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:26.550581 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:26.556198 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67665c0c-d915-485e-b094-364aaa778490 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:26.623433 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f7a0c-5c00-4148-9226-a3047fb703f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:26.624053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f7a0c-5c00-4148-9226-a3047fb703f1 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:26.624329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f7a0c-5c00-4148-9226-a3047fb703f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:26.624596 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f7a0c-5c00-4148-9226-a3047fb703f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:26.625272 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7f7a0c-5c00-4148-9226-a3047fb703f1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:26.625574 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7f7a0c-5c00-4148-9226-a3047fb703f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:26.627026 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7f7a0c-5c00-4148-9226-a3047fb703f1 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:26.641822 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 127/261] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:42:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:26.647291 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f7a0c-5c00-4148-9226-a3047fb703f1 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:26.666561 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe4117-7ba3-4692-a3d7-b9e3c962f8e9 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:26.711493 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4bb44a-3735-45a9-be43-e2cb3b91b759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:26.712152 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4bb44a-3735-45a9-be43-e2cb3b91b759 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:26.712435 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4bb44a-3735-45a9-be43-e2cb3b91b759 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:26.712710 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4bb44a-3735-45a9-be43-e2cb3b91b759 None admin] PATH_INFO: `/v3/users/0f7457330c2f419ba73e987e07015188` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:26.716763 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4bb44a-3735-45a9-be43-e2cb3b91b759 None admin] RBAC: Authorizing `identity:get_user(user_id=0f7457330c2f419ba73e987e07015188)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:26.718306 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4bb44a-3735-45a9-be43-e2cb3b91b759 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:26.720374 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 135/262] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 7 15:42:26 2022] GET /identity/v3/users/0f7457330c2f419ba73e987e07015188 => generated 283 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:26.724625 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:26.734821 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4bb44a-3735-45a9-be43-e2cb3b91b759 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:26.864071 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:26.869450 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f7a0c-5c00-4148-9226-a3047fb703f1 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:26.876273 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4bb44a-3735-45a9-be43-e2cb3b91b759 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:26.945630 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b00edfe-bd91-42d4-afac-c2b6863abfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:26.946283 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00edfe-bd91-42d4-afac-c2b6863abfbc None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:26.946572 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00edfe-bd91-42d4-afac-c2b6863abfbc None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:26.946850 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00edfe-bd91-42d4-afac-c2b6863abfbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:26.990998 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863a6571-b27e-49a8-bddb-9835fb71d406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:26.991613 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a6571-b27e-49a8-bddb-9835fb71d406 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:26.991903 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a6571-b27e-49a8-bddb-9835fb71d406 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:26.992187 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a6571-b27e-49a8-bddb-9835fb71d406 None admin] PATH_INFO: `/v3/users/0f7457330c2f419ba73e987e07015188` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:26.993371 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863a6571-b27e-49a8-bddb-9835fb71d406 None admin] RBAC: Authorizing `identity:get_user(user_id=0f7457330c2f419ba73e987e07015188)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:26.994861 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863a6571-b27e-49a8-bddb-9835fb71d406 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:26.997297 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 128/263] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 7 15:42:26 2022] GET /identity/v3/users/0f7457330c2f419ba73e987e07015188 => generated 283 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:42:27.002302 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863a6571-b27e-49a8-bddb-9835fb71d406 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:27.074600 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b00edfe-bd91-42d4-afac-c2b6863abfbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:27.081007 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b00edfe-bd91-42d4-afac-c2b6863abfbc None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:27.231078 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:27.234206 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863a6571-b27e-49a8-bddb-9835fb71d406 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:27.244661 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:27.253662 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 136/264] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:42:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:42:27.260738 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b00edfe-bd91-42d4-afac-c2b6863abfbc None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:27.288683 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac0831-9a3c-4c79-8801-c5e5cff59686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:27.289313 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac0831-9a3c-4c79-8801-c5e5cff59686 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:27.289600 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac0831-9a3c-4c79-8801-c5e5cff59686 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:27.289879 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac0831-9a3c-4c79-8801-c5e5cff59686 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:27.438916 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ac0831-9a3c-4c79-8801-c5e5cff59686 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:27.441751 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ac0831-9a3c-4c79-8801-c5e5cff59686 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:27.445552 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b00edfe-bd91-42d4-afac-c2b6863abfbc None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:27.509141 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8741281-bb3d-42e4-9bea-7a0759a179a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:27.514795 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8741281-bb3d-42e4-9bea-7a0759a179a6 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:27.515320 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8741281-bb3d-42e4-9bea-7a0759a179a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:27.515794 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8741281-bb3d-42e4-9bea-7a0759a179a6 None admin] PATH_INFO: `/v3/projects/d428d47056754be5930f84ee53d099af` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:27.517180 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8741281-bb3d-42e4-9bea-7a0759a179a6 None admin] RBAC: Authorizing `identity:get_project(project_id=d428d47056754be5930f84ee53d099af)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:27.518880 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8741281-bb3d-42e4-9bea-7a0759a179a6 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:27.520811 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 137/265] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 7 15:42:27 2022] GET /identity/v3/projects/d428d47056754be5930f84ee53d099af => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:27.526962 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8741281-bb3d-42e4-9bea-7a0759a179a6 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:27.640126 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 129/266] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:42:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 07 15:42:27.642531 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:27.647235 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac0831-9a3c-4c79-8801-c5e5cff59686 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:27.665678 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:27.705330 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8741281-bb3d-42e4-9bea-7a0759a179a6 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:27.760402 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d41e6-4a8f-4624-b30c-9f133fb96b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:27.760938 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d41e6-4a8f-4624-b30c-9f133fb96b02 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:27.761220 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d41e6-4a8f-4624-b30c-9f133fb96b02 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:27.761498 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d41e6-4a8f-4624-b30c-9f133fb96b02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:27.762252 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16d41e6-4a8f-4624-b30c-9f133fb96b02 None admin] RBAC: Adding query filter params (role.id=61605ebf17e643258730e55bf6db15ad, scope.project.id=d428d47056754be5930f84ee53d099af, user.id=0f7457330c2f419ba73e987e07015188) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:27.762640 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16d41e6-4a8f-4624-b30c-9f133fb96b02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:27.764102 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16d41e6-4a8f-4624-b30c-9f133fb96b02 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:27.770539 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 138/267] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 7 15:42:27 2022] GET /identity/v3/role_assignments?user.id=0f7457330c2f419ba73e987e07015188&scope.project.id=d428d47056754be5930f84ee53d099af&role.id=61605ebf17e643258730e55bf6db15ad => generated 608 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:42:27.878576 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac0831-9a3c-4c79-8801-c5e5cff59686 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:27.928193 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9db67-f3b7-4b70-994f-a17d061f48b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:27.929244 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9db67-f3b7-4b70-994f-a17d061f48b6 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:27.929724 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9db67-f3b7-4b70-994f-a17d061f48b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:27.930211 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9db67-f3b7-4b70-994f-a17d061f48b6 None admin] PATH_INFO: `/v3/projects/d428d47056754be5930f84ee53d099af` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:27.931633 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab9db67-f3b7-4b70-994f-a17d061f48b6 None admin] RBAC: Authorizing `identity:get_project(project_id=d428d47056754be5930f84ee53d099af)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:27.933293 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab9db67-f3b7-4b70-994f-a17d061f48b6 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:27.939813 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 130/268] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 7 15:42:27 2022] GET /identity/v3/projects/d428d47056754be5930f84ee53d099af => generated 302 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:27.945218 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d41e6-4a8f-4624-b30c-9f133fb96b02 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:28.078707 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d41e6-4a8f-4624-b30c-9f133fb96b02 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:28.104291 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:28.116647 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c5efb-5008-4f18-8836-49902cc27820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:28.117271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c5efb-5008-4f18-8836-49902cc27820 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:28.117554 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c5efb-5008-4f18-8836-49902cc27820 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:28.117829 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c5efb-5008-4f18-8836-49902cc27820 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:28.118584 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902c5efb-5008-4f18-8836-49902cc27820 None admin] RBAC: Adding query filter params (role.id=ce978876ff724bf3b4101c9fd4d2d842, scope.project.id=d428d47056754be5930f84ee53d099af, user.id=0f7457330c2f419ba73e987e07015188) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:28.118896 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902c5efb-5008-4f18-8836-49902cc27820 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:28.120367 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902c5efb-5008-4f18-8836-49902cc27820 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:28.127367 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 139/269] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 7 15:42:27 2022] GET /identity/v3/role_assignments?user.id=0f7457330c2f419ba73e987e07015188&scope.project.id=d428d47056754be5930f84ee53d099af&role.id=ce978876ff724bf3b4101c9fd4d2d842 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:28.309148 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62ee68-8ce8-4628-9a2f-aa0885f69c01 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:28.310103 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62ee68-8ce8-4628-9a2f-aa0885f69c01 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:28.310744 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62ee68-8ce8-4628-9a2f-aa0885f69c01 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:28.312285 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 131/270] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:42:28.317742 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d6acc-8c7f-4d69-972e-5db0e8644b47 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:28.318031 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d6acc-8c7f-4d69-972e-5db0e8644b47 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:28.318336 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d6acc-8c7f-4d69-972e-5db0e8644b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:28.342334 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-913d6acc-8c7f-4d69-972e-5db0e8644b47 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:28.343548 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-913d6acc-8c7f-4d69-972e-5db0e8644b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:28.421828 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 140/271] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:42:28.604176 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb20e55-cf81-43f0-af0b-468160417d7e None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:28.604885 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb20e55-cf81-43f0-af0b-468160417d7e None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:28.604885 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb20e55-cf81-43f0-af0b-468160417d7e None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:28.607666 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 132/272] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:42:28.612878 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fc308-6d9f-4217-8b3a-3ca2f7e25eb4 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:28.613307 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fc308-6d9f-4217-8b3a-3ca2f7e25eb4 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:28.613493 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fc308-6d9f-4217-8b3a-3ca2f7e25eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:28.636121 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-334fc308-6d9f-4217-8b3a-3ca2f7e25eb4 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:28.637326 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-334fc308-6d9f-4217-8b3a-3ca2f7e25eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:28.734427 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 141/273] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:42:28.761202 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb20e55-cf81-43f0-af0b-468160417d7e None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:28.797059 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27568b-9ae6-43fe-bcda-556f0cd1d4e7 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:28.797657 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27568b-9ae6-43fe-bcda-556f0cd1d4e7 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:28.798106 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27568b-9ae6-43fe-bcda-556f0cd1d4e7 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:28.799921 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 142/274] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:42:28.809414 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f384c-3b5d-4f87-884e-7f070773e1c2 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:28.809980 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f384c-3b5d-4f87-884e-7f070773e1c2 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:28.810577 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f384c-3b5d-4f87-884e-7f070773e1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:28.832146 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-a59f384c-3b5d-4f87-884e-7f070773e1c2 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:28.833728 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-a59f384c-3b5d-4f87-884e-7f070773e1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:28.858125 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:28.884635 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb20e55-cf81-43f0-af0b-468160417d7e None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:28.890891 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:28.924034 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 143/275] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:42:28.930229 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace80b1-2444-4729-92e2-8f3868684553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:28.930229 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace80b1-2444-4729-92e2-8f3868684553 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:28.930229 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace80b1-2444-4729-92e2-8f3868684553 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:28.930229 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace80b1-2444-4729-92e2-8f3868684553 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:28.940830 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace80b1-2444-4729-92e2-8f3868684553 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:42:28.945768 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-1ace80b1-2444-4729-92e2-8f3868684553 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:42:28.945768 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:28.945768 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:42:28.945768 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:42:28.945768 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:42:28.945768 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:42:28.945768 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:42:28.945768 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:42:28.945768 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:42:28.945768 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:42:28.945768 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:42:28.945768 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:42:28.945768 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:42:28.945768 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:42:28.945768 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:42:28.945768 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:42:28.946678 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:42:28.946678 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:42:28.946678 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:42:28.946678 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:42:28.946678 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:42:28.946678 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:42:28.946678 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:42:28.946678 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:42:28.946678 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:42:28.946678 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:42:28.946678 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:42:28.946678 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:42:28.946678 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:42:28.946678 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:42:28.946678 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:42:28.946678 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:42:28.947470 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:42:28.947470 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:42:28.947470 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:42:28.947470 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:42:28.947470 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:42:28.947470 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:42:28.947470 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:42:28.947470 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:42:28.947470 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:42:28.947470 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:42:28.947470 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:42:28.947470 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:42:28.947470 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 133/276] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:42:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:42:28.953112 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59f384c-3b5d-4f87-884e-7f070773e1c2 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:29.009303 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace80b1-2444-4729-92e2-8f3868684553 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:29.067469 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59f384c-3b5d-4f87-884e-7f070773e1c2 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:29.115543 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae42fb86-6340-4b81-84ae-ce032346fb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:29.116390 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42fb86-6340-4b81-84ae-ce032346fb44 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:29.116761 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42fb86-6340-4b81-84ae-ce032346fb44 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:29.117354 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42fb86-6340-4b81-84ae-ce032346fb44 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:29.118315 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae42fb86-6340-4b81-84ae-ce032346fb44 None admin] RBAC: Adding query filter params (name=member) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:29.118621 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae42fb86-6340-4b81-84ae-ce032346fb44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:29.120472 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae42fb86-6340-4b81-84ae-ce032346fb44 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:29.125937 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace80b1-2444-4729-92e2-8f3868684553 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:29.131468 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 144/277] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 7 15:42:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:29.136631 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae42fb86-6340-4b81-84ae-ce032346fb44 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:29.165787 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6bbb40-a2a3-4f4c-9be2-130496e826cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:29.166967 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bbb40-a2a3-4f4c-9be2-130496e826cf None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:29.167449 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bbb40-a2a3-4f4c-9be2-130496e826cf None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:29.167961 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bbb40-a2a3-4f4c-9be2-130496e826cf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:29.176219 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:29.183224 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6bbb40-a2a3-4f4c-9be2-130496e826cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:42:29.185470 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:29.190804 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-5f6bbb40-a2a3-4f4c-9be2-130496e826cf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 15:42:29.190804 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:29.190804 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:42:29.190804 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:42:29.190804 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:42:29.190804 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:42:29.190804 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:42:29.190804 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:42:29.190804 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:42:29.190804 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:42:29.190804 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:42:29.190804 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:42:29.190804 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:42:29.190804 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:42:29.190804 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:42:29.190804 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:42:29.191701 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:42:29.191701 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:42:29.191701 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:42:29.191701 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:42:29.191701 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:42:29.191701 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:42:29.191701 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:42:29.191701 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:42:29.191701 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:42:29.191701 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:42:29.191701 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:42:29.191701 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:42:29.191701 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:42:29.191701 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:42:29.191701 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:42:29.191701 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:42:29.192513 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:42:29.192513 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:42:29.192513 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:42:29.192513 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:42:29.192513 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:42:29.192513 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:42:29.192513 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:42:29.192513 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:42:29.192513 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:42:29.192513 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:42:29.192513 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 15:42:29.192513 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:42:29.195239 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 134/278] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:42:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:42:29.201692 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6bbb40-a2a3-4f4c-9be2-130496e826cf None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:29.252464 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae42fb86-6340-4b81-84ae-ce032346fb44 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:29.286817 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1e754-8c69-4cc5-8282-5e876bf77bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:29.287448 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1e754-8c69-4cc5-8282-5e876bf77bf6 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:29.287729 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1e754-8c69-4cc5-8282-5e876bf77bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:29.288002 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1e754-8c69-4cc5-8282-5e876bf77bf6 None admin] PATH_INFO: `/v3/users/878935acfa87481eb1b80b26fda9de90` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:29.301863 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6bbb40-a2a3-4f4c-9be2-130496e826cf None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:29.302107 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c1e754-8c69-4cc5-8282-5e876bf77bf6 None admin] RBAC: Authorizing `identity:get_user(user_id=878935acfa87481eb1b80b26fda9de90)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:29.303587 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c1e754-8c69-4cc5-8282-5e876bf77bf6 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:29.305197 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 145/279] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 7 15:42:29 2022] GET /identity/v3/users/878935acfa87481eb1b80b26fda9de90 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:42:29.306428 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910c755-e7f0-4c0b-a9e5-33f1ece0188c None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:29.306717 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910c755-e7f0-4c0b-a9e5-33f1ece0188c None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:29.306993 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910c755-e7f0-4c0b-a9e5-33f1ece0188c None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:29.308327 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 146/280] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:42:29.310928 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910c755-e7f0-4c0b-a9e5-33f1ece0188c None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:29.338352 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a8359a-3ba7-4f60-816e-8d58226083d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:29.338993 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8359a-3ba7-4f60-816e-8d58226083d6 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:29.339272 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8359a-3ba7-4f60-816e-8d58226083d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:29.339551 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8359a-3ba7-4f60-816e-8d58226083d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:29.340205 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a8359a-3ba7-4f60-816e-8d58226083d6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:29.341014 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a8359a-3ba7-4f60-816e-8d58226083d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:29.342693 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a8359a-3ba7-4f60-816e-8d58226083d6 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:29.350842 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 135/281] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 7 15:42:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:29.350842 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a8359a-3ba7-4f60-816e-8d58226083d6 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:29.409883 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:29.412108 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:29.414602 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910c755-e7f0-4c0b-a9e5-33f1ece0188c None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:29.448657 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e848470-4f95-4777-b6a0-c8dc111e7ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:29.449282 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e848470-4f95-4777-b6a0-c8dc111e7ac5 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:29.449556 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e848470-4f95-4777-b6a0-c8dc111e7ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:29.449826 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e848470-4f95-4777-b6a0-c8dc111e7ac5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:29.451006 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e848470-4f95-4777-b6a0-c8dc111e7ac5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:29.452442 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e848470-4f95-4777-b6a0-c8dc111e7ac5 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:29.453984 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 147/282] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:42:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:29.454730 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a8359a-3ba7-4f60-816e-8d58226083d6 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:29.455099 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4579e2b-b8a8-4114-b1ad-75a1d79111f7 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:29.455377 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4579e2b-b8a8-4114-b1ad-75a1d79111f7 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:29.455702 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4579e2b-b8a8-4114-b1ad-75a1d79111f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:29.473280 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-f4579e2b-b8a8-4114-b1ad-75a1d79111f7 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:29.474471 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-f4579e2b-b8a8-4114-b1ad-75a1d79111f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:29.490536 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b33e3-8528-404a-b142-657e4a58055b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:29.491149 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b33e3-8528-404a-b142-657e4a58055b None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:29.491436 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b33e3-8528-404a-b142-657e4a58055b None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:29.491711 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b33e3-8528-404a-b142-657e4a58055b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:29.492438 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228b33e3-8528-404a-b142-657e4a58055b None admin] RBAC: Adding query filter params (role.id=d45e39b4ad4e4ce782ec649246438663, user.id=878935acfa87481eb1b80b26fda9de90, scope.system=all) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:29.492744 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228b33e3-8528-404a-b142-657e4a58055b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:29.494197 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228b33e3-8528-404a-b142-657e4a58055b None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:29.499825 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 136/283] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Sep 7 15:42:29 2022] GET /identity/v3/role_assignments?user.id=878935acfa87481eb1b80b26fda9de90&scope.system=all&role.id=d45e39b4ad4e4ce782ec649246438663 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:29.500600 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b33e3-8528-404a-b142-657e4a58055b None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:29.551114 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 148/284] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:42:29.560722 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4579e2b-b8a8-4114-b1ad-75a1d79111f7 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:29.616860 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b33e3-8528-404a-b142-657e4a58055b None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:29.643259 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:29.656146 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2f1bf-2c83-4604-8475-fdd81460187d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:29.656813 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2f1bf-2c83-4604-8475-fdd81460187d None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:29.657440 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2f1bf-2c83-4604-8475-fdd81460187d None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:29.657440 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2f1bf-2c83-4604-8475-fdd81460187d None admin] PATH_INFO: `/v3/users/5368662edf3f4f48bf095defd29df726` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:29.658557 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b2f1bf-2c83-4604-8475-fdd81460187d None admin] RBAC: Authorizing `identity:get_user(user_id=5368662edf3f4f48bf095defd29df726)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:29.660192 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b2f1bf-2c83-4604-8475-fdd81460187d None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:29.661790 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 137/285] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 7 15:42:29 2022] GET /identity/v3/users/5368662edf3f4f48bf095defd29df726 => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:29.668233 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2f1bf-2c83-4604-8475-fdd81460187d None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:29.679132 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:29.688869 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4579e2b-b8a8-4114-b1ad-75a1d79111f7 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:29.724855 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53883c56-59d7-4e58-b04a-62ca89730b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:29.725471 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53883c56-59d7-4e58-b04a-62ca89730b1b None admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:29.725751 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53883c56-59d7-4e58-b04a-62ca89730b1b None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:29.726025 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53883c56-59d7-4e58-b04a-62ca89730b1b None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:29.726712 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53883c56-59d7-4e58-b04a-62ca89730b1b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:29.728152 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53883c56-59d7-4e58-b04a-62ca89730b1b None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:29.757336 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 149/286] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Sep 7 15:42:29 2022] POST /identity/v3/users => generated 293 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:42:29.805426 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2f1bf-2c83-4604-8475-fdd81460187d None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:29.827270 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53883c56-59d7-4e58-b04a-62ca89730b1b None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:29.846658 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509f831-e231-436d-a158-6c405de8637c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:29.847356 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509f831-e231-436d-a158-6c405de8637c None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:29.847637 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509f831-e231-436d-a158-6c405de8637c None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:29.847909 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509f831-e231-436d-a158-6c405de8637c None admin] PATH_INFO: `/v3/projects/d428d47056754be5930f84ee53d099af` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:29.849109 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7509f831-e231-436d-a158-6c405de8637c None admin] RBAC: Authorizing `identity:get_project(project_id=d428d47056754be5930f84ee53d099af)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:29.850611 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7509f831-e231-436d-a158-6c405de8637c None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:29.852317 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 138/287] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 7 15:42:29 2022] GET /identity/v3/projects/d428d47056754be5930f84ee53d099af => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:42:29.859578 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509f831-e231-436d-a158-6c405de8637c None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:29.929026 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:29.967037 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53883c56-59d7-4e58-b04a-62ca89730b1b None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:29.976698 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509f831-e231-436d-a158-6c405de8637c None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:30.012220 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f4e2fa-62a5-4b7f-8fd3-cb9ad4925a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:30.013634 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4e2fa-62a5-4b7f-8fd3-cb9ad4925a95 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:30.013874 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4e2fa-62a5-4b7f-8fd3-cb9ad4925a95 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:30.014144 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4e2fa-62a5-4b7f-8fd3-cb9ad4925a95 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:30.024204 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe8bfb-2a6a-4f3c-862d-c345b92240db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:30.024204 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe8bfb-2a6a-4f3c-862d-c345b92240db None admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:30.024204 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe8bfb-2a6a-4f3c-862d-c345b92240db None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:30.024204 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe8bfb-2a6a-4f3c-862d-c345b92240db None admin] PATH_INFO: `/v3/projects/d428d47056754be5930f84ee53d099af/users/5368662edf3f4f48bf095defd29df726/roles/903d756c82454add946529986655408d` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:30.027450 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fe8bfb-2a6a-4f3c-862d-c345b92240db None admin] RBAC: Authorizing `identity:create_grant(project_id=d428d47056754be5930f84ee53d099af, user_id=5368662edf3f4f48bf095defd29df726, role_id=903d756c82454add946529986655408d)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:30.029097 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fe8bfb-2a6a-4f3c-862d-c345b92240db None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:30.033321 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f4e2fa-62a5-4b7f-8fd3-cb9ad4925a95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:42:30.040376 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-58f4e2fa-62a5-4b7f-8fd3-cb9ad4925a95 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:42:30.040376 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:30.040376 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:42:30.040376 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:42:30.040376 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:42:30.040376 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:42:30.040376 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:42:30.040376 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:42:30.040376 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:42:30.040376 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:42:30.040376 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:42:30.040376 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:42:30.040376 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:42:30.040376 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:42:30.040376 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:42:30.040376 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:42:30.041751 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:42:30.041751 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:42:30.041751 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:42:30.041751 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:42:30.041751 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:42:30.041751 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:42:30.041751 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:42:30.041751 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:42:30.041751 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:42:30.041751 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:42:30.041751 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:42:30.041751 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:42:30.041751 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:42:30.041751 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:42:30.041751 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:42:30.041751 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:42:30.043189 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:42:30.043189 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:42:30.043189 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:42:30.043189 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:42:30.043189 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:42:30.043189 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:42:30.043189 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:42:30.043189 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:42:30.043189 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:42:30.043189 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:42:30.043189 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:42:30.043189 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:42:30.045974 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 150/288] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:42:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:42:30.049026 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f4e2fa-62a5-4b7f-8fd3-cb9ad4925a95 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:30.053313 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 139/289] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 7 15:42:29 2022] PUT /identity/v3/projects/d428d47056754be5930f84ee53d099af/users/5368662edf3f4f48bf095defd29df726/roles/903d756c82454add946529986655408d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 15:42:30.082574 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:30.175215 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f4e2fa-62a5-4b7f-8fd3-cb9ad4925a95 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:30.214799 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59f146-c6b1-407c-aa2a-6605850a6b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:30.216251 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59f146-c6b1-407c-aa2a-6605850a6b52 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:30.216700 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59f146-c6b1-407c-aa2a-6605850a6b52 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:30.217016 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59f146-c6b1-407c-aa2a-6605850a6b52 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:30.217795 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee59f146-c6b1-407c-aa2a-6605850a6b52 None admin] RBAC: Adding query filter params (name=member) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:30.218193 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee59f146-c6b1-407c-aa2a-6605850a6b52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:30.219840 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee59f146-c6b1-407c-aa2a-6605850a6b52 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:30.229664 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 151/290] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 7 15:42:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:42:30.236455 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe8bfb-2a6a-4f3c-862d-c345b92240db None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:30.350056 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe8bfb-2a6a-4f3c-862d-c345b92240db None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:30.374855 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:30.400321 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e403f-eb9e-46d0-b491-6ee3bd8558ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:30.400964 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e403f-eb9e-46d0-b491-6ee3bd8558ff None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:30.401310 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e403f-eb9e-46d0-b491-6ee3bd8558ff None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:30.401595 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e403f-eb9e-46d0-b491-6ee3bd8558ff None admin] PATH_INFO: `/v3/users/6c1338b2fbe646bc99d2222c0de6a576` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:30.402784 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6e403f-eb9e-46d0-b491-6ee3bd8558ff None admin] RBAC: Authorizing `identity:get_user(user_id=6c1338b2fbe646bc99d2222c0de6a576)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:30.404911 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6e403f-eb9e-46d0-b491-6ee3bd8558ff None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:30.406910 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 140/291] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 7 15:42:30 2022] GET /identity/v3/users/6c1338b2fbe646bc99d2222c0de6a576 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:30.412760 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59f146-c6b1-407c-aa2a-6605850a6b52 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:30.532975 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:30.562507 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59f146-c6b1-407c-aa2a-6605850a6b52 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:30.607958 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f15a6-4c4c-41c3-aad5-dd17e9949852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:30.608820 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f15a6-4c4c-41c3-aad5-dd17e9949852 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:30.609247 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f15a6-4c4c-41c3-aad5-dd17e9949852 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:30.609692 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f15a6-4c4c-41c3-aad5-dd17e9949852 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:30.689560 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7f15a6-4c4c-41c3-aad5-dd17e9949852 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:30.691698 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7f15a6-4c4c-41c3-aad5-dd17e9949852 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:30.786612 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:30.823453 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 152/292] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:42:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:42:30.834101 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e403f-eb9e-46d0-b491-6ee3bd8558ff None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:30.991145 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e403f-eb9e-46d0-b491-6ee3bd8558ff None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:31.038793 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccaf34e-a22d-4563-b3ed-e4df44e82ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:31.039381 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccaf34e-a22d-4563-b3ed-e4df44e82ced None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:31.039659 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccaf34e-a22d-4563-b3ed-e4df44e82ced None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:31.039932 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccaf34e-a22d-4563-b3ed-e4df44e82ced None admin] PATH_INFO: `/v3/projects/d428d47056754be5930f84ee53d099af` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:31.041136 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccaf34e-a22d-4563-b3ed-e4df44e82ced None admin] RBAC: Authorizing `identity:get_project(project_id=d428d47056754be5930f84ee53d099af)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:31.042674 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccaf34e-a22d-4563-b3ed-e4df44e82ced None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:31.045528 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 141/293] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 7 15:42:30 2022] GET /identity/v3/projects/d428d47056754be5930f84ee53d099af => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:31.051444 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f15a6-4c4c-41c3-aad5-dd17e9949852 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:31.194841 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f15a6-4c4c-41c3-aad5-dd17e9949852 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:31.237649 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ff84e-f963-4572-ad46-fc503cd5eedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:31.238292 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ff84e-f963-4572-ad46-fc503cd5eedc None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:31.238580 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ff84e-f963-4572-ad46-fc503cd5eedc None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:31.238857 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ff84e-f963-4572-ad46-fc503cd5eedc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:31.239584 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ff84e-f963-4572-ad46-fc503cd5eedc None admin] RBAC: Adding query filter params (role.id=d45e39b4ad4e4ce782ec649246438663, scope.project.id=d428d47056754be5930f84ee53d099af, user.id=6c1338b2fbe646bc99d2222c0de6a576) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:31.239895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ff84e-f963-4572-ad46-fc503cd5eedc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:31.241325 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ff84e-f963-4572-ad46-fc503cd5eedc None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:31.247305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 153/294] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 7 15:42:31 2022] GET /identity/v3/role_assignments?user.id=6c1338b2fbe646bc99d2222c0de6a576&scope.project.id=d428d47056754be5930f84ee53d099af&role.id=d45e39b4ad4e4ce782ec649246438663 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:32.158915 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306590b1-4b4a-42fe-adb6-4f8ffb242b03 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:32.159416 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306590b1-4b4a-42fe-adb6-4f8ffb242b03 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:32.159488 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306590b1-4b4a-42fe-adb6-4f8ffb242b03 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:32.161027 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 142/295] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:42:32.166127 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3aaf4-0d55-4beb-812d-0279376b8735 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:32.166553 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3aaf4-0d55-4beb-812d-0279376b8735 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:32.166726 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3aaf4-0d55-4beb-812d-0279376b8735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:32.186815 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-e1c3aaf4-0d55-4beb-812d-0279376b8735 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:32.188091 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-e1c3aaf4-0d55-4beb-812d-0279376b8735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:32.223312 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:32.262887 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 154/296] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:42:32.482414 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229800aa-aecd-4c6e-bf74-57143521bc87 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:32.482911 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229800aa-aecd-4c6e-bf74-57143521bc87 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:32.483303 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229800aa-aecd-4c6e-bf74-57143521bc87 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:32.485017 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 143/297] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:42:32.490917 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef693a8-dfa4-4547-a986-5e2458271942 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:32.491344 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef693a8-dfa4-4547-a986-5e2458271942 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:32.491733 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef693a8-dfa4-4547-a986-5e2458271942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:32.512171 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-6ef693a8-dfa4-4547-a986-5e2458271942 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:32.513467 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-6ef693a8-dfa4-4547-a986-5e2458271942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:32.534339 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229800aa-aecd-4c6e-bf74-57143521bc87 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:32.588996 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 155/298] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:42:32.591180 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7731f-d2a7-4d1d-adf1-360430dab239 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:32.591665 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7731f-d2a7-4d1d-adf1-360430dab239 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:32.592131 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7731f-d2a7-4d1d-adf1-360430dab239 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:32.593555 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 156/299] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:42:32.599514 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154e35b-ae7f-4051-b295-bdf066b639e9 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:32.600036 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154e35b-ae7f-4051-b295-bdf066b639e9 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:32.600523 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154e35b-ae7f-4051-b295-bdf066b639e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:32.601980 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:32.624792 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-c154e35b-ae7f-4051-b295-bdf066b639e9 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:32.625988 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-c154e35b-ae7f-4051-b295-bdf066b639e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:32.658655 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229800aa-aecd-4c6e-bf74-57143521bc87 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:32.693289 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 157/300] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:42:32.694577 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415ca9d-c7cc-442c-b4e7-3b5e3ea5d32f None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:32.694864 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415ca9d-c7cc-442c-b4e7-3b5e3ea5d32f None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:32.695139 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415ca9d-c7cc-442c-b4e7-3b5e3ea5d32f None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:32.695493 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df605c85-2153-4a52-88a4-4d40319c9400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:32.696320 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df605c85-2153-4a52-88a4-4d40319c9400 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:32.696424 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 158/301] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:42:32.696918 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df605c85-2153-4a52-88a4-4d40319c9400 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:32.697363 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df605c85-2153-4a52-88a4-4d40319c9400 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:32.702196 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39557ff0-998b-4bd5-a7b3-7ed941a49dc1 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:32.702490 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39557ff0-998b-4bd5-a7b3-7ed941a49dc1 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:32.702771 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39557ff0-998b-4bd5-a7b3-7ed941a49dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:32.723471 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df605c85-2153-4a52-88a4-4d40319c9400 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:42:32.725915 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-39557ff0-998b-4bd5-a7b3-7ed941a49dc1 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:32.727370 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-39557ff0-998b-4bd5-a7b3-7ed941a49dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:32.728421 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-df605c85-2153-4a52-88a4-4d40319c9400 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:42:32.728421 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:32.728421 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:42:32.728421 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:42:32.728421 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:42:32.728421 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:42:32.728421 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:42:32.728421 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:42:32.728421 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:42:32.728421 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:42:32.728421 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:42:32.728421 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:42:32.728421 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:42:32.728421 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:42:32.728421 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:42:32.728421 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:42:32.729303 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:42:32.729303 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:42:32.729303 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:42:32.729303 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:42:32.729303 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:42:32.729303 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:42:32.729303 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:42:32.729303 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:42:32.729303 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:42:32.729303 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:42:32.729303 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:42:32.729303 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:42:32.729303 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:42:32.729303 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:42:32.729303 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:42:32.729303 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:42:32.730134 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:42:32.730134 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:42:32.730134 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:42:32.730134 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:42:32.730134 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:42:32.730134 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:42:32.730134 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:42:32.730134 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:42:32.730134 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:42:32.730134 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:42:32.730134 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:42:32.730134 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:42:32.735737 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 144/302] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:42:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:42:32.736044 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df605c85-2153-4a52-88a4-4d40319c9400 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:32.763242 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:32.822098 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 159/303] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:42:32.851457 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df605c85-2153-4a52-88a4-4d40319c9400 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:32.863467 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39557ff0-998b-4bd5-a7b3-7ed941a49dc1 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:32.870313 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:32.896799 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a724c1-3054-4a60-8e78-c57e9125dc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:32.897433 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a724c1-3054-4a60-8e78-c57e9125dc8a None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:32.897717 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a724c1-3054-4a60-8e78-c57e9125dc8a None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:32.897993 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a724c1-3054-4a60-8e78-c57e9125dc8a None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:32.898997 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a724c1-3054-4a60-8e78-c57e9125dc8a None admin] RBAC: Adding query filter params (name=member) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:32.899308 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a724c1-3054-4a60-8e78-c57e9125dc8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:32.900992 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a724c1-3054-4a60-8e78-c57e9125dc8a None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:32.911908 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 145/304] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 7 15:42:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:32.923102 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a724c1-3054-4a60-8e78-c57e9125dc8a None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:32.976128 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39557ff0-998b-4bd5-a7b3-7ed941a49dc1 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:33.010638 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef9787-bae6-4dc2-84f8-edd17b3edef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:33.011553 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef9787-bae6-4dc2-84f8-edd17b3edef2 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:33.011830 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef9787-bae6-4dc2-84f8-edd17b3edef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:33.012110 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef9787-bae6-4dc2-84f8-edd17b3edef2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:33.023221 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ef9787-bae6-4dc2-84f8-edd17b3edef2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:42:33.028169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-b7ef9787-bae6-4dc2-84f8-edd17b3edef2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 15:42:33.028169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:33.028169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:42:33.028169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:42:33.028169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:42:33.028169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:42:33.028169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:42:33.028169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:42:33.028169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:42:33.028169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:42:33.028169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:42:33.028169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:42:33.028169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:42:33.028169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:42:33.028169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:42:33.028169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:42:33.029231 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:42:33.029231 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:42:33.029231 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:42:33.029231 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:42:33.029231 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:42:33.029231 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:42:33.029231 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:42:33.029231 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:42:33.029231 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:42:33.029231 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:42:33.029231 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:42:33.029231 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:42:33.029231 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:42:33.029231 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:42:33.029231 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:42:33.029231 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:42:33.030046 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:42:33.030046 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:42:33.030046 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:42:33.030046 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:42:33.030046 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:42:33.030046 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:42:33.030046 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:42:33.030046 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:42:33.030046 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:42:33.030046 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:42:33.030046 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 15:42:33.030046 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:42:33.030046 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 160/305] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:42:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:42:33.030820 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef9787-bae6-4dc2-84f8-edd17b3edef2 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:33.052469 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:33.062286 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a724c1-3054-4a60-8e78-c57e9125dc8a None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:33.105200 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8648edc4-b106-4535-a305-937caf20ec0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:33.105833 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648edc4-b106-4535-a305-937caf20ec0c None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:33.106139 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648edc4-b106-4535-a305-937caf20ec0c None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:33.107256 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648edc4-b106-4535-a305-937caf20ec0c None admin] PATH_INFO: `/v3/users/878935acfa87481eb1b80b26fda9de90` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:33.108376 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8648edc4-b106-4535-a305-937caf20ec0c None admin] RBAC: Authorizing `identity:get_user(user_id=878935acfa87481eb1b80b26fda9de90)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:33.109850 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8648edc4-b106-4535-a305-937caf20ec0c None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:33.111476 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 146/306] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 7 15:42:32 2022] GET /identity/v3/users/878935acfa87481eb1b80b26fda9de90 => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:33.113407 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8648edc4-b106-4535-a305-937caf20ec0c None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:33.137086 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef9787-bae6-4dc2-84f8-edd17b3edef2 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:33.158862 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:33.172254 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b21026-8af4-461b-b6a6-b4303da007b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:33.172880 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b21026-8af4-461b-b6a6-b4303da007b8 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:33.173154 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b21026-8af4-461b-b6a6-b4303da007b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:33.173425 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b21026-8af4-461b-b6a6-b4303da007b8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:33.174545 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b21026-8af4-461b-b6a6-b4303da007b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:33.175978 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b21026-8af4-461b-b6a6-b4303da007b8 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:33.177509 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 161/307] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:42:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:33.178326 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b21026-8af4-461b-b6a6-b4303da007b8 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:33.216851 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8648edc4-b106-4535-a305-937caf20ec0c None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:33.250306 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fbf56-5081-4d14-9a48-5687d487866d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:33.250909 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fbf56-5081-4d14-9a48-5687d487866d None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:33.251186 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fbf56-5081-4d14-9a48-5687d487866d None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:33.251458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fbf56-5081-4d14-9a48-5687d487866d None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:33.252109 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6fbf56-5081-4d14-9a48-5687d487866d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:33.252415 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6fbf56-5081-4d14-9a48-5687d487866d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:33.253772 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6fbf56-5081-4d14-9a48-5687d487866d None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:33.267252 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 147/308] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 7 15:42:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:33.267252 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fbf56-5081-4d14-9a48-5687d487866d None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:33.268149 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:33.277565 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b21026-8af4-461b-b6a6-b4303da007b8 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:33.311105 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f7f7af-6800-452f-8403-fa03896bb84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:33.311727 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7f7af-6800-452f-8403-fa03896bb84e None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:33.312006 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7f7af-6800-452f-8403-fa03896bb84e None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:33.312280 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7f7af-6800-452f-8403-fa03896bb84e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:33.322352 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f7f7af-6800-452f-8403-fa03896bb84e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:42:33.328467 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-80f7f7af-6800-452f-8403-fa03896bb84e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 15:42:33.328467 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:33.328467 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:42:33.328467 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:42:33.328467 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:42:33.328467 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:42:33.328467 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:42:33.328467 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:42:33.328467 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:42:33.328467 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:42:33.328467 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:42:33.328467 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:42:33.328467 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:42:33.328467 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:42:33.328467 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:42:33.328467 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:42:33.329377 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:42:33.329377 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:42:33.329377 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:42:33.329377 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:42:33.329377 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:42:33.329377 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:42:33.329377 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:42:33.329377 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:42:33.329377 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:42:33.329377 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:42:33.329377 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:42:33.329377 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:42:33.329377 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:42:33.329377 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:42:33.329377 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:42:33.329377 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:42:33.330221 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:42:33.330221 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:42:33.330221 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:42:33.330221 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:42:33.330221 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:42:33.330221 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:42:33.330221 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:42:33.330221 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:42:33.330221 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:42:33.330221 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:42:33.330221 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 15:42:33.330221 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:42:33.330221 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 162/309] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:42:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:42:33.330893 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f7f7af-6800-452f-8403-fa03896bb84e None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:33.362799 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fbf56-5081-4d14-9a48-5687d487866d None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:33.369772 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:33.396534 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16694319-37a3-4ddc-bb3f-44a36a95ff24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:33.397178 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16694319-37a3-4ddc-bb3f-44a36a95ff24 None admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:33.397460 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16694319-37a3-4ddc-bb3f-44a36a95ff24 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:33.397736 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16694319-37a3-4ddc-bb3f-44a36a95ff24 None admin] PATH_INFO: `/v3/system/users/878935acfa87481eb1b80b26fda9de90/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:33.399186 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16694319-37a3-4ddc-bb3f-44a36a95ff24 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=878935acfa87481eb1b80b26fda9de90, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:33.400564 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16694319-37a3-4ddc-bb3f-44a36a95ff24 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:33.409074 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 148/310] 10.222.0.16 () {58 vars in 1334 bytes} [Wed Sep 7 15:42:33 2022] PUT /identity/v3/system/users/878935acfa87481eb1b80b26fda9de90/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:42:33.409993 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16694319-37a3-4ddc-bb3f-44a36a95ff24 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:33.432889 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f7f7af-6800-452f-8403-fa03896bb84e None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:33.473991 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8592a6c-3d43-443b-8d3e-4e02a3e17149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:33.474700 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8592a6c-3d43-443b-8d3e-4e02a3e17149 None admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:33.474987 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8592a6c-3d43-443b-8d3e-4e02a3e17149 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:33.475261 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8592a6c-3d43-443b-8d3e-4e02a3e17149 None admin] PATH_INFO: `/v3/groups` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:33.476028 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8592a6c-3d43-443b-8d3e-4e02a3e17149 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:33.477506 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8592a6c-3d43-443b-8d3e-4e02a3e17149 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:33.506229 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 163/311] 10.222.0.16 () {60 vars in 1134 bytes} [Wed Sep 7 15:42:33 2022] POST /identity/v3/groups => generated 229 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:42:33.506229 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8592a6c-3d43-443b-8d3e-4e02a3e17149 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:33.517428 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:33.539590 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16694319-37a3-4ddc-bb3f-44a36a95ff24 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:33.585349 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab61846-7d96-4c00-b39c-4b183476f001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:33.586661 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab61846-7d96-4c00-b39c-4b183476f001 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:33.587788 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab61846-7d96-4c00-b39c-4b183476f001 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:33.588080 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab61846-7d96-4c00-b39c-4b183476f001 None admin] PATH_INFO: `/v3/users/06eb70a1c1214cb5ae5fe7775ed8eeb1` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:33.605932 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab61846-7d96-4c00-b39c-4b183476f001 None admin] RBAC: Authorizing `identity:get_user(user_id=06eb70a1c1214cb5ae5fe7775ed8eeb1)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:33.608325 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab61846-7d96-4c00-b39c-4b183476f001 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:33.610458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 149/312] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 7 15:42:33 2022] GET /identity/v3/users/06eb70a1c1214cb5ae5fe7775ed8eeb1 => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:33.616770 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab61846-7d96-4c00-b39c-4b183476f001 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:33.651087 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:33.656166 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8592a6c-3d43-443b-8d3e-4e02a3e17149 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:33.694707 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe8a16-153a-45b3-bb8b-662af02334c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:33.695691 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe8a16-153a-45b3-bb8b-662af02334c8 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:33.696149 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe8a16-153a-45b3-bb8b-662af02334c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:33.696612 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe8a16-153a-45b3-bb8b-662af02334c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:33.697287 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefe8a16-153a-45b3-bb8b-662af02334c8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:33.697596 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefe8a16-153a-45b3-bb8b-662af02334c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:33.699071 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefe8a16-153a-45b3-bb8b-662af02334c8 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:33.708228 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 164/313] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 7 15:42:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:33.713862 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe8a16-153a-45b3-bb8b-662af02334c8 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:33.747893 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab61846-7d96-4c00-b39c-4b183476f001 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:33.788528 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51d964-e56c-4783-9e2e-26a41f3ebf75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:33.789078 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51d964-e56c-4783-9e2e-26a41f3ebf75 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:33.789617 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51d964-e56c-4783-9e2e-26a41f3ebf75 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:33.789890 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51d964-e56c-4783-9e2e-26a41f3ebf75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:33.791115 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:33.792472 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e51d964-e56c-4783-9e2e-26a41f3ebf75 None admin] RBAC: Adding query filter params (role.id=903d756c82454add946529986655408d, user.id=06eb70a1c1214cb5ae5fe7775ed8eeb1, scope.system=all) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:33.793170 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e51d964-e56c-4783-9e2e-26a41f3ebf75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:33.796005 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e51d964-e56c-4783-9e2e-26a41f3ebf75 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:33.802901 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 150/314] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Sep 7 15:42:33 2022] GET /identity/v3/role_assignments?user.id=06eb70a1c1214cb5ae5fe7775ed8eeb1&scope.system=all&role.id=903d756c82454add946529986655408d => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:42:33.838649 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe8a16-153a-45b3-bb8b-662af02334c8 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:33.881414 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7441709-ed0a-4278-bbc4-8a3580ff031a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:33.882149 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7441709-ed0a-4278-bbc4-8a3580ff031a None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:33.882473 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7441709-ed0a-4278-bbc4-8a3580ff031a None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:33.882810 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7441709-ed0a-4278-bbc4-8a3580ff031a None admin] PATH_INFO: `/v3/users/5368662edf3f4f48bf095defd29df726` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:33.884052 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7441709-ed0a-4278-bbc4-8a3580ff031a None admin] RBAC: Authorizing `identity:get_user(user_id=5368662edf3f4f48bf095defd29df726)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:33.885523 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7441709-ed0a-4278-bbc4-8a3580ff031a None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:33.888005 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 165/315] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 7 15:42:33 2022] GET /identity/v3/users/5368662edf3f4f48bf095defd29df726 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:42:33.893515 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51d964-e56c-4783-9e2e-26a41f3ebf75 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:33.998475 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:34.007904 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51d964-e56c-4783-9e2e-26a41f3ebf75 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:34.050503 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c608d773-d9bf-4a88-ae16-b33cbb71aa13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:34.051411 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608d773-d9bf-4a88-ae16-b33cbb71aa13 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:34.051885 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608d773-d9bf-4a88-ae16-b33cbb71aa13 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:34.052391 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608d773-d9bf-4a88-ae16-b33cbb71aa13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:34.121753 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c608d773-d9bf-4a88-ae16-b33cbb71aa13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:34.123584 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c608d773-d9bf-4a88-ae16-b33cbb71aa13 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:34.215422 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:34.225931 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 151/316] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:42:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:42:34.232604 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7441709-ed0a-4278-bbc4-8a3580ff031a None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:34.347746 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7441709-ed0a-4278-bbc4-8a3580ff031a None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:34.386196 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a9677-f5d6-4f07-98dc-ef55be6936c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:34.386845 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a9677-f5d6-4f07-98dc-ef55be6936c6 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:34.387136 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a9677-f5d6-4f07-98dc-ef55be6936c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:34.387460 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a9677-f5d6-4f07-98dc-ef55be6936c6 None admin] PATH_INFO: `/v3/projects/d428d47056754be5930f84ee53d099af` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:34.389012 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65a9677-f5d6-4f07-98dc-ef55be6936c6 None admin] RBAC: Authorizing `identity:get_project(project_id=d428d47056754be5930f84ee53d099af)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:34.390594 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65a9677-f5d6-4f07-98dc-ef55be6936c6 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:34.392622 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 166/317] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 7 15:42:34 2022] GET /identity/v3/projects/d428d47056754be5930f84ee53d099af => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:34.398879 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c608d773-d9bf-4a88-ae16-b33cbb71aa13 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:34.507211 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c608d773-d9bf-4a88-ae16-b33cbb71aa13 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:34.546780 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79031b3-cd8e-4bd1-b065-d9113008e62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:34.547737 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79031b3-cd8e-4bd1-b065-d9113008e62d None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:34.548241 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79031b3-cd8e-4bd1-b065-d9113008e62d None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:34.548721 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79031b3-cd8e-4bd1-b065-d9113008e62d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:34.549647 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79031b3-cd8e-4bd1-b065-d9113008e62d None admin] RBAC: Adding query filter params (role.id=903d756c82454add946529986655408d, scope.project.id=d428d47056754be5930f84ee53d099af, user.id=5368662edf3f4f48bf095defd29df726) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:34.550195 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79031b3-cd8e-4bd1-b065-d9113008e62d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:34.552151 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79031b3-cd8e-4bd1-b065-d9113008e62d None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:34.566001 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 152/318] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 7 15:42:34 2022] GET /identity/v3/role_assignments?user.id=5368662edf3f4f48bf095defd29df726&scope.project.id=d428d47056754be5930f84ee53d099af&role.id=903d756c82454add946529986655408d => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:35.713278 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4f382-d8b8-4c33-a45d-6c37f080b6cf None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:35.713789 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4f382-d8b8-4c33-a45d-6c37f080b6cf None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:35.713863 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4f382-d8b8-4c33-a45d-6c37f080b6cf None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:35.715319 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 167/319] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:42:35.720782 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62127b70-5ac2-4088-bbd3-0724c6799d69 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:35.721158 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62127b70-5ac2-4088-bbd3-0724c6799d69 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:35.721332 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62127b70-5ac2-4088-bbd3-0724c6799d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:35.740444 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-62127b70-5ac2-4088-bbd3-0724c6799d69 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:35.741621 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-62127b70-5ac2-4088-bbd3-0724c6799d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:35.791164 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c4127-87c0-40fd-90a3-79012072b027 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:35.791473 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c4127-87c0-40fd-90a3-79012072b027 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:35.791714 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c4127-87c0-40fd-90a3-79012072b027 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:35.793173 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 168/320] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:42:35.797945 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:35.798855 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27febaff-793e-405f-ae29-a0a4c051f416 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:35.799039 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27febaff-793e-405f-ae29-a0a4c051f416 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:35.799328 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27febaff-793e-405f-ae29-a0a4c051f416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:35.806753 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:35.818216 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 153/321] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:42:35.819519 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-27febaff-793e-405f-ae29-a0a4c051f416 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:35.820757 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-27febaff-793e-405f-ae29-a0a4c051f416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:35.894218 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 169/322] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:42:36.050371 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6e2a5-d683-466e-bd4b-531574be3516 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:36.050661 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6e2a5-d683-466e-bd4b-531574be3516 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:36.050936 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6e2a5-d683-466e-bd4b-531574be3516 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:36.052407 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 154/323] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:42:36.057331 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99207b8-a00d-4560-868b-209c0dcaae15 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:36.057618 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99207b8-a00d-4560-868b-209c0dcaae15 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:36.057892 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99207b8-a00d-4560-868b-209c0dcaae15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:36.077088 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-f99207b8-a00d-4560-868b-209c0dcaae15 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:36.078303 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-f99207b8-a00d-4560-868b-209c0dcaae15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:36.089180 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be6e2a5-d683-466e-bd4b-531574be3516 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:36.152517 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 170/324] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:42:36.164186 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99207b8-a00d-4560-868b-209c0dcaae15 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:36.197192 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be6e2a5-d683-466e-bd4b-531574be3516 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:36.232260 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003e06fb-db8c-41f3-9eb5-f1227a5f27ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:36.232515 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:36.232894 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e06fb-db8c-41f3-9eb5-f1227a5f27ab None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:36.233176 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e06fb-db8c-41f3-9eb5-f1227a5f27ab None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:36.233529 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e06fb-db8c-41f3-9eb5-f1227a5f27ab None admin] PATH_INFO: `/v3/roles/member` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:36.248677 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003e06fb-db8c-41f3-9eb5-f1227a5f27ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:42:36.255171 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-003e06fb-db8c-41f3-9eb5-f1227a5f27ab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:42:36.255171 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:36.255171 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:42:36.255171 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:42:36.255171 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:42:36.255171 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:42:36.255171 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:42:36.255171 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:42:36.255171 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:42:36.255171 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:42:36.255171 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:42:36.255171 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:42:36.255171 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:42:36.255171 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:42:36.255171 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:42:36.255171 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:42:36.256054 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:42:36.256054 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:42:36.256054 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:42:36.256054 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:42:36.256054 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:42:36.256054 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:42:36.256054 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:42:36.256054 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:42:36.256054 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:42:36.256054 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:42:36.256054 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:42:36.256054 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:42:36.256054 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:42:36.256054 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:42:36.256054 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:42:36.256054 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:42:36.256839 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:42:36.256839 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:42:36.256839 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:42:36.256839 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:42:36.256839 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:42:36.256839 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:42:36.256839 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:42:36.256839 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:42:36.256839 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:42:36.256839 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:42:36.256839 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:42:36.256839 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:42:36.257470 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 155/325] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:42:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:42:36.262630 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003e06fb-db8c-41f3-9eb5-f1227a5f27ab None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:36.274498 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99207b8-a00d-4560-868b-209c0dcaae15 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:36.309406 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339674b-f69c-4beb-afd1-9801356823f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:36.309961 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339674b-f69c-4beb-afd1-9801356823f8 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:36.310261 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339674b-f69c-4beb-afd1-9801356823f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:36.310531 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339674b-f69c-4beb-afd1-9801356823f8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:36.311631 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2339674b-f69c-4beb-afd1-9801356823f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:36.313078 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2339674b-f69c-4beb-afd1-9801356823f8 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:36.314806 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:36.314926 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 171/326] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:42:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:42:36.320170 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339674b-f69c-4beb-afd1-9801356823f8 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:36.380001 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003e06fb-db8c-41f3-9eb5-f1227a5f27ab None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:36.417614 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf481f2-a305-4981-9495-74d3fc1276ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:36.418264 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf481f2-a305-4981-9495-74d3fc1276ef None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:36.418549 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf481f2-a305-4981-9495-74d3fc1276ef None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:36.419339 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf481f2-a305-4981-9495-74d3fc1276ef None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:36.420035 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf481f2-a305-4981-9495-74d3fc1276ef None admin] RBAC: Adding query filter params (name=member) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:36.420340 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf481f2-a305-4981-9495-74d3fc1276ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:36.421727 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf481f2-a305-4981-9495-74d3fc1276ef None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:36.426902 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339674b-f69c-4beb-afd1-9801356823f8 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:36.435303 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 156/327] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 7 15:42:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:42:36.435303 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf481f2-a305-4981-9495-74d3fc1276ef None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:36.457440 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:36.463040 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e09e0bf-281b-40a8-9290-0de7817e12a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:36.463640 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09e0bf-281b-40a8-9290-0de7817e12a4 None admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:36.463920 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09e0bf-281b-40a8-9290-0de7817e12a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:36.464195 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09e0bf-281b-40a8-9290-0de7817e12a4 None admin] PATH_INFO: `/v3/groups` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:36.464815 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e09e0bf-281b-40a8-9290-0de7817e12a4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:36.466940 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e09e0bf-281b-40a8-9290-0de7817e12a4 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:36.481206 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 172/328] 10.222.0.16 () {60 vars in 1134 bytes} [Wed Sep 7 15:42:36 2022] POST /identity/v3/groups => generated 226 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:42:36.482568 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e09e0bf-281b-40a8-9290-0de7817e12a4 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:36.536517 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf481f2-a305-4981-9495-74d3fc1276ef None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:36.547942 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:36.578136 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c6fd3-57ef-4c51-b1d8-f73e14096f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:36.578728 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c6fd3-57ef-4c51-b1d8-f73e14096f75 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:36.579006 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c6fd3-57ef-4c51-b1d8-f73e14096f75 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:36.579277 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c6fd3-57ef-4c51-b1d8-f73e14096f75 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:36.593699 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9c6fd3-57ef-4c51-b1d8-f73e14096f75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:42:36.607436 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-ba9c6fd3-57ef-4c51-b1d8-f73e14096f75 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 15:42:36.607436 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:36.607436 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:42:36.607436 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:42:36.607436 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:42:36.607436 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:42:36.607436 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:42:36.607436 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:42:36.607436 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:42:36.607436 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:42:36.607436 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:42:36.607436 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:42:36.607436 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:42:36.607436 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:42:36.607436 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:42:36.607436 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:42:36.608568 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:42:36.608568 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:42:36.608568 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:42:36.608568 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:42:36.608568 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:42:36.608568 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:42:36.608568 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:42:36.608568 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:42:36.608568 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:42:36.608568 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:42:36.608568 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:42:36.608568 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:42:36.608568 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:42:36.608568 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:42:36.608568 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:42:36.608568 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:42:36.609417 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:42:36.609417 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:42:36.609417 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:42:36.609417 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:42:36.609417 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:42:36.609417 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:42:36.609417 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:42:36.609417 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:42:36.609417 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:42:36.609417 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:42:36.609417 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 15:42:36.609417 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:42:36.609417 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 157/329] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:42:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:42:36.614980 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c6fd3-57ef-4c51-b1d8-f73e14096f75 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:36.617387 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e09e0bf-281b-40a8-9290-0de7817e12a4 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:36.659230 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd906b54-56c4-44d8-a066-4b59a9e05843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:36.660009 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd906b54-56c4-44d8-a066-4b59a9e05843 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:36.660166 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd906b54-56c4-44d8-a066-4b59a9e05843 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:36.660438 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd906b54-56c4-44d8-a066-4b59a9e05843 None admin] PATH_INFO: `/v3/users/878935acfa87481eb1b80b26fda9de90` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:36.661588 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd906b54-56c4-44d8-a066-4b59a9e05843 None admin] RBAC: Authorizing `identity:get_user(user_id=878935acfa87481eb1b80b26fda9de90)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:36.663064 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd906b54-56c4-44d8-a066-4b59a9e05843 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:36.664646 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 173/330] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 7 15:42:36 2022] GET /identity/v3/users/878935acfa87481eb1b80b26fda9de90 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:36.671168 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd906b54-56c4-44d8-a066-4b59a9e05843 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:36.728614 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c6fd3-57ef-4c51-b1d8-f73e14096f75 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:36.738472 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:36.777054 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca7272-e052-4d12-8766-da94042ce756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:36.777655 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca7272-e052-4d12-8766-da94042ce756 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:36.777938 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca7272-e052-4d12-8766-da94042ce756 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:36.778900 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca7272-e052-4d12-8766-da94042ce756 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:36.779679 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca7272-e052-4d12-8766-da94042ce756 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:36.779985 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca7272-e052-4d12-8766-da94042ce756 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:36.781863 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca7272-e052-4d12-8766-da94042ce756 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:36.791042 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 158/331] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 7 15:42:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:42:36.795872 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd906b54-56c4-44d8-a066-4b59a9e05843 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:36.796869 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca7272-e052-4d12-8766-da94042ce756 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:36.836904 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:36.838054 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f92cc78-7d2a-4b5d-9010-3359db1b3043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:36.839599 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92cc78-7d2a-4b5d-9010-3359db1b3043 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:36.839889 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92cc78-7d2a-4b5d-9010-3359db1b3043 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:36.840166 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92cc78-7d2a-4b5d-9010-3359db1b3043 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:36.841440 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f92cc78-7d2a-4b5d-9010-3359db1b3043 None admin] RBAC: Adding query filter params (role.id=d45e39b4ad4e4ce782ec649246438663, user.id=878935acfa87481eb1b80b26fda9de90, scope.system=all) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:36.841915 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f92cc78-7d2a-4b5d-9010-3359db1b3043 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:36.844237 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f92cc78-7d2a-4b5d-9010-3359db1b3043 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:36.860958 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 174/332] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Sep 7 15:42:36 2022] GET /identity/v3/role_assignments?user.id=878935acfa87481eb1b80b26fda9de90&scope.system=all&role.id=d45e39b4ad4e4ce782ec649246438663 => generated 510 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:42:36.929481 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca7272-e052-4d12-8766-da94042ce756 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:36.970873 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e26e538-3a8d-43c4-b691-ab9df17fa429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:36.971915 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26e538-3a8d-43c4-b691-ab9df17fa429 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:36.972399 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26e538-3a8d-43c4-b691-ab9df17fa429 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:36.972872 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26e538-3a8d-43c4-b691-ab9df17fa429 None admin] PATH_INFO: `/v3/users/06eb70a1c1214cb5ae5fe7775ed8eeb1` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:36.974438 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e26e538-3a8d-43c4-b691-ab9df17fa429 None admin] RBAC: Authorizing `identity:get_user(user_id=06eb70a1c1214cb5ae5fe7775ed8eeb1)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:36.976141 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e26e538-3a8d-43c4-b691-ab9df17fa429 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:36.978351 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 159/333] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 7 15:42:36 2022] GET /identity/v3/users/06eb70a1c1214cb5ae5fe7775ed8eeb1 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:42:36.984808 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f92cc78-7d2a-4b5d-9010-3359db1b3043 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:37.105488 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f92cc78-7d2a-4b5d-9010-3359db1b3043 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:37.141575 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:37.143370 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ddfce-6668-4030-a5ca-ff85f6359a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:37.144298 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ddfce-6668-4030-a5ca-ff85f6359a0f None admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:37.144802 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ddfce-6668-4030-a5ca-ff85f6359a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:37.145401 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ddfce-6668-4030-a5ca-ff85f6359a0f None admin] PATH_INFO: `/v3/system/users/06eb70a1c1214cb5ae5fe7775ed8eeb1/roles/903d756c82454add946529986655408d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:37.147369 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ddfce-6668-4030-a5ca-ff85f6359a0f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=06eb70a1c1214cb5ae5fe7775ed8eeb1, role_id=903d756c82454add946529986655408d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:37.149019 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ddfce-6668-4030-a5ca-ff85f6359a0f None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:37.166292 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 175/334] 10.222.0.16 () {58 vars in 1334 bytes} [Wed Sep 7 15:42:36 2022] PUT /identity/v3/system/users/06eb70a1c1214cb5ae5fe7775ed8eeb1/roles/903d756c82454add946529986655408d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:42:39.142842 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a89ac1-d953-4cda-99c4-53433e35e3d4 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:39.143334 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a89ac1-d953-4cda-99c4-53433e35e3d4 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:39.143429 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a89ac1-d953-4cda-99c4-53433e35e3d4 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:39.144968 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 160/335] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:42:39.155907 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d276c7-0713-4e65-b00d-44f9182e8239 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:39.156392 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d276c7-0713-4e65-b00d-44f9182e8239 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:39.156470 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d276c7-0713-4e65-b00d-44f9182e8239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:39.185800 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-67d276c7-0713-4e65-b00d-44f9182e8239 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:39.187068 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-67d276c7-0713-4e65-b00d-44f9182e8239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:39.284052 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 176/336] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:42:39.789690 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4edba3f-030f-4d55-a6a6-0a7e66162cd6 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:39.790070 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4edba3f-030f-4d55-a6a6-0a7e66162cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:39.790339 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4edba3f-030f-4d55-a6a6-0a7e66162cd6 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:39.791908 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 161/337] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:42:39.804194 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209723e-1b61-4141-b462-439bf6b18eb0 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:39.804499 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209723e-1b61-4141-b462-439bf6b18eb0 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:39.804754 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209723e-1b61-4141-b462-439bf6b18eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:39.814634 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4edba3f-030f-4d55-a6a6-0a7e66162cd6 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:39.829145 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-3209723e-1b61-4141-b462-439bf6b18eb0 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:39.830391 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-3209723e-1b61-4141-b462-439bf6b18eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:39.939663 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 177/338] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:42:39.960721 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadce01-acef-47d2-b013-89d0bb9f812d None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:39.961038 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadce01-acef-47d2-b013-89d0bb9f812d None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:39.961278 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadce01-acef-47d2-b013-89d0bb9f812d None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:39.962664 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 178/339] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:42:39.971820 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc71d9c-5650-44b6-aa5a-68ba633ba494 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:39.972424 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc71d9c-5650-44b6-aa5a-68ba633ba494 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:39.972898 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc71d9c-5650-44b6-aa5a-68ba633ba494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:39.997273 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-1dc71d9c-5650-44b6-aa5a-68ba633ba494 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:39.999418 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-1dc71d9c-5650-44b6-aa5a-68ba633ba494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:40.014454 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:40.021287 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4edba3f-030f-4d55-a6a6-0a7e66162cd6 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:40.064536 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:40.100452 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4050f4-c9f4-4e35-bc29-91369a08fb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:40.101102 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4050f4-c9f4-4e35-bc29-91369a08fb0c None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:40.101383 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4050f4-c9f4-4e35-bc29-91369a08fb0c None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:40.101658 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4050f4-c9f4-4e35-bc29-91369a08fb0c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:40.131276 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4050f4-c9f4-4e35-bc29-91369a08fb0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:42:40.136229 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-8e4050f4-c9f4-4e35-bc29-91369a08fb0c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:42:40.136229 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:40.136229 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:42:40.136229 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:42:40.136229 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:42:40.136229 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:42:40.136229 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:42:40.136229 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:42:40.136229 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:42:40.136229 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:42:40.136229 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:42:40.136229 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:42:40.136229 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:42:40.136229 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:42:40.136229 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:42:40.136229 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:42:40.137108 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:42:40.137108 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:42:40.137108 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:42:40.137108 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:42:40.137108 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:42:40.137108 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:42:40.137108 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:42:40.137108 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:42:40.137108 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:42:40.137108 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:42:40.137108 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:42:40.137108 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:42:40.137108 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:42:40.137108 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:42:40.137108 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:42:40.137108 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:42:40.138485 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:42:40.138485 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:42:40.138485 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:42:40.138485 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:42:40.138485 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:42:40.138485 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:42:40.138485 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:42:40.138485 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:42:40.138485 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:42:40.138485 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:42:40.138485 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:42:40.138485 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:42:40.138485 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 162/340] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:42:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:42:40.148764 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4050f4-c9f4-4e35-bc29-91369a08fb0c None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:40.153937 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 179/341] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:42:40.298957 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4050f4-c9f4-4e35-bc29-91369a08fb0c None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:40.341036 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d95ff51-bed7-4b72-b7b4-6bc20a227c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:40.341647 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95ff51-bed7-4b72-b7b4-6bc20a227c93 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:40.341929 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95ff51-bed7-4b72-b7b4-6bc20a227c93 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:40.342240 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95ff51-bed7-4b72-b7b4-6bc20a227c93 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:40.342907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d95ff51-bed7-4b72-b7b4-6bc20a227c93 None admin] RBAC: Adding query filter params (name=member) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:40.343213 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d95ff51-bed7-4b72-b7b4-6bc20a227c93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:40.344620 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d95ff51-bed7-4b72-b7b4-6bc20a227c93 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:40.355220 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 163/342] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 7 15:42:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:40.360139 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc71d9c-5650-44b6-aa5a-68ba633ba494 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:40.373653 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d95ff51-bed7-4b72-b7b4-6bc20a227c93 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:40.436525 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:40.540227 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d95ff51-bed7-4b72-b7b4-6bc20a227c93 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:40.583895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc71d9c-5650-44b6-aa5a-68ba633ba494 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:40.600410 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396b4e6-88c2-4436-af68-b63b64fea5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:40.601026 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396b4e6-88c2-4436-af68-b63b64fea5bd None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:40.601342 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396b4e6-88c2-4436-af68-b63b64fea5bd None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:40.601685 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396b4e6-88c2-4436-af68-b63b64fea5bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:40.622803 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff13da6-5bae-4705-8656-79dbcfe0153a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:40.623453 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff13da6-5bae-4705-8656-79dbcfe0153a None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:40.623730 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff13da6-5bae-4705-8656-79dbcfe0153a None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:40.624000 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff13da6-5bae-4705-8656-79dbcfe0153a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:40.640370 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff13da6-5bae-4705-8656-79dbcfe0153a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:42:40.645435 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-3ff13da6-5bae-4705-8656-79dbcfe0153a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 15:42:40.645435 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:40.645435 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:42:40.645435 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:42:40.645435 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:42:40.645435 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:42:40.645435 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:42:40.645435 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:42:40.645435 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:42:40.645435 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:42:40.645435 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:42:40.645435 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:42:40.645435 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:42:40.645435 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:42:40.645435 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:42:40.645435 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:42:40.646356 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:42:40.646356 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:42:40.646356 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:42:40.646356 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:42:40.646356 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:42:40.646356 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:42:40.646356 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:42:40.646356 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:42:40.646356 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:42:40.646356 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:42:40.646356 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:42:40.646356 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:42:40.646356 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:42:40.646356 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:42:40.646356 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:42:40.646356 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:42:40.647774 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:42:40.647774 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:42:40.647774 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:42:40.647774 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:42:40.647774 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:42:40.647774 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:42:40.647774 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:42:40.647774 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:42:40.647774 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:42:40.647774 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:42:40.647774 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 15:42:40.647774 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:42:40.647774 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 180/343] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 7 15:42:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:42:40.648614 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64a8ef-3ae4-4bf0-bb0c-c96c8b384c79 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:40.648772 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64a8ef-3ae4-4bf0-bb0c-c96c8b384c79 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:40.649046 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64a8ef-3ae4-4bf0-bb0c-c96c8b384c79 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:40.652037 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 181/344] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:42:40.652633 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e9dc2-b2de-4cbf-968b-4244b313e2f6 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:40.652914 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e9dc2-b2de-4cbf-968b-4244b313e2f6 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:40.653810 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e9dc2-b2de-4cbf-968b-4244b313e2f6 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:40.655194 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 182/345] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:42:40.655895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e9dc2-b2de-4cbf-968b-4244b313e2f6 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:40.694049 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:40.708784 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396b4e6-88c2-4436-af68-b63b64fea5bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:40.711519 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396b4e6-88c2-4436-af68-b63b64fea5bd None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:40.737709 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:40.780962 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e9dc2-b2de-4cbf-968b-4244b313e2f6 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:40.824347 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a8981-1d31-4ef6-81e7-fc0758446c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:40.825546 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a8981-1d31-4ef6-81e7-fc0758446c19 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:40.825820 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a8981-1d31-4ef6-81e7-fc0758446c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:40.826090 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a8981-1d31-4ef6-81e7-fc0758446c19 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:40.826804 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1a8981-1d31-4ef6-81e7-fc0758446c19 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:40.827105 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1a8981-1d31-4ef6-81e7-fc0758446c19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:40.828503 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1a8981-1d31-4ef6-81e7-fc0758446c19 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:40.837432 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 183/346] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:42:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:40.838530 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1aed04-f991-422c-82b7-bee455c0bf28 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:40.838817 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1aed04-f991-422c-82b7-bee455c0bf28 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:40.839093 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1aed04-f991-422c-82b7-bee455c0bf28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:40.852031 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 164/347] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:42:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:42:40.853286 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34f91c-f4ac-48d2-b074-0425ba46281b None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:40.853577 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34f91c-f4ac-48d2-b074-0425ba46281b None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:40.853857 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34f91c-f4ac-48d2-b074-0425ba46281b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:40.862932 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-4e1aed04-f991-422c-82b7-bee455c0bf28 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:40.864212 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-4e1aed04-f991-422c-82b7-bee455c0bf28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:40.874380 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-8d34f91c-f4ac-48d2-b074-0425ba46281b None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:40.875656 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-8d34f91c-f4ac-48d2-b074-0425ba46281b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:40.949166 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 184/348] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:42:40.951101 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1aed04-f991-422c-82b7-bee455c0bf28 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:40.976776 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 165/349] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:42:40.977470 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34f91c-f4ac-48d2-b074-0425ba46281b None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:40.981425 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:41.058922 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:41.071175 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1aed04-f991-422c-82b7-bee455c0bf28 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:41.115773 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ebac0-e2b1-4ca8-929d-aad3eb22abf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:41.117043 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ebac0-e2b1-4ca8-929d-aad3eb22abf1 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:41.117467 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ebac0-e2b1-4ca8-929d-aad3eb22abf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:41.117872 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ebac0-e2b1-4ca8-929d-aad3eb22abf1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:41.129986 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499ebac0-e2b1-4ca8-929d-aad3eb22abf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:42:41.136107 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-499ebac0-e2b1-4ca8-929d-aad3eb22abf1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:42:41.136107 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:41.136107 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:42:41.136107 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:42:41.136107 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:42:41.136107 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:42:41.136107 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:42:41.136107 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:42:41.136107 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:42:41.136107 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:42:41.136107 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:42:41.136107 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:42:41.136107 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:42:41.136107 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:42:41.136107 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:42:41.136107 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:42:41.137277 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:42:41.137277 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:42:41.137277 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:42:41.137277 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:42:41.137277 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:42:41.137277 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:42:41.137277 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:42:41.137277 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:42:41.137277 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:42:41.137277 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:42:41.137277 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:42:41.137277 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:42:41.137277 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:42:41.137277 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:42:41.137277 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:42:41.137277 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:42:41.138859 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:42:41.138859 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:42:41.138859 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:42:41.138859 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:42:41.138859 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:42:41.138859 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:42:41.138859 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:42:41.138859 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:42:41.138859 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:42:41.138859 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:42:41.138859 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:42:41.138859 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:42:41.141224 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 185/350] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:42:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:42:41.142264 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ebac0-e2b1-4ca8-929d-aad3eb22abf1 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:41.220318 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34f91c-f4ac-48d2-b074-0425ba46281b None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:41.238667 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:41.257979 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ebac0-e2b1-4ca8-929d-aad3eb22abf1 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:41.294572 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a6dee-df6c-439f-806b-dc85479f876d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:41.295303 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a6dee-df6c-439f-806b-dc85479f876d None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:41.295691 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a6dee-df6c-439f-806b-dc85479f876d None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:41.295974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a6dee-df6c-439f-806b-dc85479f876d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:41.297130 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2020a5-f86d-4819-9bfb-f9330d34ed2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:41.297942 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2020a5-f86d-4819-9bfb-f9330d34ed2b None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:41.298383 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2020a5-f86d-4819-9bfb-f9330d34ed2b None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:41.298790 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2020a5-f86d-4819-9bfb-f9330d34ed2b None admin] PATH_INFO: `/v3/projects/6e5edf54975843879025d05c7e7a65d7` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:41.300059 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2020a5-f86d-4819-9bfb-f9330d34ed2b None admin] RBAC: Authorizing `identity:get_project(project_id=6e5edf54975843879025d05c7e7a65d7)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:41.301634 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2020a5-f86d-4819-9bfb-f9330d34ed2b None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:41.303788 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 186/351] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 7 15:42:41 2022] GET /identity/v3/projects/6e5edf54975843879025d05c7e7a65d7 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:41.304861 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2020a5-f86d-4819-9bfb-f9330d34ed2b None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:41.383055 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57a6dee-df6c-439f-806b-dc85479f876d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:41.384912 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57a6dee-df6c-439f-806b-dc85479f876d None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:41.439369 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:41.456166 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2020a5-f86d-4819-9bfb-f9330d34ed2b None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:41.504833 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1c5c7-9be5-47f6-bf7c-3d75122f999c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:41.505881 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1c5c7-9be5-47f6-bf7c-3d75122f999c None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:41.506133 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 166/352] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:42:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:42:41.506600 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1c5c7-9be5-47f6-bf7c-3d75122f999c None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:41.507027 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a6dee-df6c-439f-806b-dc85479f876d None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:41.507156 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1c5c7-9be5-47f6-bf7c-3d75122f999c None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:41.507772 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a1c5c7-9be5-47f6-bf7c-3d75122f999c None admin] RBAC: Adding query filter params (name=member) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:41.508084 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a1c5c7-9be5-47f6-bf7c-3d75122f999c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:41.509464 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a1c5c7-9be5-47f6-bf7c-3d75122f999c None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:41.526293 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 187/353] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 7 15:42:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:41.527677 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1c5c7-9be5-47f6-bf7c-3d75122f999c None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:41.545749 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:41.644452 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a6dee-df6c-439f-806b-dc85479f876d None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:41.684630 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1c5c7-9be5-47f6-bf7c-3d75122f999c None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:41.688482 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771a97d-d544-48c9-aab8-96f04ac0778e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:41.689357 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771a97d-d544-48c9-aab8-96f04ac0778e None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:41.689637 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771a97d-d544-48c9-aab8-96f04ac0778e None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:41.689918 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771a97d-d544-48c9-aab8-96f04ac0778e None admin] PATH_INFO: `/v3/groups/d1727dcecb2a4cd792462a4ac6da11b8` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:41.696753 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7771a97d-d544-48c9-aab8-96f04ac0778e None admin] RBAC: Authorizing `identity:get_group(group_id=d1727dcecb2a4cd792462a4ac6da11b8)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:41.698211 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7771a97d-d544-48c9-aab8-96f04ac0778e None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:41.700382 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 167/354] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Sep 7 15:42:41 2022] GET /identity/v3/groups/d1727dcecb2a4cd792462a4ac6da11b8 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:41.701162 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771a97d-d544-48c9-aab8-96f04ac0778e None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:41.720494 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:41.735344 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c822e-3928-4e62-9c3c-7e869198d861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:41.736865 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c822e-3928-4e62-9c3c-7e869198d861 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:41.737165 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c822e-3928-4e62-9c3c-7e869198d861 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:41.737439 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c822e-3928-4e62-9c3c-7e869198d861 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:41.750153 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c822e-3928-4e62-9c3c-7e869198d861 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:42:41.756262 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-d57c822e-3928-4e62-9c3c-7e869198d861 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 15:42:41.756262 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:41.756262 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:42:41.756262 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:42:41.756262 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:42:41.756262 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:42:41.756262 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:42:41.756262 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:42:41.756262 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:42:41.756262 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:42:41.756262 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:42:41.756262 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:42:41.756262 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:42:41.756262 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:42:41.756262 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:42:41.756262 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:42:41.757142 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:42:41.757142 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:42:41.757142 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:42:41.757142 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:42:41.757142 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:42:41.757142 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:42:41.757142 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:42:41.757142 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:42:41.757142 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:42:41.757142 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:42:41.757142 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:42:41.757142 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:42:41.757142 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:42:41.757142 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:42:41.757142 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:42:41.757142 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:42:41.758435 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:42:41.758435 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:42:41.758435 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:42:41.758435 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:42:41.758435 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:42:41.758435 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:42:41.758435 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:42:41.758435 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:42:41.758435 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:42:41.758435 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:42:41.758435 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 15:42:41.758435 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:42:41.758435 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 188/355] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 7 15:42:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:42:41.758435 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c822e-3928-4e62-9c3c-7e869198d861 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:41.827180 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771a97d-d544-48c9-aab8-96f04ac0778e None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:41.851222 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:41.871590 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e093da-7f95-409b-905c-b0b3c419c388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:41.872777 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e093da-7f95-409b-905c-b0b3c419c388 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:41.873086 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e093da-7f95-409b-905c-b0b3c419c388 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:41.873477 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e093da-7f95-409b-905c-b0b3c419c388 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:41.882608 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c822e-3928-4e62-9c3c-7e869198d861 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:41.886101 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e093da-7f95-409b-905c-b0b3c419c388 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:42:41.893892 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-33e093da-7f95-409b-905c-b0b3c419c388 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 15:42:41.893892 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:41.893892 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:42:41.893892 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:42:41.893892 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:42:41.893892 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:42:41.893892 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:42:41.893892 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:42:41.893892 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:42:41.893892 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:42:41.893892 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:42:41.893892 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:42:41.893892 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:42:41.893892 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:42:41.893892 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:42:41.893892 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:42:41.894887 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:42:41.894887 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:42:41.894887 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:42:41.894887 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:42:41.894887 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:42:41.894887 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:42:41.894887 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:42:41.894887 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:42:41.894887 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:42:41.894887 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:42:41.894887 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:42:41.894887 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:42:41.894887 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:42:41.894887 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:42:41.894887 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:42:41.894887 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:42:41.895714 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:42:41.895714 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:42:41.895714 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:42:41.895714 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:42:41.895714 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:42:41.895714 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:42:41.895714 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:42:41.895714 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:42:41.895714 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:42:41.895714 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:42:41.895714 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 15:42:41.895714 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:42:41.899607 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 168/356] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:42:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:42:41.900483 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e093da-7f95-409b-905c-b0b3c419c388 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:41.924155 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eb46c7-bd2d-4cfa-b2ec-17d33867735f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:41.924803 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb46c7-bd2d-4cfa-b2ec-17d33867735f None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:41.925561 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb46c7-bd2d-4cfa-b2ec-17d33867735f None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:41.925772 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb46c7-bd2d-4cfa-b2ec-17d33867735f None admin] PATH_INFO: `/v3/projects/6e5edf54975843879025d05c7e7a65d7` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:41.927120 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eb46c7-bd2d-4cfa-b2ec-17d33867735f None admin] RBAC: Authorizing `identity:get_project(project_id=6e5edf54975843879025d05c7e7a65d7)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:41.928780 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eb46c7-bd2d-4cfa-b2ec-17d33867735f None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:41.930485 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 189/357] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 7 15:42:41 2022] GET /identity/v3/projects/6e5edf54975843879025d05c7e7a65d7 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:41.931615 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01863f66-7b5e-4de5-8c37-8045878e7cd3 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:41.931901 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01863f66-7b5e-4de5-8c37-8045878e7cd3 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:41.932176 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01863f66-7b5e-4de5-8c37-8045878e7cd3 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:41.933354 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 190/358] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:42:41.934039 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01863f66-7b5e-4de5-8c37-8045878e7cd3 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:41.992824 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:42.024397 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e093da-7f95-409b-905c-b0b3c419c388 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:42.064227 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01863f66-7b5e-4de5-8c37-8045878e7cd3 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:42.069366 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f491d373-6ac9-4227-8f6a-4b9d86394f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:42.070200 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491d373-6ac9-4227-8f6a-4b9d86394f7d None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:42.070503 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491d373-6ac9-4227-8f6a-4b9d86394f7d None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:42.070780 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491d373-6ac9-4227-8f6a-4b9d86394f7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:42.115149 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029152ef-fb77-42a4-b471-ac604372a109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:42.115879 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029152ef-fb77-42a4-b471-ac604372a109 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:42.116153 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029152ef-fb77-42a4-b471-ac604372a109 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:42.116427 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029152ef-fb77-42a4-b471-ac604372a109 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:42.117147 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029152ef-fb77-42a4-b471-ac604372a109 None admin] RBAC: Adding query filter params (group.id=d1727dcecb2a4cd792462a4ac6da11b8, role.id=d45e39b4ad4e4ce782ec649246438663, scope.project.id=6e5edf54975843879025d05c7e7a65d7) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:42.117453 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029152ef-fb77-42a4-b471-ac604372a109 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:42.118992 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029152ef-fb77-42a4-b471-ac604372a109 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:42.126399 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 191/359] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Sep 7 15:42:41 2022] GET /identity/v3/role_assignments?group.id=d1727dcecb2a4cd792462a4ac6da11b8&scope.project.id=6e5edf54975843879025d05c7e7a65d7&role.id=d45e39b4ad4e4ce782ec649246438663 => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:42.127481 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029152ef-fb77-42a4-b471-ac604372a109 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:42.136788 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:42.151621 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f491d373-6ac9-4227-8f6a-4b9d86394f7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:42.154282 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f491d373-6ac9-4227-8f6a-4b9d86394f7d None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:42.258346 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:42.268966 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029152ef-fb77-42a4-b471-ac604372a109 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:42.300035 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 169/360] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:42:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:42:42.300940 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f491d373-6ac9-4227-8f6a-4b9d86394f7d None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:42.315561 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183bff1a-5a48-46f6-802b-f0b55ed788ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:42.316560 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183bff1a-5a48-46f6-802b-f0b55ed788ba None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:42.317036 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183bff1a-5a48-46f6-802b-f0b55ed788ba None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:42.317822 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183bff1a-5a48-46f6-802b-f0b55ed788ba None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:42.318749 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183bff1a-5a48-46f6-802b-f0b55ed788ba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:42.319483 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183bff1a-5a48-46f6-802b-f0b55ed788ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:42.321175 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183bff1a-5a48-46f6-802b-f0b55ed788ba None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:42.333549 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 192/361] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:42:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:42.334847 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183bff1a-5a48-46f6-802b-f0b55ed788ba None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:42.419523 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:42.439839 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f491d373-6ac9-4227-8f6a-4b9d86394f7d None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:42.462110 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183bff1a-5a48-46f6-802b-f0b55ed788ba None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:42.485841 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b207e93-ca25-4018-b95b-d6da0879ce5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:42.486919 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b207e93-ca25-4018-b95b-d6da0879ce5d None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:42.486919 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b207e93-ca25-4018-b95b-d6da0879ce5d None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:42.487146 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b207e93-ca25-4018-b95b-d6da0879ce5d None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:42.487773 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b207e93-ca25-4018-b95b-d6da0879ce5d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:42.488077 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b207e93-ca25-4018-b95b-d6da0879ce5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:42.489446 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b207e93-ca25-4018-b95b-d6da0879ce5d None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:42.503296 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 170/362] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 7 15:42:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:42.504660 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b389a-a699-4aff-97d4-804560c5a1e1 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:42.504948 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b389a-a699-4aff-97d4-804560c5a1e1 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:42.505222 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b389a-a699-4aff-97d4-804560c5a1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:42.508093 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e6a9b9-61eb-4ece-916a-2a185beb353d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:42.508489 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6a9b9-61eb-4ece-916a-2a185beb353d None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:42.508840 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6a9b9-61eb-4ece-916a-2a185beb353d None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:42.509036 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6a9b9-61eb-4ece-916a-2a185beb353d None admin] PATH_INFO: `/v3/groups/d1727dcecb2a4cd792462a4ac6da11b8` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:42.510966 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e6a9b9-61eb-4ece-916a-2a185beb353d None admin] RBAC: Authorizing `identity:get_group(group_id=d1727dcecb2a4cd792462a4ac6da11b8)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:42.513751 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e6a9b9-61eb-4ece-916a-2a185beb353d None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:42.516353 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 193/363] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Sep 7 15:42:42 2022] GET /identity/v3/groups/d1727dcecb2a4cd792462a4ac6da11b8 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:42.516353 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e6a9b9-61eb-4ece-916a-2a185beb353d None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:42.527991 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-7f5b389a-a699-4aff-97d4-804560c5a1e1 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:42.527991 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-7f5b389a-a699-4aff-97d4-804560c5a1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:42.568823 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:42.627582 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 171/364] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:42:42.628663 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b389a-a699-4aff-97d4-804560c5a1e1 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:42.658452 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e6a9b9-61eb-4ece-916a-2a185beb353d None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:42.709243 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91e279-ccd1-4056-918e-226fb4d89e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:42.710315 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91e279-ccd1-4056-918e-226fb4d89e77 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:42.710604 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91e279-ccd1-4056-918e-226fb4d89e77 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:42.711160 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91e279-ccd1-4056-918e-226fb4d89e77 None admin] PATH_INFO: `/v3/projects/d428d47056754be5930f84ee53d099af` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:42.712547 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf91e279-ccd1-4056-918e-226fb4d89e77 None admin] RBAC: Authorizing `identity:get_project(project_id=d428d47056754be5930f84ee53d099af)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:42.714726 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf91e279-ccd1-4056-918e-226fb4d89e77 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:42.717349 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 194/365] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 7 15:42:42 2022] GET /identity/v3/projects/d428d47056754be5930f84ee53d099af => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:42.718475 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91e279-ccd1-4056-918e-226fb4d89e77 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:42.723957 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:42.768236 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b389a-a699-4aff-97d4-804560c5a1e1 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:42.814563 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a170b-7cb0-4c54-8c13-a34f6b0094f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:42.815186 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a170b-7cb0-4c54-8c13-a34f6b0094f6 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:42.816641 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a170b-7cb0-4c54-8c13-a34f6b0094f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:42.816915 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a170b-7cb0-4c54-8c13-a34f6b0094f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:42.839545 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91e279-ccd1-4056-918e-226fb4d89e77 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:42.856569 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:42.888496 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e12924-0c79-4703-bb47-09c8809280bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:42.889574 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e12924-0c79-4703-bb47-09c8809280bb None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:42.890969 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e12924-0c79-4703-bb47-09c8809280bb None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:42.891267 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e12924-0c79-4703-bb47-09c8809280bb None admin] PATH_INFO: `/v3/users/06eb70a1c1214cb5ae5fe7775ed8eeb1` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:42.892623 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e12924-0c79-4703-bb47-09c8809280bb None admin] RBAC: Authorizing `identity:get_user(user_id=06eb70a1c1214cb5ae5fe7775ed8eeb1)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:42.894093 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e12924-0c79-4703-bb47-09c8809280bb None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:42.895941 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 195/366] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 7 15:42:42 2022] GET /identity/v3/users/06eb70a1c1214cb5ae5fe7775ed8eeb1 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:42.896628 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e12924-0c79-4703-bb47-09c8809280bb None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:42.899624 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a170b-7cb0-4c54-8c13-a34f6b0094f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:42.901092 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a170b-7cb0-4c54-8c13-a34f6b0094f6 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:42.980334 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:43.022279 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e12924-0c79-4703-bb47-09c8809280bb None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:43.027632 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 172/367] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:42:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:42:43.028636 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a170b-7cb0-4c54-8c13-a34f6b0094f6 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:43.070498 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f48517-fa62-4a4e-9c8f-dc04db44667d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:43.071115 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f48517-fa62-4a4e-9c8f-dc04db44667d None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:43.071396 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f48517-fa62-4a4e-9c8f-dc04db44667d None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:43.071669 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f48517-fa62-4a4e-9c8f-dc04db44667d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:43.072455 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f48517-fa62-4a4e-9c8f-dc04db44667d None admin] RBAC: Adding query filter params (group.id=d1727dcecb2a4cd792462a4ac6da11b8, role.id=ce978876ff724bf3b4101c9fd4d2d842, scope.project.id=6e5edf54975843879025d05c7e7a65d7) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:43.072766 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f48517-fa62-4a4e-9c8f-dc04db44667d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:43.074283 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f48517-fa62-4a4e-9c8f-dc04db44667d None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:43.082265 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 196/368] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Sep 7 15:42:42 2022] GET /identity/v3/role_assignments?group.id=d1727dcecb2a4cd792462a4ac6da11b8&scope.project.id=6e5edf54975843879025d05c7e7a65d7&role.id=ce978876ff724bf3b4101c9fd4d2d842 => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:43.083407 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f48517-fa62-4a4e-9c8f-dc04db44667d None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:43.121188 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:43.167694 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a170b-7cb0-4c54-8c13-a34f6b0094f6 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:43.219387 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1082bc0-b6d7-497c-b4b7-51b4d259ec89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:43.220473 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1082bc0-b6d7-497c-b4b7-51b4d259ec89 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:43.221026 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1082bc0-b6d7-497c-b4b7-51b4d259ec89 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:43.221445 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1082bc0-b6d7-497c-b4b7-51b4d259ec89 None admin] PATH_INFO: `/v3/groups/d1727dcecb2a4cd792462a4ac6da11b8` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:43.223068 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1082bc0-b6d7-497c-b4b7-51b4d259ec89 None admin] RBAC: Authorizing `identity:get_group(group_id=d1727dcecb2a4cd792462a4ac6da11b8)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:43.224671 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1082bc0-b6d7-497c-b4b7-51b4d259ec89 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:43.225780 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f48517-fa62-4a4e-9c8f-dc04db44667d None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:43.227005 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 173/369] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Sep 7 15:42:43 2022] GET /identity/v3/groups/d1727dcecb2a4cd792462a4ac6da11b8 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:43.228059 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1082bc0-b6d7-497c-b4b7-51b4d259ec89 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:43.266020 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491b1a2-1f35-4cef-ac5a-ad5178816287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:43.266728 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491b1a2-1f35-4cef-ac5a-ad5178816287 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:43.267223 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491b1a2-1f35-4cef-ac5a-ad5178816287 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:43.267688 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491b1a2-1f35-4cef-ac5a-ad5178816287 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:43.268609 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d491b1a2-1f35-4cef-ac5a-ad5178816287 None admin] RBAC: Adding query filter params (role.id=903d756c82454add946529986655408d, user.id=06eb70a1c1214cb5ae5fe7775ed8eeb1, scope.system=all) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:43.269289 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d491b1a2-1f35-4cef-ac5a-ad5178816287 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:43.271202 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d491b1a2-1f35-4cef-ac5a-ad5178816287 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:43.274371 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:43.287397 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 197/370] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Sep 7 15:42:43 2022] GET /identity/v3/role_assignments?user.id=06eb70a1c1214cb5ae5fe7775ed8eeb1&scope.system=all&role.id=903d756c82454add946529986655408d => generated 510 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:43.288850 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491b1a2-1f35-4cef-ac5a-ad5178816287 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:43.349883 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1082bc0-b6d7-497c-b4b7-51b4d259ec89 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:43.392504 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5189fe-1294-4682-b8d0-cb1029758074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:43.393159 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5189fe-1294-4682-b8d0-cb1029758074 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:43.393549 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5189fe-1294-4682-b8d0-cb1029758074 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:43.393834 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5189fe-1294-4682-b8d0-cb1029758074 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:43.402540 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:43.414296 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491b1a2-1f35-4cef-ac5a-ad5178816287 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:43.419368 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5189fe-1294-4682-b8d0-cb1029758074 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:42:43.425569 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-8e5189fe-1294-4682-b8d0-cb1029758074 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:42:43.425569 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:43.425569 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:42:43.425569 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:42:43.425569 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:42:43.425569 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:42:43.425569 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:42:43.425569 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:42:43.425569 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:42:43.425569 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:42:43.425569 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:42:43.425569 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:42:43.425569 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:42:43.425569 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:42:43.425569 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:42:43.425569 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:42:43.429760 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:42:43.429760 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:42:43.429760 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:42:43.429760 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:42:43.429760 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:42:43.429760 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:42:43.429760 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:42:43.429760 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:42:43.429760 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:42:43.429760 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:42:43.429760 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:42:43.429760 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:42:43.429760 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:42:43.429760 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:42:43.429760 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:42:43.429760 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:42:43.430691 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:42:43.430691 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:42:43.430691 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:42:43.430691 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:42:43.430691 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:42:43.430691 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:42:43.430691 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:42:43.430691 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:42:43.430691 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:42:43.430691 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:42:43.430691 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:42:43.430691 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:42:43.432928 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 174/371] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 7 15:42:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:42:43.434013 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5189fe-1294-4682-b8d0-cb1029758074 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:43.486164 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8576d84-ad57-48ea-8382-cd7a311981f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:43.486701 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8576d84-ad57-48ea-8382-cd7a311981f2 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:43.486701 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8576d84-ad57-48ea-8382-cd7a311981f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:43.486931 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8576d84-ad57-48ea-8382-cd7a311981f2 None admin] PATH_INFO: `/v3/projects/d428d47056754be5930f84ee53d099af` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:43.488649 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8576d84-ad57-48ea-8382-cd7a311981f2 None admin] RBAC: Authorizing `identity:get_project(project_id=d428d47056754be5930f84ee53d099af)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:43.490096 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8576d84-ad57-48ea-8382-cd7a311981f2 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:43.493604 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 198/372] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 7 15:42:43 2022] GET /identity/v3/projects/d428d47056754be5930f84ee53d099af => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:43.493604 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8576d84-ad57-48ea-8382-cd7a311981f2 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:43.578260 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:43.586236 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5189fe-1294-4682-b8d0-cb1029758074 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:43.624742 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e5f8c-efa8-48cd-b345-d84dd35b073c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:43.625362 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e5f8c-efa8-48cd-b345-d84dd35b073c None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:43.625656 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e5f8c-efa8-48cd-b345-d84dd35b073c None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:43.625917 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e5f8c-efa8-48cd-b345-d84dd35b073c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:43.626678 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458e5f8c-efa8-48cd-b345-d84dd35b073c None admin] RBAC: Adding query filter params (group.id=d1727dcecb2a4cd792462a4ac6da11b8, role.id=d45e39b4ad4e4ce782ec649246438663, scope.project.id=d428d47056754be5930f84ee53d099af) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:43.626986 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458e5f8c-efa8-48cd-b345-d84dd35b073c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:43.628415 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458e5f8c-efa8-48cd-b345-d84dd35b073c None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:43.631697 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8576d84-ad57-48ea-8382-cd7a311981f2 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:43.634516 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 175/373] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Sep 7 15:42:43 2022] GET /identity/v3/role_assignments?group.id=d1727dcecb2a4cd792462a4ac6da11b8&scope.project.id=d428d47056754be5930f84ee53d099af&role.id=d45e39b4ad4e4ce782ec649246438663 => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:43.635397 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e5f8c-efa8-48cd-b345-d84dd35b073c None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:43.672311 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1566df1b-1bcd-41c0-aa10-8eb23d3fb64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:43.673310 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1566df1b-1bcd-41c0-aa10-8eb23d3fb64c None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:43.673810 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1566df1b-1bcd-41c0-aa10-8eb23d3fb64c None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:43.674904 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1566df1b-1bcd-41c0-aa10-8eb23d3fb64c None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:43.675853 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1566df1b-1bcd-41c0-aa10-8eb23d3fb64c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:43.676412 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1566df1b-1bcd-41c0-aa10-8eb23d3fb64c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:43.678048 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1566df1b-1bcd-41c0-aa10-8eb23d3fb64c None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:43.688468 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 199/374] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:42:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:43.693827 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1566df1b-1bcd-41c0-aa10-8eb23d3fb64c None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:43.702302 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:43.749471 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e5f8c-efa8-48cd-b345-d84dd35b073c None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:43.789582 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757d153-efc5-4a1d-a5e1-c5ca964a8bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:43.790270 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757d153-efc5-4a1d-a5e1-c5ca964a8bd8 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:43.790564 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757d153-efc5-4a1d-a5e1-c5ca964a8bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:43.790840 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757d153-efc5-4a1d-a5e1-c5ca964a8bd8 None admin] PATH_INFO: `/v3/groups/d1727dcecb2a4cd792462a4ac6da11b8` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:43.792020 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757d153-efc5-4a1d-a5e1-c5ca964a8bd8 None admin] RBAC: Authorizing `identity:get_group(group_id=d1727dcecb2a4cd792462a4ac6da11b8)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:43.793514 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757d153-efc5-4a1d-a5e1-c5ca964a8bd8 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:43.796132 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 176/375] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Sep 7 15:42:43 2022] GET /identity/v3/groups/d1727dcecb2a4cd792462a4ac6da11b8 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:43.801844 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757d153-efc5-4a1d-a5e1-c5ca964a8bd8 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:43.827509 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1566df1b-1bcd-41c0-aa10-8eb23d3fb64c None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:43.877909 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:43.894187 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92930a-e4e6-4573-a3a7-8e7617fb16bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:43.894914 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92930a-e4e6-4573-a3a7-8e7617fb16bb None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:43.895200 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92930a-e4e6-4573-a3a7-8e7617fb16bb None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:43.895475 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92930a-e4e6-4573-a3a7-8e7617fb16bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:43.953434 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757d153-efc5-4a1d-a5e1-c5ca964a8bd8 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:43.971368 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb92930a-e4e6-4573-a3a7-8e7617fb16bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:43.972874 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb92930a-e4e6-4573-a3a7-8e7617fb16bb None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:44.001880 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:44.019309 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa67b9-a38d-4f7f-af1e-27fcf50c1f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:44.020031 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa67b9-a38d-4f7f-af1e-27fcf50c1f9f None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:44.020312 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa67b9-a38d-4f7f-af1e-27fcf50c1f9f None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:44.020581 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa67b9-a38d-4f7f-af1e-27fcf50c1f9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:44.021416 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa67b9-a38d-4f7f-af1e-27fcf50c1f9f None admin] RBAC: Adding query filter params (group.id=d1727dcecb2a4cd792462a4ac6da11b8, role.id=ce978876ff724bf3b4101c9fd4d2d842, scope.project.id=d428d47056754be5930f84ee53d099af) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:44.021728 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa67b9-a38d-4f7f-af1e-27fcf50c1f9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:44.023184 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa67b9-a38d-4f7f-af1e-27fcf50c1f9f None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:44.046229 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 177/376] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Sep 7 15:42:43 2022] GET /identity/v3/role_assignments?group.id=d1727dcecb2a4cd792462a4ac6da11b8&scope.project.id=d428d47056754be5930f84ee53d099af&role.id=ce978876ff724bf3b4101c9fd4d2d842 => generated 260 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:42:44.085689 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 200/377] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:42:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 07 15:42:44.091685 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa67b9-a38d-4f7f-af1e-27fcf50c1f9f None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:44.211331 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa67b9-a38d-4f7f-af1e-27fcf50c1f9f None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:44.257320 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd78fb8-d8b0-41a9-b64f-ff9f026dfe88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:44.257980 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd78fb8-d8b0-41a9-b64f-ff9f026dfe88 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:44.258304 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd78fb8-d8b0-41a9-b64f-ff9f026dfe88 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:44.258582 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd78fb8-d8b0-41a9-b64f-ff9f026dfe88 None admin] PATH_INFO: `/v3/projects/ddba81771a254b1699bec72cf0d93f2d` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:44.259863 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd78fb8-d8b0-41a9-b64f-ff9f026dfe88 None admin] RBAC: Authorizing `identity:get_project(project_id=ddba81771a254b1699bec72cf0d93f2d)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:44.261319 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd78fb8-d8b0-41a9-b64f-ff9f026dfe88 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:44.264090 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 178/378] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 7 15:42:44 2022] GET /identity/v3/projects/ddba81771a254b1699bec72cf0d93f2d => generated 344 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:44.269596 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92930a-e4e6-4573-a3a7-8e7617fb16bb None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:44.309863 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:44.403845 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92930a-e4e6-4573-a3a7-8e7617fb16bb None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:44.441271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43bb058-ffc1-4c57-baa9-41bbc9dd3654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:44.442292 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43bb058-ffc1-4c57-baa9-41bbc9dd3654 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:44.442767 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43bb058-ffc1-4c57-baa9-41bbc9dd3654 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:44.443216 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43bb058-ffc1-4c57-baa9-41bbc9dd3654 None admin] PATH_INFO: `/v3/groups/08bda745afdb4ff38427273285b69aa7` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:44.450915 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43bb058-ffc1-4c57-baa9-41bbc9dd3654 None admin] RBAC: Authorizing `identity:get_group(group_id=08bda745afdb4ff38427273285b69aa7)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:44.452730 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43bb058-ffc1-4c57-baa9-41bbc9dd3654 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:44.454641 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 201/379] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Sep 7 15:42:44 2022] GET /identity/v3/groups/08bda745afdb4ff38427273285b69aa7 => generated 229 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:44.461077 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd78fb8-d8b0-41a9-b64f-ff9f026dfe88 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:44.537073 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:44.589023 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd78fb8-d8b0-41a9-b64f-ff9f026dfe88 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:44.629817 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd957ced-697a-41e2-972b-95bbb3335e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:44.630492 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd957ced-697a-41e2-972b-95bbb3335e20 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:44.630976 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd957ced-697a-41e2-972b-95bbb3335e20 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:44.631456 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd957ced-697a-41e2-972b-95bbb3335e20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:44.632871 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd957ced-697a-41e2-972b-95bbb3335e20 None admin] RBAC: Adding query filter params (group.id=08bda745afdb4ff38427273285b69aa7, role.id=61605ebf17e643258730e55bf6db15ad, scope.project.id=ddba81771a254b1699bec72cf0d93f2d) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:44.633421 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd957ced-697a-41e2-972b-95bbb3335e20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:44.636206 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd957ced-697a-41e2-972b-95bbb3335e20 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:44.646802 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 179/380] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Sep 7 15:42:44 2022] GET /identity/v3/role_assignments?group.id=08bda745afdb4ff38427273285b69aa7&scope.project.id=ddba81771a254b1699bec72cf0d93f2d&role.id=61605ebf17e643258730e55bf6db15ad => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:44.900183 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe8c0a-20c4-43b9-b506-1c51fca0b0aa None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:44.901208 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe8c0a-20c4-43b9-b506-1c51fca0b0aa None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:44.901725 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe8c0a-20c4-43b9-b506-1c51fca0b0aa None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:44.903899 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 202/381] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:42:44.909588 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711d72d-2aba-4139-ad41-17cd2ae37ec9 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:44.910131 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711d72d-2aba-4139-ad41-17cd2ae37ec9 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:44.910668 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711d72d-2aba-4139-ad41-17cd2ae37ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:44.936414 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-d711d72d-2aba-4139-ad41-17cd2ae37ec9 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:44.937956 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-d711d72d-2aba-4139-ad41-17cd2ae37ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:45.026573 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 180/382] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:42:45.302471 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe8c0a-20c4-43b9-b506-1c51fca0b0aa None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:45.438351 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:45.458208 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe8c0a-20c4-43b9-b506-1c51fca0b0aa None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:45.509243 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec7d0f-d3c0-41c6-8206-b242d9329ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:45.509885 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec7d0f-d3c0-41c6-8206-b242d9329ad3 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:45.510163 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec7d0f-d3c0-41c6-8206-b242d9329ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:45.510459 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec7d0f-d3c0-41c6-8206-b242d9329ad3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:45.531087 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec7d0f-d3c0-41c6-8206-b242d9329ad3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:42:45.535932 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-30ec7d0f-d3c0-41c6-8206-b242d9329ad3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:42:45.535932 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:45.535932 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:42:45.535932 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:42:45.535932 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:42:45.535932 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:42:45.535932 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:42:45.535932 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:42:45.535932 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:42:45.535932 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:42:45.535932 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:42:45.535932 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:42:45.535932 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:42:45.535932 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:42:45.535932 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:42:45.535932 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:42:45.537434 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:42:45.537434 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:42:45.537434 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:42:45.537434 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:42:45.537434 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:42:45.537434 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:42:45.537434 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:42:45.537434 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:42:45.537434 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:42:45.537434 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:42:45.537434 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:42:45.537434 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:42:45.537434 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:42:45.537434 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:42:45.537434 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:42:45.537434 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:42:45.538311 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:42:45.538311 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:42:45.538311 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:42:45.538311 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:42:45.538311 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:42:45.538311 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:42:45.538311 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:42:45.538311 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:42:45.538311 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:42:45.538311 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:42:45.538311 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:42:45.538311 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:42:45.538311 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 203/383] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:42:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:42:45.548073 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d711d72d-2aba-4139-ad41-17cd2ae37ec9 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:45.638256 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:45.704156 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d711d72d-2aba-4139-ad41-17cd2ae37ec9 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:45.754087 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436aac4-67b5-4306-83a4-df321011f857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:45.755099 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436aac4-67b5-4306-83a4-df321011f857 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:45.755641 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436aac4-67b5-4306-83a4-df321011f857 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:45.756134 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436aac4-67b5-4306-83a4-df321011f857 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:45.757024 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f436aac4-67b5-4306-83a4-df321011f857 None admin] RBAC: Adding query filter params (name=member) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:45.757549 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f436aac4-67b5-4306-83a4-df321011f857 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:45.759207 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f436aac4-67b5-4306-83a4-df321011f857 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:45.772758 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 181/384] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 7 15:42:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:45.779340 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec7d0f-d3c0-41c6-8206-b242d9329ad3 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:45.891968 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751573f-1fa9-4f24-ad4e-196e0b1cfe6c None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:45.892172 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751573f-1fa9-4f24-ad4e-196e0b1cfe6c None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:45.892607 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751573f-1fa9-4f24-ad4e-196e0b1cfe6c None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:45.894359 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 182/385] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:42:45.899291 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90ed8f-761b-4b34-8928-7224d5a3f497 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:45.899767 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90ed8f-761b-4b34-8928-7224d5a3f497 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:45.900195 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90ed8f-761b-4b34-8928-7224d5a3f497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:45.930099 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-2a90ed8f-761b-4b34-8928-7224d5a3f497 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:45.931687 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-2a90ed8f-761b-4b34-8928-7224d5a3f497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:45.985947 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec7d0f-d3c0-41c6-8206-b242d9329ad3 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:46.046722 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 183/386] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:42:46.053549 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a276e24-3212-468a-af16-fac2fe5162c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:46.054434 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a276e24-3212-468a-af16-fac2fe5162c3 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:46.054872 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a276e24-3212-468a-af16-fac2fe5162c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:46.055313 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a276e24-3212-468a-af16-fac2fe5162c3 None admin] PATH_INFO: `/v3/groups/d1727dcecb2a4cd792462a4ac6da11b8` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:46.056571 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a276e24-3212-468a-af16-fac2fe5162c3 None admin] RBAC: Authorizing `identity:get_group(group_id=d1727dcecb2a4cd792462a4ac6da11b8)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:46.058153 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a276e24-3212-468a-af16-fac2fe5162c3 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:46.060446 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 204/387] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Sep 7 15:42:45 2022] GET /identity/v3/groups/d1727dcecb2a4cd792462a4ac6da11b8 => generated 226 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:46.066018 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a90ed8f-761b-4b34-8928-7224d5a3f497 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:46.142626 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:46.237711 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a90ed8f-761b-4b34-8928-7224d5a3f497 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:46.300923 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f99b3d-7415-4dd9-b0de-0cee17efc31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:46.301572 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f99b3d-7415-4dd9-b0de-0cee17efc31b None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:46.301855 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f99b3d-7415-4dd9-b0de-0cee17efc31b None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:46.302129 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f99b3d-7415-4dd9-b0de-0cee17efc31b None admin] PATH_INFO: `/v3/projects/6e5edf54975843879025d05c7e7a65d7` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:46.303313 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f99b3d-7415-4dd9-b0de-0cee17efc31b None admin] RBAC: Authorizing `identity:get_project(project_id=6e5edf54975843879025d05c7e7a65d7)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:46.304761 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f99b3d-7415-4dd9-b0de-0cee17efc31b None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:46.306749 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 184/388] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 7 15:42:46 2022] GET /identity/v3/projects/6e5edf54975843879025d05c7e7a65d7 => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:46.312200 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a276e24-3212-468a-af16-fac2fe5162c3 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:46.345804 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:46.423984 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f99b3d-7415-4dd9-b0de-0cee17efc31b None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:46.475334 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a276e24-3212-468a-af16-fac2fe5162c3 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:46.516402 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630b1af1-28f7-49b1-b1e4-a405fb9169cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:46.517396 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b1af1-28f7-49b1-b1e4-a405fb9169cb None admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:46.517865 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b1af1-28f7-49b1-b1e4-a405fb9169cb None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:46.518369 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b1af1-28f7-49b1-b1e4-a405fb9169cb None admin] PATH_INFO: `/v3/projects/6e5edf54975843879025d05c7e7a65d7/groups/d1727dcecb2a4cd792462a4ac6da11b8/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:46.520503 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630b1af1-28f7-49b1-b1e4-a405fb9169cb None admin] RBAC: Authorizing `identity:create_grant(project_id=6e5edf54975843879025d05c7e7a65d7, group_id=d1727dcecb2a4cd792462a4ac6da11b8, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:46.522102 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630b1af1-28f7-49b1-b1e4-a405fb9169cb None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:46.538892 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 205/389] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Sep 7 15:42:46 2022] PUT /identity/v3/projects/6e5edf54975843879025d05c7e7a65d7/groups/d1727dcecb2a4cd792462a4ac6da11b8/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:42:46.604564 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f99b3d-7415-4dd9-b0de-0cee17efc31b None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:46.615579 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191f192-3a61-4fdc-8b19-592eb837a95d None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:46.616233 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191f192-3a61-4fdc-8b19-592eb837a95d None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:46.616738 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191f192-3a61-4fdc-8b19-592eb837a95d None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:46.619478 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 206/390] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:42:46.626688 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:46.628721 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8622fd-de71-4a95-8c77-6f1d271a8176 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:46.629224 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8622fd-de71-4a95-8c77-6f1d271a8176 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:46.629769 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8622fd-de71-4a95-8c77-6f1d271a8176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:46.660306 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-da8622fd-de71-4a95-8c77-6f1d271a8176 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:46.661906 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-da8622fd-de71-4a95-8c77-6f1d271a8176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:46.666226 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4af538-ea59-4eb7-a9af-92f5086f7ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:46.666668 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4af538-ea59-4eb7-a9af-92f5086f7ca2 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:46.666946 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4af538-ea59-4eb7-a9af-92f5086f7ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:46.667219 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4af538-ea59-4eb7-a9af-92f5086f7ca2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:46.690757 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4af538-ea59-4eb7-a9af-92f5086f7ca2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:42:46.696469 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-ab4af538-ea59-4eb7-a9af-92f5086f7ca2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 15:42:46.696469 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:46.696469 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:42:46.696469 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:42:46.696469 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:42:46.696469 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:42:46.696469 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:42:46.696469 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:42:46.696469 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:42:46.696469 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:42:46.696469 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:42:46.696469 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:42:46.696469 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:42:46.696469 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:42:46.696469 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:42:46.696469 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:42:46.697694 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:42:46.697694 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:42:46.697694 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:42:46.697694 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:42:46.697694 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:42:46.697694 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:42:46.697694 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:42:46.697694 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:42:46.697694 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:42:46.697694 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:42:46.697694 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:42:46.697694 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:42:46.697694 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:42:46.697694 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:42:46.697694 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:42:46.697694 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:42:46.698648 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:42:46.698648 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:42:46.698648 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:42:46.698648 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:42:46.698648 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:42:46.698648 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:42:46.698648 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:42:46.698648 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:42:46.698648 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:42:46.698648 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:42:46.698648 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 15:42:46.698648 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:42:46.706802 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 185/391] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 7 15:42:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:42:46.712154 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4af538-ea59-4eb7-a9af-92f5086f7ca2 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:46.759283 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 207/392] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:42:46.849413 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4af538-ea59-4eb7-a9af-92f5086f7ca2 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:46.889183 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf38d32-13d9-4e58-a88c-3c977fb8a1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:46.889848 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf38d32-13d9-4e58-a88c-3c977fb8a1d6 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:46.890129 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf38d32-13d9-4e58-a88c-3c977fb8a1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:46.890433 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf38d32-13d9-4e58-a88c-3c977fb8a1d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:46.891096 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf38d32-13d9-4e58-a88c-3c977fb8a1d6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:46.891395 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf38d32-13d9-4e58-a88c-3c977fb8a1d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:46.892764 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf38d32-13d9-4e58-a88c-3c977fb8a1d6 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:46.901654 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 186/393] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:42:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:42:46.908633 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8622fd-de71-4a95-8c77-6f1d271a8176 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:46.927523 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:46.942758 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac709c-423e-413c-9b0b-f82be4152a48 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:46.943247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac709c-423e-413c-9b0b-f82be4152a48 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:46.943525 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac709c-423e-413c-9b0b-f82be4152a48 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:46.945035 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 187/394] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:42:46.952071 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7cc2b-6c5b-456b-8aaa-01c93244c146 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:46.952351 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7cc2b-6c5b-456b-8aaa-01c93244c146 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:46.952627 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7cc2b-6c5b-456b-8aaa-01c93244c146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:46.998223 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-05b7cc2b-6c5b-456b-8aaa-01c93244c146 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:46.999445 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-05b7cc2b-6c5b-456b-8aaa-01c93244c146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:47.056061 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:47.099839 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8622fd-de71-4a95-8c77-6f1d271a8176 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:47.103340 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 188/395] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:42:47.104262 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7cc2b-6c5b-456b-8aaa-01c93244c146 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:47.162929 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e131c4f-71b4-46e1-acaf-d001d866ba1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:47.163647 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e131c4f-71b4-46e1-acaf-d001d866ba1f None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:47.163927 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e131c4f-71b4-46e1-acaf-d001d866ba1f None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:47.164202 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e131c4f-71b4-46e1-acaf-d001d866ba1f None admin] PATH_INFO: `/v3/groups/d1727dcecb2a4cd792462a4ac6da11b8` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:47.165299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e131c4f-71b4-46e1-acaf-d001d866ba1f None admin] RBAC: Authorizing `identity:get_group(group_id=d1727dcecb2a4cd792462a4ac6da11b8)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:47.166784 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e131c4f-71b4-46e1-acaf-d001d866ba1f None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:47.168837 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 208/396] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Sep 7 15:42:46 2022] GET /identity/v3/groups/d1727dcecb2a4cd792462a4ac6da11b8 => generated 226 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:42:47.176618 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e131c4f-71b4-46e1-acaf-d001d866ba1f None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:47.264682 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:47.291530 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e131c4f-71b4-46e1-acaf-d001d866ba1f None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:47.313934 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7cc2b-6c5b-456b-8aaa-01c93244c146 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:47.351329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811b42f-5710-4f78-92e4-1e992b52a740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:47.352239 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811b42f-5710-4f78-92e4-1e992b52a740 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:47.352718 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811b42f-5710-4f78-92e4-1e992b52a740 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:47.353135 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811b42f-5710-4f78-92e4-1e992b52a740 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:47.364439 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6811b42f-5710-4f78-92e4-1e992b52a740 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:42:47.367765 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875d9b2-9816-4bf1-b5b1-97019431f5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:47.368473 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875d9b2-9816-4bf1-b5b1-97019431f5c7 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:47.368761 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875d9b2-9816-4bf1-b5b1-97019431f5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:47.369036 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875d9b2-9816-4bf1-b5b1-97019431f5c7 None admin] PATH_INFO: `/v3/projects/6e5edf54975843879025d05c7e7a65d7` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:47.370186 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0875d9b2-9816-4bf1-b5b1-97019431f5c7 None admin] RBAC: Authorizing `identity:get_project(project_id=6e5edf54975843879025d05c7e7a65d7)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:47.370557 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-6811b42f-5710-4f78-92e4-1e992b52a740 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:42:47.370557 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:47.370557 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:42:47.370557 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:42:47.370557 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:42:47.370557 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:42:47.370557 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:42:47.370557 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:42:47.370557 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:42:47.370557 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:42:47.370557 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:42:47.370557 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:42:47.370557 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:42:47.370557 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:42:47.370557 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:42:47.370557 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:42:47.371503 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:42:47.371503 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:42:47.371503 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:42:47.371503 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:42:47.371503 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:42:47.371503 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:42:47.371503 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:42:47.371503 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:42:47.371503 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:42:47.371503 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:42:47.371503 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:42:47.371503 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:42:47.371503 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:42:47.371503 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:42:47.371503 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:42:47.371503 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:42:47.372835 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:42:47.372835 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:42:47.372835 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:42:47.372835 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:42:47.372835 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:42:47.372835 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:42:47.372835 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:42:47.372835 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:42:47.372835 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:42:47.372835 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:42:47.372835 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:42:47.372835 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:42:47.373440 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0875d9b2-9816-4bf1-b5b1-97019431f5c7 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:47.374163 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 209/397] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 7 15:42:47 2022] GET /identity/v3/projects/6e5edf54975843879025d05c7e7a65d7 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:47.379917 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 189/398] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:42:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:42:47.381792 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875d9b2-9816-4bf1-b5b1-97019431f5c7 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:47.385223 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811b42f-5710-4f78-92e4-1e992b52a740 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:47.435087 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:47.513484 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875d9b2-9816-4bf1-b5b1-97019431f5c7 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:47.517284 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811b42f-5710-4f78-92e4-1e992b52a740 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:47.556097 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c38278-a6d6-4bf1-95bb-cbadebc970ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:47.556979 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c38278-a6d6-4bf1-95bb-cbadebc970ef None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:47.557388 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c38278-a6d6-4bf1-95bb-cbadebc970ef None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:47.557793 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c38278-a6d6-4bf1-95bb-cbadebc970ef None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:47.557909 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50699f0b-249f-414d-b12b-cbf6e78252de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:47.558730 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50699f0b-249f-414d-b12b-cbf6e78252de None admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:47.558896 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c38278-a6d6-4bf1-95bb-cbadebc970ef None admin] RBAC: Adding query filter params (name=member) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:47.559349 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50699f0b-249f-414d-b12b-cbf6e78252de None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:47.559669 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c38278-a6d6-4bf1-95bb-cbadebc970ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:47.559936 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50699f0b-249f-414d-b12b-cbf6e78252de None admin] PATH_INFO: `/v3/projects/6e5edf54975843879025d05c7e7a65d7/groups/d1727dcecb2a4cd792462a4ac6da11b8/roles/ce978876ff724bf3b4101c9fd4d2d842` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:47.561417 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c38278-a6d6-4bf1-95bb-cbadebc970ef None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:47.562509 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50699f0b-249f-414d-b12b-cbf6e78252de None admin] RBAC: Authorizing `identity:create_grant(project_id=6e5edf54975843879025d05c7e7a65d7, group_id=d1727dcecb2a4cd792462a4ac6da11b8, role_id=ce978876ff724bf3b4101c9fd4d2d842)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:47.564610 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50699f0b-249f-414d-b12b-cbf6e78252de None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:47.571377 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 190/399] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 7 15:42:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:47.572520 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c38278-a6d6-4bf1-95bb-cbadebc970ef None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:47.581943 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 210/400] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Sep 7 15:42:47 2022] PUT /identity/v3/projects/6e5edf54975843879025d05c7e7a65d7/groups/d1727dcecb2a4cd792462a4ac6da11b8/roles/ce978876ff724bf3b4101c9fd4d2d842 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 15:42:47.588195 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50699f0b-249f-414d-b12b-cbf6e78252de None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:47.594487 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:47.692887 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:47.712123 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c38278-a6d6-4bf1-95bb-cbadebc970ef None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:47.749521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50699f0b-249f-414d-b12b-cbf6e78252de None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:47.752352 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e480c03-46e8-46f8-8fb1-605370ddf49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:47.753000 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e480c03-46e8-46f8-8fb1-605370ddf49c None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:47.753334 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e480c03-46e8-46f8-8fb1-605370ddf49c None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:47.753616 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e480c03-46e8-46f8-8fb1-605370ddf49c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:47.767670 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e480c03-46e8-46f8-8fb1-605370ddf49c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:42:47.773791 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-0e480c03-46e8-46f8-8fb1-605370ddf49c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 15:42:47.773791 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:47.773791 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:42:47.773791 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:42:47.773791 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:42:47.773791 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:42:47.773791 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:42:47.773791 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:42:47.773791 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:42:47.773791 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:42:47.773791 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:42:47.773791 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:42:47.773791 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:42:47.773791 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:42:47.773791 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:42:47.773791 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:42:47.774797 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:42:47.774797 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:42:47.774797 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:42:47.774797 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:42:47.774797 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:42:47.774797 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:42:47.774797 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:42:47.774797 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:42:47.774797 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:42:47.774797 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:42:47.774797 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:42:47.774797 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:42:47.774797 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:42:47.774797 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:42:47.774797 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:42:47.774797 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:42:47.775593 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:42:47.775593 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:42:47.775593 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:42:47.775593 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:42:47.775593 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:42:47.775593 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:42:47.775593 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:42:47.775593 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:42:47.775593 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:42:47.775593 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:42:47.775593 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 15:42:47.775593 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:42:47.780541 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 191/401] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 7 15:42:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:42:47.782128 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b1861-a0ae-4f5a-a25e-f53830cbf34f None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:47.782440 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b1861-a0ae-4f5a-a25e-f53830cbf34f None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:47.782716 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b1861-a0ae-4f5a-a25e-f53830cbf34f None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:47.784259 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 192/402] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:42:47.790323 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f08c7-31bb-44ef-891f-2185d644b486 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:47.790556 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f08c7-31bb-44ef-891f-2185d644b486 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:47.790833 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f08c7-31bb-44ef-891f-2185d644b486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:47.800787 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca391b-f49f-4abc-924f-ef44abd0cb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:47.801720 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca391b-f49f-4abc-924f-ef44abd0cb14 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:47.802258 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca391b-f49f-4abc-924f-ef44abd0cb14 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:47.802718 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca391b-f49f-4abc-924f-ef44abd0cb14 None admin] PATH_INFO: `/v3/groups/d1727dcecb2a4cd792462a4ac6da11b8` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:47.804064 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aca391b-f49f-4abc-924f-ef44abd0cb14 None admin] RBAC: Authorizing `identity:get_group(group_id=d1727dcecb2a4cd792462a4ac6da11b8)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:47.806268 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aca391b-f49f-4abc-924f-ef44abd0cb14 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:47.808008 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 211/403] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Sep 7 15:42:47 2022] GET /identity/v3/groups/d1727dcecb2a4cd792462a4ac6da11b8 => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:47.808892 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca391b-f49f-4abc-924f-ef44abd0cb14 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:47.811042 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-e74f08c7-31bb-44ef-891f-2185d644b486 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:47.812672 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-e74f08c7-31bb-44ef-891f-2185d644b486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:47.894158 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 193/404] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:42:47.895078 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f08c7-31bb-44ef-891f-2185d644b486 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:47.902668 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:47.950485 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca391b-f49f-4abc-924f-ef44abd0cb14 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:47.982107 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:48.000499 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd1f12-1cde-41f8-9f61-68546eb695bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:48.001686 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd1f12-1cde-41f8-9f61-68546eb695bf None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:48.002617 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd1f12-1cde-41f8-9f61-68546eb695bf None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:48.003368 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd1f12-1cde-41f8-9f61-68546eb695bf None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:48.004499 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cd1f12-1cde-41f8-9f61-68546eb695bf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:48.005421 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cd1f12-1cde-41f8-9f61-68546eb695bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:48.007320 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cd1f12-1cde-41f8-9f61-68546eb695bf None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:48.007876 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f08c7-31bb-44ef-891f-2185d644b486 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:48.017240 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 212/405] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:42:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:48.023230 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd1f12-1cde-41f8-9f61-68546eb695bf None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:48.061209 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f6237-353b-4489-ae25-3948796e695e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:48.062282 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f6237-353b-4489-ae25-3948796e695e None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:48.062711 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f6237-353b-4489-ae25-3948796e695e None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:48.063386 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f6237-353b-4489-ae25-3948796e695e None admin] PATH_INFO: `/v3/projects/d428d47056754be5930f84ee53d099af` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:48.065052 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7f6237-353b-4489-ae25-3948796e695e None admin] RBAC: Authorizing `identity:get_project(project_id=d428d47056754be5930f84ee53d099af)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:48.066745 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7f6237-353b-4489-ae25-3948796e695e None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:48.069155 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 194/406] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 7 15:42:47 2022] GET /identity/v3/projects/d428d47056754be5930f84ee53d099af => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:48.074689 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f6237-353b-4489-ae25-3948796e695e None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:48.222283 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f6237-353b-4489-ae25-3948796e695e None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:48.246079 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd1f12-1cde-41f8-9f61-68546eb695bf None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:48.269938 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf5dcbc-f977-4c12-aea0-4c36e680b28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:48.271339 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5dcbc-f977-4c12-aea0-4c36e680b28d None admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:48.272019 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5dcbc-f977-4c12-aea0-4c36e680b28d None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:48.272447 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5dcbc-f977-4c12-aea0-4c36e680b28d None admin] PATH_INFO: `/v3/projects/d428d47056754be5930f84ee53d099af/groups/d1727dcecb2a4cd792462a4ac6da11b8/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:48.275404 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf5dcbc-f977-4c12-aea0-4c36e680b28d None admin] RBAC: Authorizing `identity:create_grant(project_id=d428d47056754be5930f84ee53d099af, group_id=d1727dcecb2a4cd792462a4ac6da11b8, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:48.276993 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:48.277334 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf5dcbc-f977-4c12-aea0-4c36e680b28d None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:48.285742 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711b1b7-6228-4cbb-877e-b811b163c534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:48.286684 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711b1b7-6228-4cbb-877e-b811b163c534 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:48.286969 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711b1b7-6228-4cbb-877e-b811b163c534 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:48.287333 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711b1b7-6228-4cbb-877e-b811b163c534 None admin] PATH_INFO: `/v3/groups/d1727dcecb2a4cd792462a4ac6da11b8` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:48.288754 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1711b1b7-6228-4cbb-877e-b811b163c534 None admin] RBAC: Authorizing `identity:get_group(group_id=d1727dcecb2a4cd792462a4ac6da11b8)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:48.290537 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1711b1b7-6228-4cbb-877e-b811b163c534 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:48.295518 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 195/407] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Sep 7 15:42:48 2022] PUT /identity/v3/projects/d428d47056754be5930f84ee53d099af/groups/d1727dcecb2a4cd792462a4ac6da11b8/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:42:48.296635 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf5dcbc-f977-4c12-aea0-4c36e680b28d None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:48.298461 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 213/408] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Sep 7 15:42:48 2022] GET /identity/v3/groups/d1727dcecb2a4cd792462a4ac6da11b8 => generated 226 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:48.299539 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711b1b7-6228-4cbb-877e-b811b163c534 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:48.300994 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:48.424345 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711b1b7-6228-4cbb-877e-b811b163c534 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:48.441045 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf5dcbc-f977-4c12-aea0-4c36e680b28d None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:48.463924 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e086a3b-9e5e-45a5-8804-22f6ee0b582a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:48.464650 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e086a3b-9e5e-45a5-8804-22f6ee0b582a None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:48.464993 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e086a3b-9e5e-45a5-8804-22f6ee0b582a None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:48.465267 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e086a3b-9e5e-45a5-8804-22f6ee0b582a None admin] PATH_INFO: `/v3/projects/d428d47056754be5930f84ee53d099af` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:48.467141 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e086a3b-9e5e-45a5-8804-22f6ee0b582a None admin] RBAC: Authorizing `identity:get_project(project_id=d428d47056754be5930f84ee53d099af)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:48.468645 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e086a3b-9e5e-45a5-8804-22f6ee0b582a None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:48.470426 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 214/409] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 7 15:42:48 2022] GET /identity/v3/projects/d428d47056754be5930f84ee53d099af => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:48.476811 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e086a3b-9e5e-45a5-8804-22f6ee0b582a None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:48.488069 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845245e-9811-4009-86f2-ca8448287f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:48.489084 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845245e-9811-4009-86f2-ca8448287f34 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:48.489606 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845245e-9811-4009-86f2-ca8448287f34 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:48.490097 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845245e-9811-4009-86f2-ca8448287f34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:48.504443 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0845245e-9811-4009-86f2-ca8448287f34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:42:48.512937 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-0845245e-9811-4009-86f2-ca8448287f34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:42:48.512937 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:48.512937 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:42:48.512937 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:42:48.512937 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:42:48.512937 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:42:48.512937 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:42:48.512937 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:42:48.512937 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:42:48.512937 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:42:48.512937 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:42:48.512937 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:42:48.512937 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:42:48.512937 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:42:48.512937 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:42:48.512937 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:42:48.514404 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:42:48.514404 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:42:48.514404 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:42:48.514404 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:42:48.514404 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:42:48.514404 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:42:48.514404 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:42:48.514404 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:42:48.514404 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:42:48.514404 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:42:48.514404 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:42:48.514404 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:42:48.514404 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:42:48.514404 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:42:48.514404 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:42:48.514404 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:42:48.515214 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:42:48.515214 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:42:48.515214 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:42:48.515214 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:42:48.515214 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:42:48.515214 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:42:48.515214 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:42:48.515214 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:42:48.515214 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:42:48.515214 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:42:48.515214 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:42:48.515214 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:42:48.517833 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 196/410] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 7 15:42:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:42:48.530405 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845245e-9811-4009-86f2-ca8448287f34 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:48.596316 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:48.629773 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:48.644487 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e086a3b-9e5e-45a5-8804-22f6ee0b582a None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:48.683905 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845245e-9811-4009-86f2-ca8448287f34 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:48.687130 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac41e79-1e36-44e8-8c83-034806ecd930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:48.687802 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac41e79-1e36-44e8-8c83-034806ecd930 None admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:48.688151 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac41e79-1e36-44e8-8c83-034806ecd930 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:48.688486 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac41e79-1e36-44e8-8c83-034806ecd930 None admin] PATH_INFO: `/v3/projects/d428d47056754be5930f84ee53d099af/groups/d1727dcecb2a4cd792462a4ac6da11b8/roles/ce978876ff724bf3b4101c9fd4d2d842` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:48.690725 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac41e79-1e36-44e8-8c83-034806ecd930 None admin] RBAC: Authorizing `identity:create_grant(project_id=d428d47056754be5930f84ee53d099af, group_id=d1727dcecb2a4cd792462a4ac6da11b8, role_id=ce978876ff724bf3b4101c9fd4d2d842)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:48.692157 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac41e79-1e36-44e8-8c83-034806ecd930 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:48.724487 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 215/411] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Sep 7 15:42:48 2022] PUT /identity/v3/projects/d428d47056754be5930f84ee53d099af/groups/d1727dcecb2a4cd792462a4ac6da11b8/roles/ce978876ff724bf3b4101c9fd4d2d842 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 15:42:48.738092 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f49f36-8a3a-43c4-bbed-9d4997c33670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:48.738853 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f49f36-8a3a-43c4-bbed-9d4997c33670 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:48.739144 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f49f36-8a3a-43c4-bbed-9d4997c33670 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:48.739420 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f49f36-8a3a-43c4-bbed-9d4997c33670 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:48.740120 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f49f36-8a3a-43c4-bbed-9d4997c33670 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:48.740425 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f49f36-8a3a-43c4-bbed-9d4997c33670 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:48.741949 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f49f36-8a3a-43c4-bbed-9d4997c33670 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:48.761289 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 197/412] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:42:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:48.767649 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac41e79-1e36-44e8-8c83-034806ecd930 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:48.904651 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac41e79-1e36-44e8-8c83-034806ecd930 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:48.933138 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:48.944426 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9824bedd-c85b-4191-a529-a71463d47148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:48.945064 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824bedd-c85b-4191-a529-a71463d47148 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:48.945343 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824bedd-c85b-4191-a529-a71463d47148 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:48.945622 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824bedd-c85b-4191-a529-a71463d47148 None admin] PATH_INFO: `/v3/groups/08bda745afdb4ff38427273285b69aa7` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:48.946750 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9824bedd-c85b-4191-a529-a71463d47148 None admin] RBAC: Authorizing `identity:get_group(group_id=08bda745afdb4ff38427273285b69aa7)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:48.948185 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9824bedd-c85b-4191-a529-a71463d47148 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:48.953696 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 216/413] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Sep 7 15:42:48 2022] GET /identity/v3/groups/08bda745afdb4ff38427273285b69aa7 => generated 229 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:48.955900 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f49f36-8a3a-43c4-bbed-9d4997c33670 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:49.105779 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f49f36-8a3a-43c4-bbed-9d4997c33670 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:49.132786 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:49.144589 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49edf7d-e52c-480c-83bd-f9d4628aea4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:49.145232 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49edf7d-e52c-480c-83bd-f9d4628aea4a None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:49.145512 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49edf7d-e52c-480c-83bd-f9d4628aea4a None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:49.145786 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49edf7d-e52c-480c-83bd-f9d4628aea4a None admin] PATH_INFO: `/v3/projects/ddba81771a254b1699bec72cf0d93f2d` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:49.146993 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49edf7d-e52c-480c-83bd-f9d4628aea4a None admin] RBAC: Authorizing `identity:get_project(project_id=ddba81771a254b1699bec72cf0d93f2d)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:49.148489 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49edf7d-e52c-480c-83bd-f9d4628aea4a None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:49.150458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 198/414] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 7 15:42:48 2022] GET /identity/v3/projects/ddba81771a254b1699bec72cf0d93f2d => generated 344 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:49.156157 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9824bedd-c85b-4191-a529-a71463d47148 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:49.268674 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9824bedd-c85b-4191-a529-a71463d47148 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:49.309322 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6424b4a-953b-4018-8bf6-835a1ac6eb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:49.310437 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6424b4a-953b-4018-8bf6-835a1ac6eb89 None admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:49.310899 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6424b4a-953b-4018-8bf6-835a1ac6eb89 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:49.311370 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6424b4a-953b-4018-8bf6-835a1ac6eb89 None admin] PATH_INFO: `/v3/projects/ddba81771a254b1699bec72cf0d93f2d/groups/08bda745afdb4ff38427273285b69aa7/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:49.317630 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6424b4a-953b-4018-8bf6-835a1ac6eb89 None admin] RBAC: Authorizing `identity:create_grant(project_id=ddba81771a254b1699bec72cf0d93f2d, group_id=08bda745afdb4ff38427273285b69aa7, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:49.319356 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6424b4a-953b-4018-8bf6-835a1ac6eb89 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:49.337639 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 217/415] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Sep 7 15:42:49 2022] PUT /identity/v3/projects/ddba81771a254b1699bec72cf0d93f2d/groups/08bda745afdb4ff38427273285b69aa7/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 15:42:49.571811 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e98acf-8c83-430d-b7c9-a7e613d83479 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:49.572392 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e98acf-8c83-430d-b7c9-a7e613d83479 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:49.572869 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e98acf-8c83-430d-b7c9-a7e613d83479 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:49.574718 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 199/416] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:42:49.581055 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e352b5a-b2fc-4db7-899a-17bd47891b1e None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:49.581592 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e352b5a-b2fc-4db7-899a-17bd47891b1e None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:49.582061 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e352b5a-b2fc-4db7-899a-17bd47891b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:49.601994 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-7e352b5a-b2fc-4db7-899a-17bd47891b1e None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:49.603200 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-7e352b5a-b2fc-4db7-899a-17bd47891b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:49.659857 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:49.678340 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 218/417] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:42:50.066025 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6befba3-4271-4680-9a3b-5389618cb389 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:50.066538 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6befba3-4271-4680-9a3b-5389618cb389 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:50.066640 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6befba3-4271-4680-9a3b-5389618cb389 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:50.068061 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 200/418] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:42:50.073437 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a88c9-613e-4df7-a0cc-2d6e098b4d3d None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:50.073733 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a88c9-613e-4df7-a0cc-2d6e098b4d3d None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:50.074016 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a88c9-613e-4df7-a0cc-2d6e098b4d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:50.103135 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-f25a88c9-613e-4df7-a0cc-2d6e098b4d3d None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:50.104320 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-f25a88c9-613e-4df7-a0cc-2d6e098b4d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:50.129074 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6befba3-4271-4680-9a3b-5389618cb389 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:50.196293 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 219/419] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:42:50.300022 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6befba3-4271-4680-9a3b-5389618cb389 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:50.347840 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e9ec8e-4a9b-4f17-a9f1-672b57ac7570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:50.348473 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9ec8e-4a9b-4f17-a9f1-672b57ac7570 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:50.348752 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9ec8e-4a9b-4f17-a9f1-672b57ac7570 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:50.349024 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9ec8e-4a9b-4f17-a9f1-672b57ac7570 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:50.369789 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e9ec8e-4a9b-4f17-a9f1-672b57ac7570 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:42:50.375239 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-39e9ec8e-4a9b-4f17-a9f1-672b57ac7570 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:42:50.375239 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:50.375239 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:42:50.375239 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:42:50.375239 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:42:50.375239 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:42:50.375239 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:42:50.375239 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:42:50.375239 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:42:50.375239 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:42:50.375239 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:42:50.375239 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:42:50.375239 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:42:50.375239 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:42:50.375239 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:42:50.375239 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:42:50.376084 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:42:50.376084 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:42:50.376084 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:42:50.376084 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:42:50.376084 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:42:50.376084 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:42:50.376084 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:42:50.376084 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:42:50.376084 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:42:50.376084 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:42:50.376084 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:42:50.376084 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:42:50.376084 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:42:50.376084 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:42:50.376084 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:42:50.376084 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:42:50.376907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:42:50.376907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:42:50.376907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:42:50.376907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:42:50.376907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:42:50.376907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:42:50.376907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:42:50.376907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:42:50.376907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:42:50.376907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:42:50.376907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:42:50.376907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:42:50.376907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 201/420] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:42:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:42:50.383644 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a88c9-613e-4df7-a0cc-2d6e098b4d3d None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:50.532774 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a88c9-613e-4df7-a0cc-2d6e098b4d3d None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:50.552791 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:50.577220 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30433810-7911-44f8-9542-299c0a2040b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:50.577835 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30433810-7911-44f8-9542-299c0a2040b0 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:50.578110 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30433810-7911-44f8-9542-299c0a2040b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:50.578420 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30433810-7911-44f8-9542-299c0a2040b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:50.579081 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30433810-7911-44f8-9542-299c0a2040b0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:50.579379 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30433810-7911-44f8-9542-299c0a2040b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:50.580832 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30433810-7911-44f8-9542-299c0a2040b0 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:50.593816 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 220/421] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 7 15:42:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:50.599502 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e9ec8e-4a9b-4f17-a9f1-672b57ac7570 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:50.616112 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30433810-7911-44f8-9542-299c0a2040b0 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:50.673244 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:50.750837 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30433810-7911-44f8-9542-299c0a2040b0 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:50.786054 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3adef7c-5bd7-42f5-9788-38c5a1b33192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:50.786727 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3adef7c-5bd7-42f5-9788-38c5a1b33192 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:50.787009 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3adef7c-5bd7-42f5-9788-38c5a1b33192 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:50.787283 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3adef7c-5bd7-42f5-9788-38c5a1b33192 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:50.798269 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3adef7c-5bd7-42f5-9788-38c5a1b33192 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:42:50.803648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-b3adef7c-5bd7-42f5-9788-38c5a1b33192 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 15:42:50.803648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:50.803648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:42:50.803648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:42:50.803648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:42:50.803648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:42:50.803648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:42:50.803648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:42:50.803648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:42:50.803648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:42:50.803648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:42:50.803648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:42:50.803648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:42:50.803648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:42:50.803648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:42:50.803648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:42:50.804524 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:42:50.804524 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:42:50.804524 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:42:50.804524 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:42:50.804524 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:42:50.804524 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:42:50.804524 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:42:50.804524 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:42:50.804524 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:42:50.804524 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:42:50.804524 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:42:50.804524 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:42:50.804524 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:42:50.804524 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:42:50.804524 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:42:50.804524 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:42:50.805681 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:42:50.805681 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:42:50.805681 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:42:50.805681 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:42:50.805681 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:42:50.805681 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:42:50.805681 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:42:50.805681 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:42:50.805681 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:42:50.805681 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:42:50.805681 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 15:42:50.805681 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:42:50.806565 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e9ec8e-4a9b-4f17-a9f1-672b57ac7570 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:50.806646 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 221/422] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 7 15:42:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:42:50.810776 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3adef7c-5bd7-42f5-9788-38c5a1b33192 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:50.861798 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:50.910078 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf9200a-6447-4bd4-adc1-6f99d1671d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:50.910721 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9200a-6447-4bd4-adc1-6f99d1671d4c None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:50.911003 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9200a-6447-4bd4-adc1-6f99d1671d4c None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:50.911277 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9200a-6447-4bd4-adc1-6f99d1671d4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:50.918293 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3adef7c-5bd7-42f5-9788-38c5a1b33192 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:50.954211 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1c812-d9c7-4760-9a6c-b9e80d663d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:50.954850 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1c812-d9c7-4760-9a6c-b9e80d663d5f None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:50.955119 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1c812-d9c7-4760-9a6c-b9e80d663d5f None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:50.955460 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1c812-d9c7-4760-9a6c-b9e80d663d5f None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:50.956133 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa1c812-d9c7-4760-9a6c-b9e80d663d5f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:50.956439 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa1c812-d9c7-4760-9a6c-b9e80d663d5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:50.957821 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa1c812-d9c7-4760-9a6c-b9e80d663d5f None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:50.971650 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 222/423] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:42:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:50.977324 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1c812-d9c7-4760-9a6c-b9e80d663d5f None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:51.040202 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf9200a-6447-4bd4-adc1-6f99d1671d4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:51.050225 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf9200a-6447-4bd4-adc1-6f99d1671d4c None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:51.092038 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:51.096806 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1c812-d9c7-4760-9a6c-b9e80d663d5f None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:51.113413 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:51.136548 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa1023-415a-40de-b257-a5ce1160b64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:51.137309 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa1023-415a-40de-b257-a5ce1160b64a None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:51.137734 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa1023-415a-40de-b257-a5ce1160b64a None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:51.138088 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa1023-415a-40de-b257-a5ce1160b64a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:51.172525 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 202/424] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:42:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:42:51.173986 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee711d11-01ab-43a1-9b5a-ec2976d2051e None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:51.174361 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee711d11-01ab-43a1-9b5a-ec2976d2051e None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:51.174707 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee711d11-01ab-43a1-9b5a-ec2976d2051e None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:51.176319 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 203/425] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:42:51.183308 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee711d11-01ab-43a1-9b5a-ec2976d2051e None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:51.227733 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afa1023-415a-40de-b257-a5ce1160b64a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:51.229197 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afa1023-415a-40de-b257-a5ce1160b64a None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:51.304404 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee711d11-01ab-43a1-9b5a-ec2976d2051e None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:51.351652 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60046dc8-1111-4f05-b203-4bd0c91930ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:51.352199 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60046dc8-1111-4f05-b203-4bd0c91930ec None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:51.352472 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60046dc8-1111-4f05-b203-4bd0c91930ec None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:51.352741 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60046dc8-1111-4f05-b203-4bd0c91930ec None admin] PATH_INFO: `/v3/projects/6e5edf54975843879025d05c7e7a65d7` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:51.353866 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60046dc8-1111-4f05-b203-4bd0c91930ec None admin] RBAC: Authorizing `identity:get_project(project_id=6e5edf54975843879025d05c7e7a65d7)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:51.355668 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60046dc8-1111-4f05-b203-4bd0c91930ec None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:51.359238 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 204/426] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 7 15:42:51 2022] GET /identity/v3/projects/6e5edf54975843879025d05c7e7a65d7 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:51.361063 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a36cd-7d87-43d4-bf54-1a7dbb4a300c None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:51.361480 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a36cd-7d87-43d4-bf54-1a7dbb4a300c None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:51.361761 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a36cd-7d87-43d4-bf54-1a7dbb4a300c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:51.363831 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:51.373362 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 223/427] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:42:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 07 15:42:51.374406 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa1023-415a-40de-b257-a5ce1160b64a None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:51.381630 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-907a36cd-7d87-43d4-bf54-1a7dbb4a300c None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:51.382923 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-907a36cd-7d87-43d4-bf54-1a7dbb4a300c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:51.401465 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:51.459105 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 205/428] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:42:51.460028 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907a36cd-7d87-43d4-bf54-1a7dbb4a300c None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:51.499491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa1023-415a-40de-b257-a5ce1160b64a None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:51.537359 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf3ab5-6110-4713-9e2b-5cf464409fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:51.538392 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf3ab5-6110-4713-9e2b-5cf464409fb5 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:51.538938 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf3ab5-6110-4713-9e2b-5cf464409fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:51.539453 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf3ab5-6110-4713-9e2b-5cf464409fb5 None admin] PATH_INFO: `/v3/groups/d1727dcecb2a4cd792462a4ac6da11b8` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:51.541012 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bf3ab5-6110-4713-9e2b-5cf464409fb5 None admin] RBAC: Authorizing `identity:get_group(group_id=d1727dcecb2a4cd792462a4ac6da11b8)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:51.542916 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bf3ab5-6110-4713-9e2b-5cf464409fb5 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:51.545748 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 224/429] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Sep 7 15:42:51 2022] GET /identity/v3/groups/d1727dcecb2a4cd792462a4ac6da11b8 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:51.547195 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d15be6-3688-4e04-afff-32dfcafda869 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:51.547751 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d15be6-3688-4e04-afff-32dfcafda869 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:51.548312 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d15be6-3688-4e04-afff-32dfcafda869 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:51.553999 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 225/430] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:42:51.555131 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d15be6-3688-4e04-afff-32dfcafda869 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:51.568122 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907a36cd-7d87-43d4-bf54-1a7dbb4a300c None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:51.605734 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbd5d7-1fe5-401d-948a-12c0826598d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:51.606533 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbd5d7-1fe5-401d-948a-12c0826598d2 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:51.607126 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbd5d7-1fe5-401d-948a-12c0826598d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:51.607375 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbd5d7-1fe5-401d-948a-12c0826598d2 None admin] PATH_INFO: `/v3/projects/6e5edf54975843879025d05c7e7a65d7` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:51.608683 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bbd5d7-1fe5-401d-948a-12c0826598d2 None admin] RBAC: Authorizing `identity:get_project(project_id=6e5edf54975843879025d05c7e7a65d7)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:51.610047 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bbd5d7-1fe5-401d-948a-12c0826598d2 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:51.611797 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 206/431] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 7 15:42:51 2022] GET /identity/v3/projects/6e5edf54975843879025d05c7e7a65d7 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:51.613207 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c86f48-9f37-4aa5-bcf8-87760d422418 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:51.613487 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c86f48-9f37-4aa5-bcf8-87760d422418 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:51.613757 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c86f48-9f37-4aa5-bcf8-87760d422418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:51.633221 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-30c86f48-9f37-4aa5-bcf8-87760d422418 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:51.634513 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-30c86f48-9f37-4aa5-bcf8-87760d422418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:51.635791 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:51.652785 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:51.679190 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d15be6-3688-4e04-afff-32dfcafda869 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:51.710555 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 207/432] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:42:51.711846 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c86f48-9f37-4aa5-bcf8-87760d422418 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:51.729565 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d9ba1-2211-4672-8345-2127101fac5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:51.730220 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d9ba1-2211-4672-8345-2127101fac5f None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:51.730491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d9ba1-2211-4672-8345-2127101fac5f None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:51.730889 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d9ba1-2211-4672-8345-2127101fac5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:51.733094 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7d9ba1-2211-4672-8345-2127101fac5f None admin] RBAC: Adding query filter params (group.id=d1727dcecb2a4cd792462a4ac6da11b8, role.id=d45e39b4ad4e4ce782ec649246438663, scope.project.id=6e5edf54975843879025d05c7e7a65d7) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:51.733302 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7d9ba1-2211-4672-8345-2127101fac5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:51.734883 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7d9ba1-2211-4672-8345-2127101fac5f None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:51.746011 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 226/433] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Sep 7 15:42:51 2022] GET /identity/v3/role_assignments?group.id=d1727dcecb2a4cd792462a4ac6da11b8&scope.project.id=6e5edf54975843879025d05c7e7a65d7&role.id=d45e39b4ad4e4ce782ec649246438663 => generated 611 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:51.747086 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d9ba1-2211-4672-8345-2127101fac5f None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:51.824886 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c86f48-9f37-4aa5-bcf8-87760d422418 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:51.903481 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d9ba1-2211-4672-8345-2127101fac5f None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:51.920194 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de9404-492e-4c21-a679-42d4221903bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:51.921240 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de9404-492e-4c21-a679-42d4221903bc None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:51.921742 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de9404-492e-4c21-a679-42d4221903bc None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:51.922400 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de9404-492e-4c21-a679-42d4221903bc None admin] PATH_INFO: `/v3/groups/d1727dcecb2a4cd792462a4ac6da11b8` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:51.923789 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44de9404-492e-4c21-a679-42d4221903bc None admin] RBAC: Authorizing `identity:get_group(group_id=d1727dcecb2a4cd792462a4ac6da11b8)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:51.925517 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44de9404-492e-4c21-a679-42d4221903bc None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:51.935417 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 208/434] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Sep 7 15:42:51 2022] GET /identity/v3/groups/d1727dcecb2a4cd792462a4ac6da11b8 => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:51.938575 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:51.941041 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de9404-492e-4c21-a679-42d4221903bc None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:51.946109 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e49918-0e59-4153-aac9-1e33df9a319c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:51.946716 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e49918-0e59-4153-aac9-1e33df9a319c None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:51.947124 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e49918-0e59-4153-aac9-1e33df9a319c None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:51.947587 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e49918-0e59-4153-aac9-1e33df9a319c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:51.962082 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e49918-0e59-4153-aac9-1e33df9a319c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:42:51.968781 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-d1e49918-0e59-4153-aac9-1e33df9a319c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:42:51.968781 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:51.968781 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:42:51.968781 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:42:51.968781 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:42:51.968781 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:42:51.968781 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:42:51.968781 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:42:51.968781 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:42:51.968781 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:42:51.968781 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:42:51.968781 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:42:51.968781 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:42:51.968781 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:42:51.968781 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:42:51.968781 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:42:51.969660 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:42:51.969660 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:42:51.969660 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:42:51.969660 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:42:51.969660 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:42:51.969660 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:42:51.969660 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:42:51.969660 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:42:51.969660 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:42:51.969660 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:42:51.969660 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:42:51.969660 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:42:51.969660 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:42:51.969660 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:42:51.969660 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:42:51.969660 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:42:51.970614 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:42:51.970614 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:42:51.970614 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:42:51.970614 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:42:51.970614 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:42:51.970614 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:42:51.970614 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:42:51.970614 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:42:51.970614 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:42:51.970614 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:42:51.970614 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 15:42:51.970614 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:42:51.970614 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 227/435] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:42:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:42:51.971283 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:51.977703 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e49918-0e59-4153-aac9-1e33df9a319c None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:52.064869 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de9404-492e-4c21-a679-42d4221903bc None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:52.100170 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e49918-0e59-4153-aac9-1e33df9a319c None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:52.104393 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432bc81-974c-4315-bce7-a36033b42c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:52.105024 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432bc81-974c-4315-bce7-a36033b42c05 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:52.105305 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432bc81-974c-4315-bce7-a36033b42c05 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:52.105576 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432bc81-974c-4315-bce7-a36033b42c05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:52.107162 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432bc81-974c-4315-bce7-a36033b42c05 None admin] RBAC: Adding query filter params (group.id=d1727dcecb2a4cd792462a4ac6da11b8, role.id=ce978876ff724bf3b4101c9fd4d2d842, scope.project.id=6e5edf54975843879025d05c7e7a65d7) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:52.107475 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432bc81-974c-4315-bce7-a36033b42c05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:52.108970 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432bc81-974c-4315-bce7-a36033b42c05 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:52.117113 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 209/436] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Sep 7 15:42:51 2022] GET /identity/v3/role_assignments?group.id=d1727dcecb2a4cd792462a4ac6da11b8&scope.project.id=6e5edf54975843879025d05c7e7a65d7&role.id=ce978876ff724bf3b4101c9fd4d2d842 => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:42:52.128020 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432bc81-974c-4315-bce7-a36033b42c05 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:52.144203 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a953b6-0d79-4d19-8d65-ff6253f87e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:52.144834 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a953b6-0d79-4d19-8d65-ff6253f87e93 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:52.145118 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a953b6-0d79-4d19-8d65-ff6253f87e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:52.145392 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a953b6-0d79-4d19-8d65-ff6253f87e93 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:52.146076 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a953b6-0d79-4d19-8d65-ff6253f87e93 None admin] RBAC: Adding query filter params (name=member) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:52.146480 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a953b6-0d79-4d19-8d65-ff6253f87e93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:52.147942 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a953b6-0d79-4d19-8d65-ff6253f87e93 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:52.159316 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 228/437] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 7 15:42:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:52.165580 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a953b6-0d79-4d19-8d65-ff6253f87e93 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:52.248522 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:52.252686 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:52.277391 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432bc81-974c-4315-bce7-a36033b42c05 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:52.307841 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a953b6-0d79-4d19-8d65-ff6253f87e93 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:52.330335 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff432db0-6b93-4c93-b048-f404fdc675e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:52.331033 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff432db0-6b93-4c93-b048-f404fdc675e7 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:52.331318 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff432db0-6b93-4c93-b048-f404fdc675e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:52.331595 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff432db0-6b93-4c93-b048-f404fdc675e7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:52.346380 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff432db0-6b93-4c93-b048-f404fdc675e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:42:52.351819 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-ff432db0-6b93-4c93-b048-f404fdc675e7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 15:42:52.351819 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:52.351819 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:42:52.351819 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:42:52.351819 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:42:52.351819 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:42:52.351819 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:42:52.351819 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:42:52.351819 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:42:52.351819 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:42:52.351819 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:42:52.351819 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:42:52.351819 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:42:52.351819 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:42:52.351819 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:42:52.351819 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:42:52.352722 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:42:52.352722 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:42:52.352722 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:42:52.352722 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:42:52.352722 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:42:52.352722 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:42:52.352722 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:42:52.352722 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:42:52.352722 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:42:52.352722 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:42:52.352722 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:42:52.352722 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:42:52.352722 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:42:52.352722 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:42:52.352722 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:42:52.352722 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:42:52.354203 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:42:52.354203 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:42:52.354203 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:42:52.354203 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:42:52.354203 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:42:52.354203 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:42:52.354203 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:42:52.354203 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:42:52.354203 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:42:52.354203 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:42:52.354203 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 15:42:52.354203 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:42:52.354203 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 210/438] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 7 15:42:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:42:52.354862 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7fc728-6f3c-4dee-be8c-888d6bf94276 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:52.354862 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7fc728-6f3c-4dee-be8c-888d6bf94276 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:52.355206 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7fc728-6f3c-4dee-be8c-888d6bf94276 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:52.356742 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 211/439] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:42:52.358721 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6f16b-fa1a-47f0-826f-9a7f5326d68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:52.359344 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6f16b-fa1a-47f0-826f-9a7f5326d68b None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:52.359630 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6f16b-fa1a-47f0-826f-9a7f5326d68b None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:52.359906 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6f16b-fa1a-47f0-826f-9a7f5326d68b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:52.362010 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7fc728-6f3c-4dee-be8c-888d6bf94276 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:52.447182 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf6f16b-fa1a-47f0-826f-9a7f5326d68b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:52.450839 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf6f16b-fa1a-47f0-826f-9a7f5326d68b None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:52.496250 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7fc728-6f3c-4dee-be8c-888d6bf94276 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:52.515331 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:52.537934 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d878ece-7b9b-49c6-abf9-4515cac83016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:52.538486 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d878ece-7b9b-49c6-abf9-4515cac83016 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:52.538770 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d878ece-7b9b-49c6-abf9-4515cac83016 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:52.539050 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d878ece-7b9b-49c6-abf9-4515cac83016 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:52.539718 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d878ece-7b9b-49c6-abf9-4515cac83016 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:52.540452 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d878ece-7b9b-49c6-abf9-4515cac83016 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:52.541835 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d878ece-7b9b-49c6-abf9-4515cac83016 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:52.551574 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 212/440] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:42:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:52.553167 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b3e34-3a82-40bb-ac8f-5e5a409108c2 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:52.553454 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b3e34-3a82-40bb-ac8f-5e5a409108c2 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:52.553728 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b3e34-3a82-40bb-ac8f-5e5a409108c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:52.561892 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:52.570404 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 229/441] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:42:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 07 15:42:52.571272 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6f16b-fa1a-47f0-826f-9a7f5326d68b None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:52.574267 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-089b3e34-3a82-40bb-ac8f-5e5a409108c2 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:52.576185 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-089b3e34-3a82-40bb-ac8f-5e5a409108c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:52.652277 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 213/442] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:42:52.653203 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b3e34-3a82-40bb-ac8f-5e5a409108c2 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:52.675610 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6f16b-fa1a-47f0-826f-9a7f5326d68b None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:52.713557 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946bca30-05a7-4da7-99b0-b10ac6dbdee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:52.714214 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946bca30-05a7-4da7-99b0-b10ac6dbdee6 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:52.714502 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946bca30-05a7-4da7-99b0-b10ac6dbdee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:52.714892 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946bca30-05a7-4da7-99b0-b10ac6dbdee6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:52.741637 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:52.767559 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b3e34-3a82-40bb-ac8f-5e5a409108c2 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:52.790302 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946bca30-05a7-4da7-99b0-b10ac6dbdee6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:52.791971 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946bca30-05a7-4da7-99b0-b10ac6dbdee6 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:52.803450 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7d211-c1f6-4611-a20a-bc69a87906e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:52.804080 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7d211-c1f6-4611-a20a-bc69a87906e0 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:52.804355 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7d211-c1f6-4611-a20a-bc69a87906e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:52.804625 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7d211-c1f6-4611-a20a-bc69a87906e0 None admin] PATH_INFO: `/v3/projects/d428d47056754be5930f84ee53d099af` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:52.805731 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f7d211-c1f6-4611-a20a-bc69a87906e0 None admin] RBAC: Authorizing `identity:get_project(project_id=d428d47056754be5930f84ee53d099af)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:52.807181 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f7d211-c1f6-4611-a20a-bc69a87906e0 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:52.808773 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 214/443] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 7 15:42:52 2022] GET /identity/v3/projects/d428d47056754be5930f84ee53d099af => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:52.814976 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7d211-c1f6-4611-a20a-bc69a87906e0 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:52.817721 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:52.906136 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 230/444] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:42:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:42:52.911587 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946bca30-05a7-4da7-99b0-b10ac6dbdee6 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:52.926625 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7d211-c1f6-4611-a20a-bc69a87906e0 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:52.959964 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8cb97b-4a07-4e4f-99da-110467acda1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:52.960609 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8cb97b-4a07-4e4f-99da-110467acda1a None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:52.960888 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8cb97b-4a07-4e4f-99da-110467acda1a None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:52.961159 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8cb97b-4a07-4e4f-99da-110467acda1a None admin] PATH_INFO: `/v3/groups/d1727dcecb2a4cd792462a4ac6da11b8` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:52.962285 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8cb97b-4a07-4e4f-99da-110467acda1a None admin] RBAC: Authorizing `identity:get_group(group_id=d1727dcecb2a4cd792462a4ac6da11b8)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:52.963784 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8cb97b-4a07-4e4f-99da-110467acda1a None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:52.965255 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 215/445] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Sep 7 15:42:52 2022] GET /identity/v3/groups/d1727dcecb2a4cd792462a4ac6da11b8 => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:42:52.966317 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:52.966785 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8cb97b-4a07-4e4f-99da-110467acda1a None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:53.014609 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946bca30-05a7-4da7-99b0-b10ac6dbdee6 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:53.038687 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:53.052330 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53368e26-84f9-418f-8ee6-9132a89f405c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:53.052955 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53368e26-84f9-418f-8ee6-9132a89f405c None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:53.053230 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53368e26-84f9-418f-8ee6-9132a89f405c None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:53.053496 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53368e26-84f9-418f-8ee6-9132a89f405c None admin] PATH_INFO: `/v3/projects/d428d47056754be5930f84ee53d099af` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:53.054633 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53368e26-84f9-418f-8ee6-9132a89f405c None admin] RBAC: Authorizing `identity:get_project(project_id=d428d47056754be5930f84ee53d099af)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:53.056054 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53368e26-84f9-418f-8ee6-9132a89f405c None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:53.057642 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 231/446] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 7 15:42:52 2022] GET /identity/v3/projects/d428d47056754be5930f84ee53d099af => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:42:53.058409 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53368e26-84f9-418f-8ee6-9132a89f405c None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:53.074311 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8cb97b-4a07-4e4f-99da-110467acda1a None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:53.109198 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d61c9-90e1-46c9-b628-f443132e6747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:53.109825 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d61c9-90e1-46c9-b628-f443132e6747 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:53.110117 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d61c9-90e1-46c9-b628-f443132e6747 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:53.110418 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d61c9-90e1-46c9-b628-f443132e6747 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:53.120318 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78d61c9-90e1-46c9-b628-f443132e6747 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:42:53.126131 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-e78d61c9-90e1-46c9-b628-f443132e6747 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:42:53.126131 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:53.126131 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:42:53.126131 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:42:53.126131 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:42:53.126131 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:42:53.126131 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:42:53.126131 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:42:53.126131 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:42:53.126131 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:42:53.126131 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:42:53.126131 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:42:53.126131 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:42:53.126131 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:42:53.126131 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:42:53.126131 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:42:53.127051 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:42:53.127051 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:42:53.127051 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:42:53.127051 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:42:53.127051 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:42:53.127051 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:42:53.127051 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:42:53.127051 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:42:53.127051 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:42:53.127051 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:42:53.127051 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:42:53.127051 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:42:53.127051 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:42:53.127051 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:42:53.127051 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:42:53.127051 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:42:53.127874 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:42:53.127874 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:42:53.127874 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:42:53.127874 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:42:53.127874 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:42:53.127874 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:42:53.127874 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:42:53.127874 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:42:53.127874 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:42:53.127874 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:42:53.127874 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:42:53.127874 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:42:53.127874 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 216/447] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 7 15:42:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:42:53.128541 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d61c9-90e1-46c9-b628-f443132e6747 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:53.158471 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53368e26-84f9-418f-8ee6-9132a89f405c None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:53.180400 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:53.193296 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7872e5-b56a-4653-af25-2882fd080827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:53.193973 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7872e5-b56a-4653-af25-2882fd080827 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:53.194287 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7872e5-b56a-4653-af25-2882fd080827 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:53.194567 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7872e5-b56a-4653-af25-2882fd080827 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:53.195289 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7872e5-b56a-4653-af25-2882fd080827 None admin] RBAC: Adding query filter params (group.id=d1727dcecb2a4cd792462a4ac6da11b8, role.id=d45e39b4ad4e4ce782ec649246438663, scope.project.id=d428d47056754be5930f84ee53d099af) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:53.195600 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7872e5-b56a-4653-af25-2882fd080827 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:53.197041 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7872e5-b56a-4653-af25-2882fd080827 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:53.203658 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 232/448] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Sep 7 15:42:53 2022] GET /identity/v3/role_assignments?group.id=d1727dcecb2a4cd792462a4ac6da11b8&scope.project.id=d428d47056754be5930f84ee53d099af&role.id=d45e39b4ad4e4ce782ec649246438663 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:53.204430 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7872e5-b56a-4653-af25-2882fd080827 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:53.240728 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d61c9-90e1-46c9-b628-f443132e6747 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:53.275307 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:53.282581 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f64f25-0d18-4973-aacb-921930f64c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:53.283240 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f64f25-0d18-4973-aacb-921930f64c7a None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:53.283523 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f64f25-0d18-4973-aacb-921930f64c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:53.283794 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f64f25-0d18-4973-aacb-921930f64c7a None admin] PATH_INFO: `/v3/groups/d1727dcecb2a4cd792462a4ac6da11b8` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:53.284990 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f64f25-0d18-4973-aacb-921930f64c7a None admin] RBAC: Authorizing `identity:get_group(group_id=d1727dcecb2a4cd792462a4ac6da11b8)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:53.286489 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f64f25-0d18-4973-aacb-921930f64c7a None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:53.288309 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 217/449] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Sep 7 15:42:53 2022] GET /identity/v3/groups/d1727dcecb2a4cd792462a4ac6da11b8 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:53.294522 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f64f25-0d18-4973-aacb-921930f64c7a None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:53.330098 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7872e5-b56a-4653-af25-2882fd080827 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:53.373182 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d9ed5d-1392-460f-a171-6623f442dadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:53.373798 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d9ed5d-1392-460f-a171-6623f442dadc None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:53.374081 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d9ed5d-1392-460f-a171-6623f442dadc None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:53.374081 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d9ed5d-1392-460f-a171-6623f442dadc None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:53.375045 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d9ed5d-1392-460f-a171-6623f442dadc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:53.375352 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d9ed5d-1392-460f-a171-6623f442dadc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:53.377142 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d9ed5d-1392-460f-a171-6623f442dadc None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:53.387524 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 233/450] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:42:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:53.393295 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d9ed5d-1392-460f-a171-6623f442dadc None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:53.413626 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f64f25-0d18-4973-aacb-921930f64c7a None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:53.457421 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:53.458650 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e9c90c-698a-44aa-b3f0-74f61e614797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:53.459343 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9c90c-698a-44aa-b3f0-74f61e614797 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:53.459541 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9c90c-698a-44aa-b3f0-74f61e614797 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:53.459813 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9c90c-698a-44aa-b3f0-74f61e614797 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:53.460702 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e9c90c-698a-44aa-b3f0-74f61e614797 None admin] RBAC: Adding query filter params (group.id=d1727dcecb2a4cd792462a4ac6da11b8, role.id=ce978876ff724bf3b4101c9fd4d2d842, scope.project.id=d428d47056754be5930f84ee53d099af) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:53.461055 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e9c90c-698a-44aa-b3f0-74f61e614797 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:53.462518 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e9c90c-698a-44aa-b3f0-74f61e614797 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:53.469295 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 218/451] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Sep 7 15:42:53 2022] GET /identity/v3/role_assignments?group.id=d1727dcecb2a4cd792462a4ac6da11b8&scope.project.id=d428d47056754be5930f84ee53d099af&role.id=ce978876ff724bf3b4101c9fd4d2d842 => generated 611 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:42:53.519331 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d9ed5d-1392-460f-a171-6623f442dadc None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:53.557849 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f10594e-a037-407b-a727-4426773f0ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:53.558801 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10594e-a037-407b-a727-4426773f0ebc None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:53.559067 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10594e-a037-407b-a727-4426773f0ebc None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:53.559408 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10594e-a037-407b-a727-4426773f0ebc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:53.643648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f10594e-a037-407b-a727-4426773f0ebc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:53.645733 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f10594e-a037-407b-a727-4426773f0ebc None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:53.694636 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:53.748595 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 234/452] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:42:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 07 15:42:53.754567 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e9c90c-698a-44aa-b3f0-74f61e614797 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:53.819353 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:53.860450 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e9c90c-698a-44aa-b3f0-74f61e614797 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:53.892973 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288687bd-ecea-4383-bd77-d7b2a999882e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:53.893585 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288687bd-ecea-4383-bd77-d7b2a999882e None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:53.893867 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288687bd-ecea-4383-bd77-d7b2a999882e None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:53.894137 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288687bd-ecea-4383-bd77-d7b2a999882e None admin] PATH_INFO: `/v3/projects/ddba81771a254b1699bec72cf0d93f2d` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:53.895252 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288687bd-ecea-4383-bd77-d7b2a999882e None admin] RBAC: Authorizing `identity:get_project(project_id=ddba81771a254b1699bec72cf0d93f2d)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:53.896709 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288687bd-ecea-4383-bd77-d7b2a999882e None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:53.898308 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 219/453] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 7 15:42:53 2022] GET /identity/v3/projects/ddba81771a254b1699bec72cf0d93f2d => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:53.904617 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f10594e-a037-407b-a727-4426773f0ebc None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:54.002436 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f10594e-a037-407b-a727-4426773f0ebc None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:54.035778 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c971a1c-12dc-4bb8-a9ab-7562f48e36cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:54.036410 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c971a1c-12dc-4bb8-a9ab-7562f48e36cf None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:54.036694 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c971a1c-12dc-4bb8-a9ab-7562f48e36cf None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:54.036973 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c971a1c-12dc-4bb8-a9ab-7562f48e36cf None admin] PATH_INFO: `/v3/groups/08bda745afdb4ff38427273285b69aa7` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:54.038076 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c971a1c-12dc-4bb8-a9ab-7562f48e36cf None admin] RBAC: Authorizing `identity:get_group(group_id=08bda745afdb4ff38427273285b69aa7)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:54.039543 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c971a1c-12dc-4bb8-a9ab-7562f48e36cf None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:54.041094 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 235/454] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Sep 7 15:42:53 2022] GET /identity/v3/groups/08bda745afdb4ff38427273285b69aa7 => generated 229 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:54.047112 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288687bd-ecea-4383-bd77-d7b2a999882e None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:54.144849 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288687bd-ecea-4383-bd77-d7b2a999882e None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:54.172949 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:54.178716 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55199632-7fbe-4298-8ca8-26721d38c9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:54.179301 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55199632-7fbe-4298-8ca8-26721d38c9ea None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:54.179580 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55199632-7fbe-4298-8ca8-26721d38c9ea None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:54.179849 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55199632-7fbe-4298-8ca8-26721d38c9ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:54.180554 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55199632-7fbe-4298-8ca8-26721d38c9ea None admin] RBAC: Adding query filter params (group.id=08bda745afdb4ff38427273285b69aa7, role.id=61605ebf17e643258730e55bf6db15ad, scope.project.id=ddba81771a254b1699bec72cf0d93f2d) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:54.180856 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55199632-7fbe-4298-8ca8-26721d38c9ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:54.182298 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55199632-7fbe-4298-8ca8-26721d38c9ea None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:54.188062 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 220/455] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Sep 7 15:42:54 2022] GET /identity/v3/role_assignments?group.id=08bda745afdb4ff38427273285b69aa7&scope.project.id=ddba81771a254b1699bec72cf0d93f2d&role.id=61605ebf17e643258730e55bf6db15ad => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:56.864017 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a38b3a2-9c4e-4439-b899-2506a295fb97 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:56.864017 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a38b3a2-9c4e-4439-b899-2506a295fb97 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:56.864017 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a38b3a2-9c4e-4439-b899-2506a295fb97 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:56.864017 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 236/456] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:42:56.875746 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e6501-79b1-4f20-a6cc-f0c2a6119855 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:56.876194 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e6501-79b1-4f20-a6cc-f0c2a6119855 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:56.876374 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e6501-79b1-4f20-a6cc-f0c2a6119855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:56.896766 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-e34e6501-79b1-4f20-a6cc-f0c2a6119855 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:56.897974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-e34e6501-79b1-4f20-a6cc-f0c2a6119855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:56.999367 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 221/457] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:42:57.102309 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f99b5-9062-4dac-8197-632f707600ff None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:57.104215 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f99b5-9062-4dac-8197-632f707600ff None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:57.104215 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f99b5-9062-4dac-8197-632f707600ff None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:57.104668 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 237/458] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:42:57.119592 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73692b2d-3fc7-4d09-b37a-241eb87f2396 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:57.119818 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73692b2d-3fc7-4d09-b37a-241eb87f2396 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:57.120095 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73692b2d-3fc7-4d09-b37a-241eb87f2396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:57.147593 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-73692b2d-3fc7-4d09-b37a-241eb87f2396 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:57.148794 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-73692b2d-3fc7-4d09-b37a-241eb87f2396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:57.167786 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b07ac-fbb7-4da3-8b25-d76cf127a068 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:57.168389 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b07ac-fbb7-4da3-8b25-d76cf127a068 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:57.168954 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b07ac-fbb7-4da3-8b25-d76cf127a068 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:57.170906 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 238/459] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:42:57.177160 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea70268-bb72-45ce-bb18-c513928a51ab None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:57.177448 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea70268-bb72-45ce-bb18-c513928a51ab None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:57.177726 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea70268-bb72-45ce-bb18-c513928a51ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:57.223473 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-5ea70268-bb72-45ce-bb18-c513928a51ab None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:57.224702 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-5ea70268-bb72-45ce-bb18-c513928a51ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:57.252092 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 222/460] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:42:57.254517 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:57.361604 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 239/461] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:42:57.381976 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73692b2d-3fc7-4d09-b37a-241eb87f2396 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:57.440037 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030378fb-b10b-4380-b721-4e55da2e5624 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:57.440544 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030378fb-b10b-4380-b721-4e55da2e5624 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:57.440960 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030378fb-b10b-4380-b721-4e55da2e5624 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:57.442694 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 240/462] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:42:57.447446 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab491f-e2c8-4475-a1e2-834c77f0ba01 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:57.447914 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab491f-e2c8-4475-a1e2-834c77f0ba01 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:57.448331 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab491f-e2c8-4475-a1e2-834c77f0ba01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:57.458574 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:57.494152 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-ffab491f-e2c8-4475-a1e2-834c77f0ba01 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:57.495599 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-ffab491f-e2c8-4475-a1e2-834c77f0ba01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:57.505179 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73692b2d-3fc7-4d09-b37a-241eb87f2396 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:57.541798 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73560c-14a6-4000-b9d6-fcbd04a33ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:57.542733 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73560c-14a6-4000-b9d6-fcbd04a33ff9 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:57.544136 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73560c-14a6-4000-b9d6-fcbd04a33ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:57.544614 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73560c-14a6-4000-b9d6-fcbd04a33ff9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:57.555368 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a73560c-14a6-4000-b9d6-fcbd04a33ff9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:57.557010 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a73560c-14a6-4000-b9d6-fcbd04a33ff9 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:57.573376 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-4a73560c-14a6-4000-b9d6-fcbd04a33ff9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:42:57.573376 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:57.573376 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:42:57.573376 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:42:57.573376 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:42:57.573376 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:42:57.573376 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:42:57.573376 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:42:57.573376 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:42:57.573376 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:42:57.573376 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:42:57.573376 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:42:57.573376 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:42:57.573376 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:42:57.573376 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:42:57.573376 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:42:57.574347 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:42:57.574347 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:42:57.574347 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:42:57.574347 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:42:57.574347 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:42:57.574347 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:42:57.574347 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:42:57.574347 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:42:57.574347 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:42:57.574347 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:42:57.574347 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:42:57.574347 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:42:57.574347 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:42:57.574347 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:42:57.574347 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:42:57.574347 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:42:57.574347 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:42:57.575816 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:42:57.575816 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:42:57.575816 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:42:57.578008 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 223/463] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:42:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:42:57.583558 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73560c-14a6-4000-b9d6-fcbd04a33ff9 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:57.640359 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 241/464] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:42:57.641423 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab491f-e2c8-4475-a1e2-834c77f0ba01 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:57.709118 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73560c-14a6-4000-b9d6-fcbd04a33ff9 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:57.718985 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:57.733396 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:57.754489 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a1a3a4-70b8-4ca7-a9bd-4909b6beada7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:57.755638 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1a3a4-70b8-4ca7-a9bd-4909b6beada7 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:57.756101 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1a3a4-70b8-4ca7-a9bd-4909b6beada7 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:57.756765 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1a3a4-70b8-4ca7-a9bd-4909b6beada7 None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:57.757573 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a1a3a4-70b8-4ca7-a9bd-4909b6beada7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:57.758151 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a1a3a4-70b8-4ca7-a9bd-4909b6beada7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:57.760281 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a1a3a4-70b8-4ca7-a9bd-4909b6beada7 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:57.761910 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab491f-e2c8-4475-a1e2-834c77f0ba01 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:57.785148 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 224/465] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:42:57.786359 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a1a3a4-70b8-4ca7-a9bd-4909b6beada7 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:57.803140 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357d4c3-ce55-495f-b869-5e2f4f31548b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:57.804276 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357d4c3-ce55-495f-b869-5e2f4f31548b None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:57.804707 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357d4c3-ce55-495f-b869-5e2f4f31548b None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:57.805126 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357d4c3-ce55-495f-b869-5e2f4f31548b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:57.819295 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357d4c3-ce55-495f-b869-5e2f4f31548b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:57.821614 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357d4c3-ce55-495f-b869-5e2f4f31548b None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:57.841658 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-c357d4c3-ce55-495f-b869-5e2f4f31548b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:42:57.841658 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:57.841658 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:42:57.841658 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:42:57.841658 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:42:57.841658 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:42:57.841658 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:42:57.841658 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:42:57.841658 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:42:57.841658 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:42:57.841658 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:42:57.841658 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:42:57.841658 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:42:57.841658 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:42:57.841658 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:42:57.841658 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:42:57.842793 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:42:57.842793 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:42:57.842793 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:42:57.842793 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:42:57.842793 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:42:57.842793 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:42:57.842793 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:42:57.842793 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:42:57.842793 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:42:57.842793 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:42:57.842793 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:42:57.842793 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:42:57.842793 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:42:57.842793 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:42:57.842793 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:42:57.842793 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:42:57.842793 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:42:57.843834 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:42:57.843834 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:42:57.843834 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:42:57.845721 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 242/466] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:42:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:42:57.846653 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357d4c3-ce55-495f-b869-5e2f4f31548b None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:57.915752 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a1a3a4-70b8-4ca7-a9bd-4909b6beada7 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:57.957054 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb57821-5221-4f74-9527-3f3e23408804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:57.957674 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb57821-5221-4f74-9527-3f3e23408804 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:57.957957 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb57821-5221-4f74-9527-3f3e23408804 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:57.958263 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb57821-5221-4f74-9527-3f3e23408804 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:57.960524 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357d4c3-ce55-495f-b869-5e2f4f31548b None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:57.969333 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb57821-5221-4f74-9527-3f3e23408804 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:57.970830 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb57821-5221-4f74-9527-3f3e23408804 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:57.986672 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-5eb57821-5221-4f74-9527-3f3e23408804 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:42:57.986672 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:57.986672 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:42:57.986672 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:42:57.986672 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:42:57.986672 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:42:57.986672 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:42:57.986672 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:42:57.986672 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:42:57.986672 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:42:57.986672 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:42:57.986672 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:42:57.986672 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:42:57.986672 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:42:57.986672 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:42:57.986672 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:42:57.987756 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:42:57.987756 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:42:57.987756 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:42:57.987756 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:42:57.987756 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:42:57.987756 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:42:57.987756 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:42:57.987756 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:42:57.987756 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:42:57.987756 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:42:57.987756 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:42:57.987756 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:42:57.987756 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:42:57.987756 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:42:57.987756 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:42:57.987756 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:42:57.987756 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:42:57.988936 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:42:57.988936 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:42:57.988936 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:42:57.988936 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 225/467] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:42:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:42:57.988936 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb57821-5221-4f74-9527-3f3e23408804 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:57.990515 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:58.002716 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5293af57-db88-48b4-9b48-bb23ce2ea34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:58.003669 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293af57-db88-48b4-9b48-bb23ce2ea34b None admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:58.004163 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293af57-db88-48b4-9b48-bb23ce2ea34b None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:58.004645 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293af57-db88-48b4-9b48-bb23ce2ea34b None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:58.005362 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5293af57-db88-48b4-9b48-bb23ce2ea34b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:58.006871 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5293af57-db88-48b4-9b48-bb23ce2ea34b None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:58.011874 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:58.038650 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 243/468] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Sep 7 15:42:57 2022] POST /identity/v3/users => generated 248 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:42:58.039776 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5293af57-db88-48b4-9b48-bb23ce2ea34b None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:58.105869 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb57821-5221-4f74-9527-3f3e23408804 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:58.145650 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78314634-8538-4391-9d3c-cd8b4ff938c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:58.146463 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78314634-8538-4391-9d3c-cd8b4ff938c4 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:58.147037 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78314634-8538-4391-9d3c-cd8b4ff938c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:58.147519 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78314634-8538-4391-9d3c-cd8b4ff938c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:58.148387 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78314634-8538-4391-9d3c-cd8b4ff938c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:58.148913 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78314634-8538-4391-9d3c-cd8b4ff938c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:58.150534 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78314634-8538-4391-9d3c-cd8b4ff938c4 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:58.164954 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 226/469] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:58.166265 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78314634-8538-4391-9d3c-cd8b4ff938c4 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:58.195742 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5293af57-db88-48b4-9b48-bb23ce2ea34b None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:58.236610 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c65d4-903d-407e-a69a-a24cb66d65b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:58.237293 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c65d4-903d-407e-a69a-a24cb66d65b7 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:58.237579 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c65d4-903d-407e-a69a-a24cb66d65b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:58.237855 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c65d4-903d-407e-a69a-a24cb66d65b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:58.250211 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c65d4-903d-407e-a69a-a24cb66d65b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:58.252136 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c65d4-903d-407e-a69a-a24cb66d65b7 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:58.261659 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:58.271320 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-502c65d4-903d-407e-a69a-a24cb66d65b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:42:58.271320 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:58.271320 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:42:58.271320 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:42:58.271320 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:42:58.271320 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:42:58.271320 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:42:58.271320 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:42:58.271320 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:42:58.271320 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:42:58.271320 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:42:58.271320 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:42:58.271320 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:42:58.271320 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:42:58.271320 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:42:58.271320 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:42:58.272275 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:42:58.272275 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:42:58.272275 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:42:58.272275 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:42:58.272275 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:42:58.272275 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:42:58.272275 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:42:58.272275 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:42:58.272275 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:42:58.272275 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:42:58.272275 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:42:58.272275 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:42:58.272275 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:42:58.272275 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:42:58.272275 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:42:58.272275 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:42:58.272275 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:42:58.273164 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:42:58.273164 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:42:58.273164 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:42:58.273328 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 244/470] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:42:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:42:58.274083 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c65d4-903d-407e-a69a-a24cb66d65b7 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:58.296987 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78314634-8538-4391-9d3c-cd8b4ff938c4 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:58.322234 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:58.346408 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e8275-522e-48c0-97fa-3f843d809bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:58.349911 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e8275-522e-48c0-97fa-3f843d809bac None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:58.349911 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e8275-522e-48c0-97fa-3f843d809bac None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:58.349911 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e8275-522e-48c0-97fa-3f843d809bac None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:58.349911 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e8275-522e-48c0-97fa-3f843d809bac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:58.349911 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e8275-522e-48c0-97fa-3f843d809bac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:58.352010 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e8275-522e-48c0-97fa-3f843d809bac None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:58.365278 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 227/471] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:42:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:58.366212 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e8275-522e-48c0-97fa-3f843d809bac None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:58.410780 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c65d4-903d-407e-a69a-a24cb66d65b7 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:58.451476 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025206cc-c6ba-49ef-835a-ad19aa7e0bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:58.452991 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025206cc-c6ba-49ef-835a-ad19aa7e0bd2 None admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:58.453276 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025206cc-c6ba-49ef-835a-ad19aa7e0bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:58.453551 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025206cc-c6ba-49ef-835a-ad19aa7e0bd2 None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:58.454232 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025206cc-c6ba-49ef-835a-ad19aa7e0bd2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:58.455717 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025206cc-c6ba-49ef-835a-ad19aa7e0bd2 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:58.493552 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e8275-522e-48c0-97fa-3f843d809bac None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:58.533177 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 245/472] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Sep 7 15:42:58 2022] POST /identity/v3/users => generated 248 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:42:58.533177 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025206cc-c6ba-49ef-835a-ad19aa7e0bd2 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:58.566219 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0998b1c5-5b31-4116-afff-dee30fbca98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:58.566219 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998b1c5-5b31-4116-afff-dee30fbca98e None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:58.566219 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998b1c5-5b31-4116-afff-dee30fbca98e None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:58.566219 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998b1c5-5b31-4116-afff-dee30fbca98e None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:58.566636 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0998b1c5-5b31-4116-afff-dee30fbca98e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:58.566636 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0998b1c5-5b31-4116-afff-dee30fbca98e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:58.566636 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0998b1c5-5b31-4116-afff-dee30fbca98e None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:58.590207 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:58.602202 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 228/473] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:42:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:42:58.610211 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0998b1c5-5b31-4116-afff-dee30fbca98e None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:58.731309 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:58.749927 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025206cc-c6ba-49ef-835a-ad19aa7e0bd2 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:58.766286 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0998b1c5-5b31-4116-afff-dee30fbca98e None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:58.813012 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d77647e-50ff-4328-b7d6-9a66cacc6634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:58.813631 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d77647e-50ff-4328-b7d6-9a66cacc6634 None admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:58.813906 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d77647e-50ff-4328-b7d6-9a66cacc6634 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:58.814210 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d77647e-50ff-4328-b7d6-9a66cacc6634 None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:58.814861 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d77647e-50ff-4328-b7d6-9a66cacc6634 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:58.817031 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d77647e-50ff-4328-b7d6-9a66cacc6634 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:58.832477 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380503b-b98a-470f-aa63-07b90f5c8960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:58.834701 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380503b-b98a-470f-aa63-07b90f5c8960 None admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:58.835659 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380503b-b98a-470f-aa63-07b90f5c8960 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:58.836167 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380503b-b98a-470f-aa63-07b90f5c8960 None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:58.836807 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380503b-b98a-470f-aa63-07b90f5c8960 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:58.839012 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380503b-b98a-470f-aa63-07b90f5c8960 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:58.856537 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 229/474] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Sep 7 15:42:58 2022] POST /identity/v3/users => generated 249 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:42:58.856537 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108ae02-2196-4a78-82ef-e78c1db020d8 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:58.856537 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108ae02-2196-4a78-82ef-e78c1db020d8 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:58.856537 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108ae02-2196-4a78-82ef-e78c1db020d8 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:58.858775 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 230/475] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:42:58.864512 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d12d8b-53ce-4c5c-95e3-b146c53e2098 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:58.864804 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d12d8b-53ce-4c5c-95e3-b146c53e2098 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:58.865228 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d12d8b-53ce-4c5c-95e3-b146c53e2098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:58.877531 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 246/476] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Sep 7 15:42:58 2022] POST /identity/v3/users => generated 246 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:42:58.891690 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-b5d12d8b-53ce-4c5c-95e3-b146c53e2098 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:42:58.893368 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b5d12d8b-53ce-4c5c-95e3-b146c53e2098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:42:58.970466 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:58.991300 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 231/477] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:42:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:42:59.347915 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380503b-b98a-470f-aa63-07b90f5c8960 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:59.457710 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380503b-b98a-470f-aa63-07b90f5c8960 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:59.494362 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff60f35-b962-4007-8032-fdb41abdf3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:59.495345 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff60f35-b962-4007-8032-fdb41abdf3b0 None admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:59.495834 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff60f35-b962-4007-8032-fdb41abdf3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:59.496307 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff60f35-b962-4007-8032-fdb41abdf3b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:59.497894 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff60f35-b962-4007-8032-fdb41abdf3b0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:59.499593 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff60f35-b962-4007-8032-fdb41abdf3b0 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:59.511269 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.sql.core [None req-9ff60f35-b962-4007-8032-fdb41abdf3b0 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 07 15:42:59.511269 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 07 15:42:59.511269 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [parameters: {'id': 'c27fb280cd5941df83e25f3722c56fcb', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 07 15:42:59.511269 dv-cinder-853315-8-smb devstack@keystone.service[81501]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81501) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 07 15:42:59.531209 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-9ff60f35-b962-4007-8032-fdb41abdf3b0 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 07 15:42:59.531209 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:59.531209 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 07 15:42:59.531209 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 07 15:42:59.531209 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 07 15:42:59.531209 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 07 15:42:59.531209 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 07 15:42:59.531209 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application result = self._query(query) Sep 07 15:42:59.531209 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 07 15:42:59.531209 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application conn.query(q) Sep 07 15:42:59.531209 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 07 15:42:59.531209 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 07 15:42:59.531209 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 07 15:42:59.531209 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application result.read() Sep 07 15:42:59.531209 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 07 15:42:59.532149 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 07 15:42:59.532149 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 07 15:42:59.532149 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 07 15:42:59.532149 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 07 15:42:59.532149 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 07 15:42:59.532149 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 07 15:42:59.532149 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 07 15:42:59.532149 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 07 15:42:59.532149 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:42:59.532149 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 07 15:42:59.532149 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:42:59.532149 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:59.532149 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 07 15:42:59.532149 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 07 15:42:59.532149 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 07 15:42:59.532149 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return ref.to_dict() Sep 07 15:42:59.532149 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 07 15:42:59.532149 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application next(self.gen) Sep 07 15:42:59.533037 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 07 15:42:59.533037 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application yield resource Sep 07 15:42:59.533037 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 07 15:42:59.533037 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application next(self.gen) Sep 07 15:42:59.533037 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 07 15:42:59.533037 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self.session.rollback() Sep 07 15:42:59.533037 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 15:42:59.533037 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self.force_reraise() Sep 07 15:42:59.533037 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 15:42:59.533037 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise self.value Sep 07 15:42:59.533037 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 07 15:42:59.533037 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 07 15:42:59.533037 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 07 15:42:59.533037 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application session.commit() Sep 07 15:42:59.533037 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 07 15:42:59.533037 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 07 15:42:59.533037 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 07 15:42:59.533917 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._prepare_impl() Sep 07 15:42:59.533917 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 07 15:42:59.533917 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self.session.flush() Sep 07 15:42:59.533917 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 07 15:42:59.533917 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._flush(objects) Sep 07 15:42:59.533917 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 07 15:42:59.533917 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 07 15:42:59.533917 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 07 15:42:59.533917 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application compat.raise_( Sep 07 15:42:59.533917 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 07 15:42:59.533917 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception Sep 07 15:42:59.533917 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 07 15:42:59.533917 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application flush_context.execute() Sep 07 15:42:59.533917 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 07 15:42:59.533917 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rec.execute(self) Sep 07 15:42:59.533917 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 07 15:42:59.533917 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 07 15:42:59.534876 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 07 15:42:59.534876 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 07 15:42:59.534876 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 07 15:42:59.534876 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 07 15:42:59.534876 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 07 15:42:59.534876 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 07 15:42:59.534876 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 07 15:42:59.534876 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 07 15:42:59.534876 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 07 15:42:59.534876 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 07 15:42:59.534876 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 07 15:42:59.534876 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 07 15:42:59.534876 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 07 15:42:59.534876 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 07 15:42:59.534876 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 07 15:42:59.534876 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception Sep 07 15:42:59.535714 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 07 15:42:59.535714 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 07 15:42:59.535714 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 07 15:42:59.535714 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 07 15:42:59.535714 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 07 15:42:59.535714 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application result = self._query(query) Sep 07 15:42:59.535714 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 07 15:42:59.535714 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application conn.query(q) Sep 07 15:42:59.535714 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 07 15:42:59.535714 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 07 15:42:59.535714 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 07 15:42:59.535714 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application result.read() Sep 07 15:42:59.535714 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 07 15:42:59.535714 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 07 15:42:59.535714 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 07 15:42:59.535714 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 07 15:42:59.536511 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 07 15:42:59.536511 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 07 15:42:59.536511 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 07 15:42:59.536511 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 07 15:42:59.536511 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 07 15:42:59.536511 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 07 15:42:59.536511 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [parameters: {'id': 'c27fb280cd5941df83e25f3722c56fcb', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 07 15:42:59.536511 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 07 15:42:59.536511 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:42:59.536511 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:42:59.536511 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:42:59.536511 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:59.536511 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:42:59.536511 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:42:59.536511 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:42:59.536511 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:42:59.537390 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:42:59.537390 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:42:59.537390 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:42:59.537390 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:42:59.537390 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:42:59.537390 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:42:59.537390 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 07 15:42:59.537390 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 07 15:42:59.537390 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:42:59.537390 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:42:59.537390 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 07 15:42:59.537390 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 07 15:42:59.537390 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 07 15:42:59.537390 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 07 15:42:59.537390 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 07 15:42:59.537390 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:42:59.541324 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 247/478] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Sep 7 15:42:59 2022] POST /identity/v3/roles => generated 144 bytes in 194 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:42:59.550009 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d12d8b-53ce-4c5c-95e3-b146c53e2098 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:59.694211 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d12d8b-53ce-4c5c-95e3-b146c53e2098 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:59.730228 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255699e9-34e1-40db-94d3-c28b25c03630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:59.730876 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255699e9-34e1-40db-94d3-c28b25c03630 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:59.731783 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255699e9-34e1-40db-94d3-c28b25c03630 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:59.732547 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255699e9-34e1-40db-94d3-c28b25c03630 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:59.743539 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255699e9-34e1-40db-94d3-c28b25c03630 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:42:59.748947 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-255699e9-34e1-40db-94d3-c28b25c03630 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 15:42:59.748947 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:42:59.748947 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:42:59.748947 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:42:59.748947 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:42:59.748947 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:42:59.748947 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:42:59.748947 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:42:59.748947 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:42:59.748947 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:42:59.748947 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:42:59.748947 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:42:59.748947 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:42:59.748947 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:42:59.748947 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:42:59.748947 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:42:59.749856 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:42:59.749856 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:42:59.749856 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:42:59.749856 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:42:59.749856 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:42:59.749856 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:42:59.749856 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:42:59.749856 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:42:59.749856 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:42:59.749856 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:42:59.749856 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:42:59.749856 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:42:59.749856 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:42:59.749856 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:42:59.749856 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:42:59.749856 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:42:59.750717 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:42:59.750717 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:42:59.750717 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:42:59.750717 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:42:59.750717 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:42:59.750717 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:42:59.750717 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:42:59.750717 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:42:59.750717 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:42:59.750717 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:42:59.750717 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 15:42:59.750717 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:42:59.750717 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 232/479] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 7 15:42:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:42:59.755988 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff60f35-b962-4007-8032-fdb41abdf3b0 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:42:59.773795 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:42:59.873626 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff60f35-b962-4007-8032-fdb41abdf3b0 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:42:59.912370 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa7b25-0e0f-42f3-a418-620ed8b802b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:42:59.913369 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa7b25-0e0f-42f3-a418-620ed8b802b2 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:42:59.913853 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa7b25-0e0f-42f3-a418-620ed8b802b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:42:59.914372 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa7b25-0e0f-42f3-a418-620ed8b802b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:42:59.915281 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa7b25-0e0f-42f3-a418-620ed8b802b2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:42:59.915826 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa7b25-0e0f-42f3-a418-620ed8b802b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:42:59.917500 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa7b25-0e0f-42f3-a418-620ed8b802b2 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:42:59.928264 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 248/480] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:42:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:00.563157 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5dcb7-db3f-4c3e-856f-3db81a23e1f8 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:00.564139 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5dcb7-db3f-4c3e-856f-3db81a23e1f8 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:00.564629 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5dcb7-db3f-4c3e-856f-3db81a23e1f8 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:00.566462 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 233/481] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:43:00.571639 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24600bd4-58e5-401c-b90f-33e9141bc1a4 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:00.572428 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24600bd4-58e5-401c-b90f-33e9141bc1a4 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:00.572934 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24600bd4-58e5-401c-b90f-33e9141bc1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:00.595269 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-24600bd4-58e5-401c-b90f-33e9141bc1a4 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:00.596754 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-24600bd4-58e5-401c-b90f-33e9141bc1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:00.689034 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 249/482] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:43:01.219839 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5dcb7-db3f-4c3e-856f-3db81a23e1f8 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:01.286913 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:01.352764 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5dcb7-db3f-4c3e-856f-3db81a23e1f8 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:01.366116 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b72a64-1fd3-486b-8ff4-eb97969c2904 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:01.366518 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b72a64-1fd3-486b-8ff4-eb97969c2904 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:01.366876 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b72a64-1fd3-486b-8ff4-eb97969c2904 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:01.368544 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 250/483] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:43:01.373938 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c90781-d6b7-4a83-968f-bb89c3c1070a None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:01.374312 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c90781-d6b7-4a83-968f-bb89c3c1070a None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:01.374690 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c90781-d6b7-4a83-968f-bb89c3c1070a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:01.391343 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:01.392958 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ec2dd1-f3d8-4293-ac01-a1de6fd4d1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:01.394094 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec2dd1-f3d8-4293-ac01-a1de6fd4d1f0 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:01.394586 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec2dd1-f3d8-4293-ac01-a1de6fd4d1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:01.395033 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec2dd1-f3d8-4293-ac01-a1de6fd4d1f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:01.408027 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ec2dd1-f3d8-4293-ac01-a1de6fd4d1f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:43:01.413347 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-c6ec2dd1-f3d8-4293-ac01-a1de6fd4d1f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:43:01.413347 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:01.413347 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:01.413347 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:01.413347 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:01.413347 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:01.413347 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:01.413347 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:01.413347 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:01.413347 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:01.413347 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:01.413347 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:01.413347 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:43:01.413347 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:43:01.413347 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:43:01.413347 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:43:01.414266 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:43:01.414266 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:43:01.414266 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:43:01.414266 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:43:01.414266 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:01.414266 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:01.414266 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:01.414266 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:01.414266 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:01.414266 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:01.414266 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:01.414266 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:01.414266 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:01.414266 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:01.414266 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:01.414266 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:01.415053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:01.415053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:01.415053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:01.415053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:01.415053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:43:01.415053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:43:01.415053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:43:01.415053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:43:01.415053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:43:01.415053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:43:01.415053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:43:01.415053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:01.415657 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-e5c90781-d6b7-4a83-968f-bb89c3c1070a None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:01.417074 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-e5c90781-d6b7-4a83-968f-bb89c3c1070a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:01.418033 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 234/484] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 7 15:43:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:01.426213 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ec2dd1-f3d8-4293-ac01-a1de6fd4d1f0 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:01.531732 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 251/485] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:43:01.571607 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ec2dd1-f3d8-4293-ac01-a1de6fd4d1f0 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:01.579170 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:01.630993 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6a851-12eb-401c-8cd6-c166c53614cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:01.631605 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6a851-12eb-401c-8cd6-c166c53614cc None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:01.631886 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6a851-12eb-401c-8cd6-c166c53614cc None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:01.632161 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6a851-12eb-401c-8cd6-c166c53614cc None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:01.632832 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6a851-12eb-401c-8cd6-c166c53614cc None admin] RBAC: Adding query filter params (name=service) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:01.633134 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6a851-12eb-401c-8cd6-c166c53614cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:01.634540 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6a851-12eb-401c-8cd6-c166c53614cc None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:01.645661 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 235/486] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 7 15:43:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:01.651316 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c90781-d6b7-4a83-968f-bb89c3c1070a None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:01.778321 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c90781-d6b7-4a83-968f-bb89c3c1070a None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:01.827864 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a0c37-e1e4-464d-ab1d-cf184a5b02f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:01.828426 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a0c37-e1e4-464d-ab1d-cf184a5b02f5 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:01.828705 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a0c37-e1e4-464d-ab1d-cf184a5b02f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:01.828982 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a0c37-e1e4-464d-ab1d-cf184a5b02f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:01.832712 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f39f02-fa0d-430a-a98b-cbe62b072e26 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:01.833141 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f39f02-fa0d-430a-a98b-cbe62b072e26 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:01.833591 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f39f02-fa0d-430a-a98b-cbe62b072e26 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:01.835765 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 236/487] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:43:01.836223 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:01.838080 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f39f02-fa0d-430a-a98b-cbe62b072e26 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:01.842765 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98a0c37-e1e4-464d-ab1d-cf184a5b02f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:01.844247 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98a0c37-e1e4-464d-ab1d-cf184a5b02f5 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:01.865217 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-e98a0c37-e1e4-464d-ab1d-cf184a5b02f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:01.865217 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:01.865217 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:01.865217 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:01.865217 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:01.865217 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:01.865217 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:01.865217 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:01.865217 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:01.865217 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:01.865217 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:01.865217 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:01.865217 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:01.865217 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:01.865217 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:01.865217 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:01.866195 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:01.866195 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:01.866195 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:01.866195 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:01.866195 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:01.866195 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:01.866195 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:01.866195 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:01.866195 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:01.866195 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:01.866195 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:01.866195 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:01.866195 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:01.866195 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:01.866195 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:01.866195 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:01.866195 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:01.867100 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:01.867100 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:01.867100 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:01.867100 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 252/488] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:01.867894 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6196e2-39ac-471e-9c36-70e46564fc56 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:01.868182 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6196e2-39ac-471e-9c36-70e46564fc56 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:01.868462 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6196e2-39ac-471e-9c36-70e46564fc56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:01.889313 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-3d6196e2-39ac-471e-9c36-70e46564fc56 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:01.890564 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-3d6196e2-39ac-471e-9c36-70e46564fc56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:01.969359 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 253/489] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:43:01.969359 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6196e2-39ac-471e-9c36-70e46564fc56 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:01.978883 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f39f02-fa0d-430a-a98b-cbe62b072e26 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:02.058553 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef19eca-7577-4422-be5c-cabb4d2f7c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:02.059441 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef19eca-7577-4422-be5c-cabb4d2f7c40 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:02.059732 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef19eca-7577-4422-be5c-cabb4d2f7c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:02.060008 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef19eca-7577-4422-be5c-cabb4d2f7c40 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:02.077942 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6196e2-39ac-471e-9c36-70e46564fc56 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:02.085790 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef19eca-7577-4422-be5c-cabb4d2f7c40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:43:02.091458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-8ef19eca-7577-4422-be5c-cabb4d2f7c40 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:43:02.091458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:02.091458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:02.091458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:02.091458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:02.091458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:02.091458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:02.091458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:02.091458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:02.091458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:02.091458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:02.091458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:02.091458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:43:02.091458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:43:02.091458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:43:02.091458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:43:02.092763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:43:02.092763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:43:02.092763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:43:02.092763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:43:02.092763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:02.092763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:02.092763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:02.092763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:02.092763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:02.092763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:02.092763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:02.092763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:02.092763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:02.092763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:02.092763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:02.092763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:02.093582 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:02.093582 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:02.093582 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:02.093582 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:02.093582 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:43:02.093582 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:43:02.093582 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:43:02.093582 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:43:02.093582 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:43:02.093582 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:43:02.093582 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:43:02.093582 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:02.093582 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 237/490] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 7 15:43:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:02.097951 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:02.099238 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef19eca-7577-4422-be5c-cabb4d2f7c40 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:02.122866 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e6964-9c7e-46f2-9314-d7f47a75d54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:02.123488 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e6964-9c7e-46f2-9314-d7f47a75d54c None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:02.123769 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e6964-9c7e-46f2-9314-d7f47a75d54c None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:02.124048 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e6964-9c7e-46f2-9314-d7f47a75d54c None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:02.124691 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e6964-9c7e-46f2-9314-d7f47a75d54c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:02.124995 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e6964-9c7e-46f2-9314-d7f47a75d54c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:02.126468 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e6964-9c7e-46f2-9314-d7f47a75d54c None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:02.139326 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 254/491] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:02.140905 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:02.141141 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee87af-cfce-46ed-a710-5f67731eb657 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:02.141576 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee87af-cfce-46ed-a710-5f67731eb657 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:02.141989 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee87af-cfce-46ed-a710-5f67731eb657 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:02.154209 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 255/492] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:02 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:43:02.154209 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee87af-cfce-46ed-a710-5f67731eb657 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:02.228362 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef19eca-7577-4422-be5c-cabb4d2f7c40 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:02.267161 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b409523-d596-477a-88db-c33428cd6a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:02.267521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee87af-cfce-46ed-a710-5f67731eb657 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:02.268292 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b409523-d596-477a-88db-c33428cd6a39 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:02.268864 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b409523-d596-477a-88db-c33428cd6a39 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:02.269364 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b409523-d596-477a-88db-c33428cd6a39 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:02.270348 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b409523-d596-477a-88db-c33428cd6a39 None admin] RBAC: Adding query filter params (name=service) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:02.270856 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b409523-d596-477a-88db-c33428cd6a39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:02.272729 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b409523-d596-477a-88db-c33428cd6a39 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:02.282653 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 238/493] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 7 15:43:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:02.284264 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e7333-224c-45d2-bec0-76d7616da6d1 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:02.284765 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e7333-224c-45d2-bec0-76d7616da6d1 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:02.285299 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e7333-224c-45d2-bec0-76d7616da6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:02.302551 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5488a7e-7873-47fa-81d6-0aa573e9ac68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:02.303323 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5488a7e-7873-47fa-81d6-0aa573e9ac68 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:02.303611 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5488a7e-7873-47fa-81d6-0aa573e9ac68 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:02.303885 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5488a7e-7873-47fa-81d6-0aa573e9ac68 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:02.305983 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-1b9e7333-224c-45d2-bec0-76d7616da6d1 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:02.307518 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-1b9e7333-224c-45d2-bec0-76d7616da6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:02.315885 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5488a7e-7873-47fa-81d6-0aa573e9ac68 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:02.315885 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5488a7e-7873-47fa-81d6-0aa573e9ac68 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:02.330419 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-b5488a7e-7873-47fa-81d6-0aa573e9ac68 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 07 15:43:02.330419 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:02.330419 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:02.330419 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:02.330419 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:02.330419 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:02.330419 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:02.330419 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:02.330419 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:02.330419 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:02.330419 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:02.330419 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:02.330419 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:43:02.330419 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:43:02.330419 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:43:02.330419 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:43:02.331528 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:02.331528 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:02.331528 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:43:02.331528 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:02.331528 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:43:02.331528 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:02.331528 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:02.331528 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:02.331528 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:02.331528 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:02.331528 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:02.331528 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:02.331528 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:02.331528 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:02.331528 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:02.331528 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:02.331528 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:02.331528 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:02.332660 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:02.332660 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:02.332660 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:43:02.332660 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:43:02.332660 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:43:02.332660 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:43:02.332660 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:43:02.332660 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:43:02.332660 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 07 15:43:02.332660 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:02.334441 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 256/494] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:43:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:02.335352 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5488a7e-7873-47fa-81d6-0aa573e9ac68 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:02.374254 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:02.387324 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 239/495] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:43:02.388536 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e7333-224c-45d2-bec0-76d7616da6d1 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:02.430604 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:02.463613 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5488a7e-7873-47fa-81d6-0aa573e9ac68 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:02.508356 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ecaff-2902-403d-b46b-19d6d60c1e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:02.509491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ecaff-2902-403d-b46b-19d6d60c1e6f None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:02.509869 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ecaff-2902-403d-b46b-19d6d60c1e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:02.510278 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ecaff-2902-403d-b46b-19d6d60c1e6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:02.513597 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e7333-224c-45d2-bec0-76d7616da6d1 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:02.523781 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238ecaff-2902-403d-b46b-19d6d60c1e6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:02.525536 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238ecaff-2902-403d-b46b-19d6d60c1e6f None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:02.541848 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-238ecaff-2902-403d-b46b-19d6d60c1e6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:02.541848 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:02.541848 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:02.541848 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:02.541848 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:02.541848 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:02.541848 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:02.541848 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:02.541848 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:02.541848 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:02.541848 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:02.541848 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:02.541848 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:02.541848 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:02.541848 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:02.541848 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:02.542859 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:02.542859 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:02.542859 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:02.542859 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:02.542859 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:02.542859 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:02.542859 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:02.542859 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:02.542859 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:02.542859 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:02.542859 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:02.542859 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:02.542859 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:02.542859 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:02.542859 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:02.542859 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:02.542859 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:02.543768 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:02.543768 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:02.543768 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:02.543768 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 257/496] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:02.545002 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ecaff-2902-403d-b46b-19d6d60c1e6f None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:02.552650 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7249c-1bf2-4025-a648-b4ea8e66f53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:02.553511 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7249c-1bf2-4025-a648-b4ea8e66f53c None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:02.553930 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7249c-1bf2-4025-a648-b4ea8e66f53c None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:02.554420 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7249c-1bf2-4025-a648-b4ea8e66f53c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:02.566217 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c7249c-1bf2-4025-a648-b4ea8e66f53c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:43:02.571860 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-24c7249c-1bf2-4025-a648-b4ea8e66f53c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:43:02.571860 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:02.571860 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:02.571860 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:02.571860 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:02.571860 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:02.571860 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:02.571860 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:02.571860 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:02.571860 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:02.571860 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:02.571860 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:02.571860 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:43:02.571860 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:43:02.571860 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:43:02.571860 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:43:02.573289 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:43:02.573289 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:43:02.573289 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:43:02.573289 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:43:02.573289 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:02.573289 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:02.573289 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:02.573289 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:02.573289 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:02.573289 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:02.573289 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:02.573289 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:02.573289 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:02.573289 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:02.573289 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:02.573289 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:02.574218 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:02.574218 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:02.574218 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:02.574218 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:02.574218 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:43:02.574218 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:43:02.574218 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:43:02.574218 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:43:02.574218 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:43:02.574218 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:43:02.574218 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:43:02.574218 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:02.577084 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 240/497] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 7 15:43:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:02.578142 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7249c-1bf2-4025-a648-b4ea8e66f53c None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:02.642848 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:02.657174 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ecaff-2902-403d-b46b-19d6d60c1e6f None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:02.666322 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:02.690330 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7249c-1bf2-4025-a648-b4ea8e66f53c None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:02.694776 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec607297-936c-4ee7-bd20-c84a139446b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:02.695382 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec607297-936c-4ee7-bd20-c84a139446b5 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:02.695658 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec607297-936c-4ee7-bd20-c84a139446b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:02.695930 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec607297-936c-4ee7-bd20-c84a139446b5 None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:02.696646 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec607297-936c-4ee7-bd20-c84a139446b5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:02.696949 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec607297-936c-4ee7-bd20-c84a139446b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:02.698510 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec607297-936c-4ee7-bd20-c84a139446b5 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:02.723787 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae12093-f2ab-4376-9446-f593555937ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:02.724389 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae12093-f2ab-4376-9446-f593555937ca None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:02.724666 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae12093-f2ab-4376-9446-f593555937ca None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:02.724935 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae12093-f2ab-4376-9446-f593555937ca None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:02.725567 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae12093-f2ab-4376-9446-f593555937ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:02.725989 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae12093-f2ab-4376-9446-f593555937ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:02.727371 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae12093-f2ab-4376-9446-f593555937ca None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:02.739026 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 258/498] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Sep 7 15:43:02 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:02.740121 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec607297-936c-4ee7-bd20-c84a139446b5 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:02.740415 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 241/499] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:02.741284 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae12093-f2ab-4376-9446-f593555937ca None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:02.857331 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec607297-936c-4ee7-bd20-c84a139446b5 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:02.858283 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae12093-f2ab-4376-9446-f593555937ca None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:02.891476 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100b36d-0cd2-453b-981a-79c2910b8b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:02.892089 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100b36d-0cd2-453b-981a-79c2910b8b08 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:02.892377 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100b36d-0cd2-453b-981a-79c2910b8b08 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:02.892640 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100b36d-0cd2-453b-981a-79c2910b8b08 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:02.893354 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2100b36d-0cd2-453b-981a-79c2910b8b08 None admin] RBAC: Adding query filter params (name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:02.893602 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2100b36d-0cd2-453b-981a-79c2910b8b08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:02.895081 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2100b36d-0cd2-453b-981a-79c2910b8b08 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:02.897292 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0a217-4972-4bab-8a2c-73bc1e3ecb3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:02.897929 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0a217-4972-4bab-8a2c-73bc1e3ecb3b None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:02.898238 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0a217-4972-4bab-8a2c-73bc1e3ecb3b None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:02.898520 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0a217-4972-4bab-8a2c-73bc1e3ecb3b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:02.904105 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 259/500] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 7 15:43:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:02.904919 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100b36d-0cd2-453b-981a-79c2910b8b08 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:02.911186 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:02.917691 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:02.918140 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d0a217-4972-4bab-8a2c-73bc1e3ecb3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:43:02.923721 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-e4d0a217-4972-4bab-8a2c-73bc1e3ecb3b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:43:02.923721 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:02.923721 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:02.923721 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:02.923721 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:02.923721 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:02.923721 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:02.923721 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:02.923721 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:02.923721 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:02.923721 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:02.923721 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:02.923721 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:43:02.923721 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:43:02.923721 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:43:02.923721 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:43:02.924634 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:43:02.924634 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:43:02.924634 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:43:02.924634 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:43:02.924634 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:02.924634 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:02.924634 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:02.924634 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:02.924634 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:02.924634 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:02.924634 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:02.924634 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:02.924634 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:02.924634 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:02.924634 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:02.924634 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:02.930449 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:02.930449 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:02.930449 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:02.930449 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:02.930449 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:43:02.930449 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:43:02.930449 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:43:02.930449 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:43:02.930449 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:43:02.930449 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:43:02.930449 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:43:02.930449 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:02.930449 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 242/501] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 7 15:43:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:02.930449 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0a217-4972-4bab-8a2c-73bc1e3ecb3b None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:03.013493 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100b36d-0cd2-453b-981a-79c2910b8b08 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:03.024997 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0a217-4972-4bab-8a2c-73bc1e3ecb3b None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:03.050650 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d61eabf-a272-4ae5-8b84-d156b56801f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:03.051274 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d61eabf-a272-4ae5-8b84-d156b56801f4 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:03.051556 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d61eabf-a272-4ae5-8b84-d156b56801f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:03.051837 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d61eabf-a272-4ae5-8b84-d156b56801f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:03.063001 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e25945-07cf-4e66-996d-72104f711e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:03.063906 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e25945-07cf-4e66-996d-72104f711e8d None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:03.064326 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e25945-07cf-4e66-996d-72104f711e8d None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:03.064729 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e25945-07cf-4e66-996d-72104f711e8d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:03.073524 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e25945-07cf-4e66-996d-72104f711e8d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:03.075567 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e25945-07cf-4e66-996d-72104f711e8d None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:03.088371 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-79e25945-07cf-4e66-996d-72104f711e8d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 15:43:03.088371 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:03.088371 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:03.088371 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:03.088371 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:03.088371 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:03.088371 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:03.088371 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:03.088371 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:03.088371 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:03.088371 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:03.088371 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:03.088371 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:43:03.088371 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:43:03.088371 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:43:03.088371 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:43:03.089360 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:03.089360 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:03.089360 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:43:03.089360 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:03.089360 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:43:03.089360 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:03.089360 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:03.089360 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:03.089360 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:03.089360 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:03.089360 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:03.089360 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:03.089360 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:03.089360 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:03.089360 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:03.089360 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:03.089360 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:03.089360 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:03.090329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:03.090329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:03.090329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:43:03.090329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:43:03.090329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:43:03.090329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:43:03.090329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:43:03.090329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:43:03.090329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 15:43:03.090329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:03.090329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 243/502] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:43:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:03.090329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e25945-07cf-4e66-996d-72104f711e8d None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:03.120066 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d61eabf-a272-4ae5-8b84-d156b56801f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:03.122146 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d61eabf-a272-4ae5-8b84-d156b56801f4 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:03.131747 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:03.158756 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:03.200489 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e25945-07cf-4e66-996d-72104f711e8d None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:03.222543 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 260/503] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:43:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:43:03.223868 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e89cc1-6177-4ba7-89a9-67b43e949803 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:03.224191 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e89cc1-6177-4ba7-89a9-67b43e949803 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:03.224469 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e89cc1-6177-4ba7-89a9-67b43e949803 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:03.225686 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 261/504] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:43:03.226421 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e89cc1-6177-4ba7-89a9-67b43e949803 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:03.238819 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf9dcdd-ad8f-4830-85a7-117935af9e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:03.239449 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9dcdd-ad8f-4830-85a7-117935af9e0c None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:03.239731 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9dcdd-ad8f-4830-85a7-117935af9e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:03.240007 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9dcdd-ad8f-4830-85a7-117935af9e0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:03.251095 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf9dcdd-ad8f-4830-85a7-117935af9e0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:03.252551 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf9dcdd-ad8f-4830-85a7-117935af9e0c None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:03.266540 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-3cf9dcdd-ad8f-4830-85a7-117935af9e0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:03.266540 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:03.266540 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:03.266540 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:03.266540 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:03.266540 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:03.266540 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:03.266540 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:03.266540 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:03.266540 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:03.266540 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:03.266540 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:03.266540 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:03.266540 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:03.266540 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:03.266540 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:03.267517 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:03.267517 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:03.267517 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:03.267517 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:03.267517 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:03.267517 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:03.267517 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:03.267517 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:03.267517 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:03.267517 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:03.267517 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:03.267517 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:03.267517 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:03.267517 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:03.267517 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:03.267517 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:03.267517 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:03.268396 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:03.268396 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:03.268396 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:03.268396 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 244/505] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:03.268396 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf9dcdd-ad8f-4830-85a7-117935af9e0c None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:03.332572 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e89cc1-6177-4ba7-89a9-67b43e949803 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:03.341780 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:03.368387 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97af339-9b50-42fc-bfea-a4162d605971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:03.368602 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf9dcdd-ad8f-4830-85a7-117935af9e0c None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:03.368992 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97af339-9b50-42fc-bfea-a4162d605971 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:03.369273 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97af339-9b50-42fc-bfea-a4162d605971 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:03.369547 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97af339-9b50-42fc-bfea-a4162d605971 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:03.370296 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97af339-9b50-42fc-bfea-a4162d605971 None admin] RBAC: Adding query filter params (name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:03.370604 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97af339-9b50-42fc-bfea-a4162d605971 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:03.372784 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97af339-9b50-42fc-bfea-a4162d605971 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:03.379580 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:03.380999 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 262/506] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 7 15:43:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:03.382105 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97af339-9b50-42fc-bfea-a4162d605971 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:03.407631 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba417647-d7ba-429c-9f28-1a668098d51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:03.408244 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba417647-d7ba-429c-9f28-1a668098d51e None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:03.408529 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba417647-d7ba-429c-9f28-1a668098d51e None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:03.408859 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba417647-d7ba-429c-9f28-1a668098d51e None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:03.409541 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba417647-d7ba-429c-9f28-1a668098d51e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:03.409853 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba417647-d7ba-429c-9f28-1a668098d51e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:03.411330 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba417647-d7ba-429c-9f28-1a668098d51e None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:03.448095 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 245/507] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Sep 7 15:43:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:03.449323 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24a9fb-610a-4339-82de-d8a89117e4ff None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:03.449614 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24a9fb-610a-4339-82de-d8a89117e4ff None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:03.450440 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24a9fb-610a-4339-82de-d8a89117e4ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:03.468274 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-ba24a9fb-610a-4339-82de-d8a89117e4ff None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:03.469479 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-ba24a9fb-610a-4339-82de-d8a89117e4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:03.486421 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97af339-9b50-42fc-bfea-a4162d605971 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:03.521089 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729fd1be-cf30-45f6-9829-2b96a6fa394c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:03.521708 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729fd1be-cf30-45f6-9829-2b96a6fa394c None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:03.521991 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729fd1be-cf30-45f6-9829-2b96a6fa394c None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:03.522290 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729fd1be-cf30-45f6-9829-2b96a6fa394c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:03.533138 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729fd1be-cf30-45f6-9829-2b96a6fa394c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:03.534609 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729fd1be-cf30-45f6-9829-2b96a6fa394c None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:03.535713 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 246/508] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:43:03.536578 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24a9fb-610a-4339-82de-d8a89117e4ff None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:03.548754 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-729fd1be-cf30-45f6-9829-2b96a6fa394c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:03.548754 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:03.548754 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:03.548754 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:03.548754 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:03.548754 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:03.548754 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:03.548754 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:03.548754 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:03.548754 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:03.548754 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:03.548754 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:03.548754 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:03.548754 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:03.548754 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:03.548754 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:03.549712 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:03.549712 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:03.549712 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:03.549712 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:03.549712 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:03.549712 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:03.549712 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:03.549712 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:03.549712 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:03.549712 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:03.549712 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:03.549712 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:03.549712 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:03.549712 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:03.549712 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:03.549712 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:03.549712 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:03.555356 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:03.555356 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:03.555356 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:03.555356 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 263/509] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:03.555356 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729fd1be-cf30-45f6-9829-2b96a6fa394c None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:03.579586 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:03.646034 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:03.650534 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24a9fb-610a-4339-82de-d8a89117e4ff None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:03.668795 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729fd1be-cf30-45f6-9829-2b96a6fa394c None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:03.690788 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2414eb-9de7-438d-b706-da4bf48609de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:03.691454 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2414eb-9de7-438d-b706-da4bf48609de None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:03.691675 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2414eb-9de7-438d-b706-da4bf48609de None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:03.691952 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2414eb-9de7-438d-b706-da4bf48609de None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:03.692600 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2414eb-9de7-438d-b706-da4bf48609de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:03.692907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2414eb-9de7-438d-b706-da4bf48609de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:03.694326 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2414eb-9de7-438d-b706-da4bf48609de None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:03.704511 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437596d7-c165-4068-bef3-36dbed75cb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:03.705192 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437596d7-c165-4068-bef3-36dbed75cb4c None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:03.705477 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437596d7-c165-4068-bef3-36dbed75cb4c None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:03.705752 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437596d7-c165-4068-bef3-36dbed75cb4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:03.710835 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 247/510] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:03.710835 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2414eb-9de7-438d-b706-da4bf48609de None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:03.722261 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437596d7-c165-4068-bef3-36dbed75cb4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:03.723720 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437596d7-c165-4068-bef3-36dbed75cb4c None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:03.739124 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-437596d7-c165-4068-bef3-36dbed75cb4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:03.739124 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:03.739124 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:03.739124 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:03.739124 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:03.739124 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:03.739124 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:03.739124 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:03.739124 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:03.739124 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:03.739124 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:03.739124 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:03.739124 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:03.739124 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:03.739124 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:03.739124 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:03.739995 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:03.739995 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:03.739995 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:03.739995 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:03.739995 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:03.739995 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:03.739995 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:03.739995 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:03.739995 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:03.739995 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:03.739995 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:03.739995 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:03.739995 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:03.739995 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:03.739995 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:03.739995 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:03.739995 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:03.740827 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:03.740827 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:03.740827 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:03.740827 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 264/511] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:03.741045 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437596d7-c165-4068-bef3-36dbed75cb4c None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:03.816195 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2414eb-9de7-438d-b706-da4bf48609de None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:03.822492 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:03.848161 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437596d7-c165-4068-bef3-36dbed75cb4c None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:03.849397 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe4097c-5949-4644-8ba4-d32e5ef420ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:03.850007 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4097c-5949-4644-8ba4-d32e5ef420ef None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:03.850339 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4097c-5949-4644-8ba4-d32e5ef420ef None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:03.850619 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4097c-5949-4644-8ba4-d32e5ef420ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:03.877413 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:03.882562 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c0bc2-9c9d-4700-8bd8-309775436734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:03.883168 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c0bc2-9c9d-4700-8bd8-309775436734 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:03.883466 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c0bc2-9c9d-4700-8bd8-309775436734 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:03.883719 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c0bc2-9c9d-4700-8bd8-309775436734 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:03.884349 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c0bc2-9c9d-4700-8bd8-309775436734 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:03.884645 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c0bc2-9c9d-4700-8bd8-309775436734 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:03.886046 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c0bc2-9c9d-4700-8bd8-309775436734 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:03.897631 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 265/512] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:03.898446 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c0bc2-9c9d-4700-8bd8-309775436734 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:03.918760 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe4097c-5949-4644-8ba4-d32e5ef420ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:03.920280 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe4097c-5949-4644-8ba4-d32e5ef420ef None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:03.998623 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c0bc2-9c9d-4700-8bd8-309775436734 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:04.019401 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 248/513] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:43:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:43:04.020242 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe4097c-5949-4644-8ba4-d32e5ef420ef None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:04.040110 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6b24d-1d84-490c-a626-e72b0f19b181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:04.040749 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6b24d-1d84-490c-a626-e72b0f19b181 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:04.041031 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6b24d-1d84-490c-a626-e72b0f19b181 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:04.041306 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6b24d-1d84-490c-a626-e72b0f19b181 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:04.043268 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:04.050781 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f6b24d-1d84-490c-a626-e72b0f19b181 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:04.052234 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f6b24d-1d84-490c-a626-e72b0f19b181 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:04.063883 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-78f6b24d-1d84-490c-a626-e72b0f19b181 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 07 15:43:04.063883 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:04.063883 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:04.063883 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:04.063883 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:04.063883 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:04.063883 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:04.063883 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:04.063883 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:04.063883 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:04.063883 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:04.063883 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:04.063883 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:43:04.063883 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:43:04.063883 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:43:04.063883 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:43:04.064929 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:04.064929 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:04.064929 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:43:04.064929 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:04.064929 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:43:04.064929 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:04.064929 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:04.064929 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:04.064929 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:04.064929 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:04.064929 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:04.064929 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:04.064929 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:04.064929 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:04.064929 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:04.064929 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:04.064929 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:04.064929 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:04.065863 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:04.065863 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:04.065863 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:43:04.065863 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:43:04.065863 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:43:04.065863 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:43:04.065863 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:43:04.065863 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:43:04.065863 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 07 15:43:04.065863 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:04.065863 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 266/514] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 7 15:43:03 2022] GET /identity/v3/users/neutron => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:04.065863 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6b24d-1d84-490c-a626-e72b0f19b181 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:04.085664 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:04.126799 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe4097c-5949-4644-8ba4-d32e5ef420ef None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:04.160299 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b980014-26f2-48b3-af31-3587e02efa2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:04.160903 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b980014-26f2-48b3-af31-3587e02efa2b None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:04.161184 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b980014-26f2-48b3-af31-3587e02efa2b None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:04.161461 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b980014-26f2-48b3-af31-3587e02efa2b None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:04.162102 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b980014-26f2-48b3-af31-3587e02efa2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:04.162438 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b980014-26f2-48b3-af31-3587e02efa2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:04.163815 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b980014-26f2-48b3-af31-3587e02efa2b None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:04.165162 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6b24d-1d84-490c-a626-e72b0f19b181 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:04.175969 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 249/515] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:04.179424 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b980014-26f2-48b3-af31-3587e02efa2b None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:04.199285 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47440c6-bae8-4ccd-a5b0-b6e8eabb4fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:04.200077 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47440c6-bae8-4ccd-a5b0-b6e8eabb4fd9 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:04.200387 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47440c6-bae8-4ccd-a5b0-b6e8eabb4fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:04.200736 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47440c6-bae8-4ccd-a5b0-b6e8eabb4fd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:04.211256 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47440c6-bae8-4ccd-a5b0-b6e8eabb4fd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:04.212694 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47440c6-bae8-4ccd-a5b0-b6e8eabb4fd9 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:04.226588 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-b47440c6-bae8-4ccd-a5b0-b6e8eabb4fd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:04.226588 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:04.226588 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:04.226588 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:04.226588 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:04.226588 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:04.226588 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:04.226588 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:04.226588 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:04.226588 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:04.226588 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:04.226588 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:04.226588 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:04.226588 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:04.226588 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:04.226588 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:04.227505 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:04.227505 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:04.227505 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:04.227505 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:04.227505 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:04.227505 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:04.227505 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:04.227505 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:04.227505 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:04.227505 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:04.227505 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:04.227505 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:04.227505 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:04.227505 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:04.227505 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:04.227505 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:04.227505 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:04.228354 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:04.228354 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:04.228354 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:04.228354 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 267/516] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:04.228579 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47440c6-bae8-4ccd-a5b0-b6e8eabb4fd9 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:04.276480 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:04.284308 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b980014-26f2-48b3-af31-3587e02efa2b None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:04.301493 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:04.319613 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3be92-84f3-413c-a552-6f5769df56d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:04.320240 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3be92-84f3-413c-a552-6f5769df56d1 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:04.320521 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3be92-84f3-413c-a552-6f5769df56d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:04.320793 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3be92-84f3-413c-a552-6f5769df56d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:04.327347 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce3be92-84f3-413c-a552-6f5769df56d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:04.328780 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce3be92-84f3-413c-a552-6f5769df56d1 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:04.329985 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47440c6-bae8-4ccd-a5b0-b6e8eabb4fd9 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:04.340357 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-bce3be92-84f3-413c-a552-6f5769df56d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:04.340357 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:04.340357 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:04.340357 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:04.340357 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:04.340357 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:04.340357 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:04.340357 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:04.340357 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:04.340357 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:04.340357 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:04.340357 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:04.340357 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:43:04.340357 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:43:04.340357 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:43:04.341391 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:43:04.341391 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:04.341391 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:04.341391 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:04.341391 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:04.341391 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:04.341391 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:04.341391 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:04.341391 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:04.341391 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:04.341391 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:04.341391 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:04.341391 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:04.341391 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:04.341391 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:04.341391 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:04.341391 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:04.342282 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:43:04.342282 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:43:04.342282 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:43:04.342282 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:43:04.342282 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:43:04.342282 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:43:04.342282 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:04.342282 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:04.342282 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 250/517] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:43:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:04.342282 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3be92-84f3-413c-a552-6f5769df56d1 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:04.368822 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e00619-3ebf-4db3-9876-b128416d3057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:04.369448 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e00619-3ebf-4db3-9876-b128416d3057 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:04.369729 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e00619-3ebf-4db3-9876-b128416d3057 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:04.370002 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e00619-3ebf-4db3-9876-b128416d3057 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:04.380563 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e00619-3ebf-4db3-9876-b128416d3057 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:04.382002 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e00619-3ebf-4db3-9876-b128416d3057 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:04.396119 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-a5e00619-3ebf-4db3-9876-b128416d3057 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:04.396119 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:04.396119 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:04.396119 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:04.396119 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:04.396119 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:04.396119 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:04.396119 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:04.396119 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:04.396119 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:04.396119 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:04.396119 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:04.396119 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:04.396119 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:04.396119 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:04.396119 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:04.397070 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:04.397070 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:04.397070 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:04.397070 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:04.397070 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:04.397070 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:04.397070 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:04.397070 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:04.397070 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:04.397070 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:04.397070 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:04.397070 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:04.397070 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:04.397070 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:04.397070 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:04.397070 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:04.397070 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:04.397936 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:04.397936 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:04.397936 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:04.397936 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 268/518] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:04.398567 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e00619-3ebf-4db3-9876-b128416d3057 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:04.446083 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3be92-84f3-413c-a552-6f5769df56d1 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:04.478801 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73913bba-46a7-472e-91c7-76e352102302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:04.479399 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73913bba-46a7-472e-91c7-76e352102302 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:04.479676 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73913bba-46a7-472e-91c7-76e352102302 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:04.479951 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73913bba-46a7-472e-91c7-76e352102302 None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:04.480657 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73913bba-46a7-472e-91c7-76e352102302 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:04.481036 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73913bba-46a7-472e-91c7-76e352102302 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:04.483098 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73913bba-46a7-472e-91c7-76e352102302 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:04.494721 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:04.499317 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e00619-3ebf-4db3-9876-b128416d3057 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:04.500387 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 251/519] 10.222.0.16 () {56 vars in 1139 bytes} [Wed Sep 7 15:43:04 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:04.501183 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73913bba-46a7-472e-91c7-76e352102302 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:04.534952 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:04.537134 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b581c4-37eb-46da-a136-9440a0ffda68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:04.537769 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b581c4-37eb-46da-a136-9440a0ffda68 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:04.538044 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b581c4-37eb-46da-a136-9440a0ffda68 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:04.538363 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b581c4-37eb-46da-a136-9440a0ffda68 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:04.546620 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b581c4-37eb-46da-a136-9440a0ffda68 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:04.548073 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b581c4-37eb-46da-a136-9440a0ffda68 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:04.559227 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-63b581c4-37eb-46da-a136-9440a0ffda68 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 15:43:04.559227 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:04.559227 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:04.559227 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:04.559227 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:04.559227 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:04.559227 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:04.559227 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:04.559227 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:04.559227 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:04.559227 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:04.559227 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:04.559227 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:43:04.559227 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:43:04.559227 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:43:04.559227 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:43:04.560152 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:04.560152 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:04.560152 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:43:04.560152 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:04.560152 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:43:04.560152 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:04.560152 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:04.560152 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:04.560152 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:04.560152 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:04.560152 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:04.560152 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:04.560152 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:04.560152 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:04.560152 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:04.560152 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:04.560152 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:04.560152 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:04.561521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:04.561521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:04.561521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:43:04.561521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:43:04.561521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:43:04.561521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:43:04.561521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:43:04.561521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:43:04.561521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 15:43:04.561521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:04.561521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 269/520] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Sep 7 15:43:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:04.561521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b581c4-37eb-46da-a136-9440a0ffda68 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:04.606891 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73913bba-46a7-472e-91c7-76e352102302 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:04.641109 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edaa955-0cd6-4829-a463-142936a11609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:04.641715 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edaa955-0cd6-4829-a463-142936a11609 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:04.641995 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edaa955-0cd6-4829-a463-142936a11609 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:04.642302 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edaa955-0cd6-4829-a463-142936a11609 None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:04.642934 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edaa955-0cd6-4829-a463-142936a11609 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:04.643236 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edaa955-0cd6-4829-a463-142936a11609 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:04.644599 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edaa955-0cd6-4829-a463-142936a11609 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:04.656059 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 252/521] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:04.656844 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edaa955-0cd6-4829-a463-142936a11609 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:04.662845 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b581c4-37eb-46da-a136-9440a0ffda68 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:04.696866 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846b7a02-0b17-430f-accc-081e6c34eab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:04.697463 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b7a02-0b17-430f-accc-081e6c34eab8 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:04.697662 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b7a02-0b17-430f-accc-081e6c34eab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:04.697931 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b7a02-0b17-430f-accc-081e6c34eab8 None admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:04.698670 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846b7a02-0b17-430f-accc-081e6c34eab8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:04.698977 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846b7a02-0b17-430f-accc-081e6c34eab8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:04.700663 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846b7a02-0b17-430f-accc-081e6c34eab8 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:04.718130 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 270/522] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 7 15:43:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:04.718936 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846b7a02-0b17-430f-accc-081e6c34eab8 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:04.737476 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:04.756711 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:04.762894 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edaa955-0cd6-4829-a463-142936a11609 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:04.795571 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee9a018-8ac4-42fd-b6ba-e13e62424b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:04.796166 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee9a018-8ac4-42fd-b6ba-e13e62424b0e None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:04.796441 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee9a018-8ac4-42fd-b6ba-e13e62424b0e None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:04.796709 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee9a018-8ac4-42fd-b6ba-e13e62424b0e None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:04.797338 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee9a018-8ac4-42fd-b6ba-e13e62424b0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:04.797638 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee9a018-8ac4-42fd-b6ba-e13e62424b0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:04.799025 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee9a018-8ac4-42fd-b6ba-e13e62424b0e None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:04.815131 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 253/523] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:04.815841 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee9a018-8ac4-42fd-b6ba-e13e62424b0e None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:04.818035 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846b7a02-0b17-430f-accc-081e6c34eab8 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:04.852816 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81616b63-d171-4c55-8d1b-7518f5848614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:04.853423 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81616b63-d171-4c55-8d1b-7518f5848614 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:04.853708 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81616b63-d171-4c55-8d1b-7518f5848614 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:04.853981 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81616b63-d171-4c55-8d1b-7518f5848614 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:04.914899 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee9a018-8ac4-42fd-b6ba-e13e62424b0e None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:04.926636 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81616b63-d171-4c55-8d1b-7518f5848614 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:04.928097 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81616b63-d171-4c55-8d1b-7518f5848614 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:04.945813 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:04.949301 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e495e25d-fc80-4296-bf24-819f7f97dee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:04.949568 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495e25d-fc80-4296-bf24-819f7f97dee1 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:04.949876 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495e25d-fc80-4296-bf24-819f7f97dee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:04.950149 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495e25d-fc80-4296-bf24-819f7f97dee1 None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:04.950904 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e495e25d-fc80-4296-bf24-819f7f97dee1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:04.951208 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e495e25d-fc80-4296-bf24-819f7f97dee1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:04.952634 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e495e25d-fc80-4296-bf24-819f7f97dee1 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:04.969327 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 254/524] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Sep 7 15:43:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:04.970102 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e495e25d-fc80-4296-bf24-819f7f97dee1 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:04.985532 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:05.033271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 271/525] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:43:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:43:05.033271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81616b63-d171-4c55-8d1b-7518f5848614 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:05.072732 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e495e25d-fc80-4296-bf24-819f7f97dee1 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:05.106636 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5178baf-e1ae-4912-a80c-7971a19006c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:05.107501 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5178baf-e1ae-4912-a80c-7971a19006c2 None admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:05.107784 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5178baf-e1ae-4912-a80c-7971a19006c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:05.108056 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5178baf-e1ae-4912-a80c-7971a19006c2 None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:05.108695 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5178baf-e1ae-4912-a80c-7971a19006c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:05.110137 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5178baf-e1ae-4912-a80c-7971a19006c2 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:05.131523 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 255/526] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Sep 7 15:43:04 2022] POST /identity/v3/users => generated 247 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:43:05.132029 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81616b63-d171-4c55-8d1b-7518f5848614 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:05.132325 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5178baf-e1ae-4912-a80c-7971a19006c2 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:05.151783 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:05.173556 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4438eef3-8e85-44cd-9579-5a1d32a889cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:05.174216 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438eef3-8e85-44cd-9579-5a1d32a889cc None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:05.174494 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438eef3-8e85-44cd-9579-5a1d32a889cc None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:05.174768 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438eef3-8e85-44cd-9579-5a1d32a889cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:05.175503 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4438eef3-8e85-44cd-9579-5a1d32a889cc None admin] RBAC: Adding query filter params (role.id=a420b17212b94988beb75affe974355b, scope.project.id=488830167943488f85743236584113d7, user.id=5753fea47f5944cd93dbea90fb9ad9b3) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:05.175811 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4438eef3-8e85-44cd-9579-5a1d32a889cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:05.177273 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4438eef3-8e85-44cd-9579-5a1d32a889cc None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:05.183798 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 272/527] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 7 15:43:05 2022] GET /identity/v3/role_assignments?user.id=5753fea47f5944cd93dbea90fb9ad9b3&scope.project.id=488830167943488f85743236584113d7&role.id=a420b17212b94988beb75affe974355b => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:05.184711 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4438eef3-8e85-44cd-9579-5a1d32a889cc None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:05.254466 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:05.313686 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5178baf-e1ae-4912-a80c-7971a19006c2 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:05.314671 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4438eef3-8e85-44cd-9579-5a1d32a889cc None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:05.355733 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4b4a1-03f2-4e48-b39c-8fcda39da5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:05.356732 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4b4a1-03f2-4e48-b39c-8fcda39da5f3 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:05.357014 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4b4a1-03f2-4e48-b39c-8fcda39da5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:05.357594 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4b4a1-03f2-4e48-b39c-8fcda39da5f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:05.357746 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cbf65f-20d5-4d8b-8249-855571c71454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:05.358443 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbf65f-20d5-4d8b-8249-855571c71454 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:05.358769 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbf65f-20d5-4d8b-8249-855571c71454 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:05.359921 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbf65f-20d5-4d8b-8249-855571c71454 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:05.365998 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc4b4a1-03f2-4e48-b39c-8fcda39da5f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:05.367529 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc4b4a1-03f2-4e48-b39c-8fcda39da5f3 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:05.381065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-4bc4b4a1-03f2-4e48-b39c-8fcda39da5f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:05.381065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:05.381065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:05.381065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:05.381065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:05.381065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:05.381065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:05.381065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:05.381065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:05.381065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:05.381065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:05.381065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:05.381065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:43:05.381065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:43:05.381065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:43:05.381971 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:43:05.381971 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:05.381971 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:05.381971 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:05.381971 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:05.381971 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:05.381971 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:05.381971 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:05.381971 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:05.381971 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:05.381971 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:05.381971 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:05.381971 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:05.381971 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:05.381971 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:05.381971 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:05.381971 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:05.382950 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:43:05.382950 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:43:05.382950 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:43:05.382950 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:43:05.382950 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:43:05.382950 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:43:05.382950 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:05.382950 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:05.382950 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 256/528] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:43:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:05.383745 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4b4a1-03f2-4e48-b39c-8fcda39da5f3 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:05.428676 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:05.454425 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cbf65f-20d5-4d8b-8249-855571c71454 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:05.456612 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cbf65f-20d5-4d8b-8249-855571c71454 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:05.510676 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4b4a1-03f2-4e48-b39c-8fcda39da5f3 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:05.551940 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2e530-496a-41e5-8161-cc9ba5f3d693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:05.552576 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2e530-496a-41e5-8161-cc9ba5f3d693 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:05.553299 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2e530-496a-41e5-8161-cc9ba5f3d693 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:05.553589 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2e530-496a-41e5-8161-cc9ba5f3d693 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:05.563007 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:05.568114 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac2e530-496a-41e5-8161-cc9ba5f3d693 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:05.570121 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac2e530-496a-41e5-8161-cc9ba5f3d693 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:05.587247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-6ac2e530-496a-41e5-8161-cc9ba5f3d693 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:05.587247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:05.587247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:05.587247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:05.587247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:05.587247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:05.587247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:05.587247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:05.587247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:05.587247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:05.587247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:05.587247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:05.587247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:05.587247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:05.587247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:05.587247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:05.588415 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:05.588415 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:05.588415 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:05.588415 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:05.588415 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:05.588415 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:05.588415 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:05.588415 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:05.588415 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:05.588415 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:05.588415 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:05.588415 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:05.588415 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:05.588415 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:05.588415 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:05.588415 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:05.588415 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:05.589477 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:05.589477 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:05.589477 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:05.590550 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 257/529] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:05.591371 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2e530-496a-41e5-8161-cc9ba5f3d693 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:05.594712 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 273/530] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:43:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:43:05.595856 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cbf65f-20d5-4d8b-8249-855571c71454 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:05.698998 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:05.711831 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2e530-496a-41e5-8161-cc9ba5f3d693 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:05.726720 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cbf65f-20d5-4d8b-8249-855571c71454 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:05.758779 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde5231-21ba-4950-be9d-1c9dcb739aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:05.759611 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde5231-21ba-4950-be9d-1c9dcb739aa1 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:05.759894 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde5231-21ba-4950-be9d-1c9dcb739aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:05.760390 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde5231-21ba-4950-be9d-1c9dcb739aa1 None admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:05.761239 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fde5231-21ba-4950-be9d-1c9dcb739aa1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:05.761902 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fde5231-21ba-4950-be9d-1c9dcb739aa1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:05.764287 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fde5231-21ba-4950-be9d-1c9dcb739aa1 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:05.767682 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ff180-5f1f-41af-83a9-b77be8ddac0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:05.768558 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ff180-5f1f-41af-83a9-b77be8ddac0a None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:05.769035 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ff180-5f1f-41af-83a9-b77be8ddac0a None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:05.769507 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ff180-5f1f-41af-83a9-b77be8ddac0a None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:05.770376 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4ff180-5f1f-41af-83a9-b77be8ddac0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:05.770897 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4ff180-5f1f-41af-83a9-b77be8ddac0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:05.772452 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4ff180-5f1f-41af-83a9-b77be8ddac0a None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:05.785260 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 258/531] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 7 15:43:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:05.791909 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 274/532] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:43:05.792807 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ff180-5f1f-41af-83a9-b77be8ddac0a None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:05.794907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde5231-21ba-4950-be9d-1c9dcb739aa1 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:05.841781 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:05.912202 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde5231-21ba-4950-be9d-1c9dcb739aa1 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:05.927406 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ff180-5f1f-41af-83a9-b77be8ddac0a None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:05.950192 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe25f24-d487-41be-99e0-1eee41582c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:05.950849 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe25f24-d487-41be-99e0-1eee41582c87 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:05.951131 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe25f24-d487-41be-99e0-1eee41582c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:05.951406 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe25f24-d487-41be-99e0-1eee41582c87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:05.952142 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe25f24-d487-41be-99e0-1eee41582c87 None admin] RBAC: Adding query filter params (role.id=a420b17212b94988beb75affe974355b, scope.project.id=488830167943488f85743236584113d7, user.id=99f8fac7bf3842cba115fa03ef9291d8) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:05.952447 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe25f24-d487-41be-99e0-1eee41582c87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:05.954381 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe25f24-d487-41be-99e0-1eee41582c87 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:05.966207 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 259/533] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 7 15:43:05 2022] GET /identity/v3/role_assignments?user.id=99f8fac7bf3842cba115fa03ef9291d8&scope.project.id=488830167943488f85743236584113d7&role.id=a420b17212b94988beb75affe974355b => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:05.966207 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe25f24-d487-41be-99e0-1eee41582c87 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:05.981917 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be770c94-1741-41bb-af44-4d1a6d27245c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:05.983277 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be770c94-1741-41bb-af44-4d1a6d27245c None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:05.983782 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be770c94-1741-41bb-af44-4d1a6d27245c None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:05.984296 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be770c94-1741-41bb-af44-4d1a6d27245c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:06.009941 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be770c94-1741-41bb-af44-4d1a6d27245c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:06.011867 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be770c94-1741-41bb-af44-4d1a6d27245c None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:06.014267 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:06.040565 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-be770c94-1741-41bb-af44-4d1a6d27245c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:06.040565 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:06.040565 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:06.040565 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:06.040565 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:06.040565 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:06.040565 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:06.040565 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:06.040565 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:06.040565 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:06.040565 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:06.040565 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:06.040565 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:06.040565 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:06.040565 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:06.040565 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:06.041463 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:06.041463 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:06.041463 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:06.041463 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:06.041463 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:06.041463 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:06.041463 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:06.041463 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:06.041463 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:06.041463 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:06.041463 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:06.041463 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:06.041463 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:06.041463 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:06.041463 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:06.041463 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:06.041463 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:06.042785 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:06.042785 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:06.042785 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:06.042785 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 275/534] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:06.051487 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be770c94-1741-41bb-af44-4d1a6d27245c None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:06.095068 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe25f24-d487-41be-99e0-1eee41582c87 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:06.110571 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:06.179243 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4e226-f908-43ae-8125-d010313b70e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:06.180283 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4e226-f908-43ae-8125-d010313b70e3 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:06.180769 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4e226-f908-43ae-8125-d010313b70e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:06.181269 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4e226-f908-43ae-8125-d010313b70e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:06.198433 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4e226-f908-43ae-8125-d010313b70e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:06.202934 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4e226-f908-43ae-8125-d010313b70e3 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:06.224870 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-b1a4e226-f908-43ae-8125-d010313b70e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:06.224870 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:06.224870 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:06.224870 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:06.224870 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:06.224870 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:06.224870 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:06.224870 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:06.224870 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:06.224870 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:06.224870 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:06.224870 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:06.224870 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:43:06.224870 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:43:06.224870 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:43:06.225833 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:43:06.225833 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:06.225833 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:06.225833 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:06.225833 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:06.225833 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:06.225833 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:06.225833 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:06.225833 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:06.225833 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:06.225833 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:06.225833 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:06.225833 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:06.225833 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:06.225833 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:06.225833 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:06.225833 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:06.226719 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:43:06.226719 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:43:06.226719 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:43:06.226719 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:43:06.226719 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:43:06.226719 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:43:06.226719 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:06.226719 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:06.239043 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 260/535] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:43:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:06.241842 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4e226-f908-43ae-8125-d010313b70e3 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:06.290421 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be770c94-1741-41bb-af44-4d1a6d27245c None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:06.362277 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2ab77-488e-4952-aa48-f7b920bdd1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:06.363294 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2ab77-488e-4952-aa48-f7b920bdd1b2 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:06.365351 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2ab77-488e-4952-aa48-f7b920bdd1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:06.365841 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2ab77-488e-4952-aa48-f7b920bdd1b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:06.366737 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2ab77-488e-4952-aa48-f7b920bdd1b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:06.368332 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2ab77-488e-4952-aa48-f7b920bdd1b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:06.370763 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2ab77-488e-4952-aa48-f7b920bdd1b2 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:06.398916 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 276/536] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:43:06.404652 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2ab77-488e-4952-aa48-f7b920bdd1b2 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:06.443341 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4e226-f908-43ae-8125-d010313b70e3 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:06.508958 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:06.519247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78345f-b545-4d39-953f-715ace812d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:06.519865 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78345f-b545-4d39-953f-715ace812d6b None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:06.520145 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78345f-b545-4d39-953f-715ace812d6b None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:06.520419 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78345f-b545-4d39-953f-715ace812d6b None admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:06.522384 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc78345f-b545-4d39-953f-715ace812d6b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:06.523486 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc78345f-b545-4d39-953f-715ace812d6b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:06.524941 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc78345f-b545-4d39-953f-715ace812d6b None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:06.552649 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 261/537] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 7 15:43:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:06.558714 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78345f-b545-4d39-953f-715ace812d6b None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:06.597691 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2ab77-488e-4952-aa48-f7b920bdd1b2 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:06.610850 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:06.691795 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee645e1-4ddb-47e5-934c-59d15df90531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:06.692443 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee645e1-4ddb-47e5-934c-59d15df90531 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:06.692722 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee645e1-4ddb-47e5-934c-59d15df90531 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:06.692990 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee645e1-4ddb-47e5-934c-59d15df90531 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:06.693609 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78345f-b545-4d39-953f-715ace812d6b None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:06.706505 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee645e1-4ddb-47e5-934c-59d15df90531 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:06.707961 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee645e1-4ddb-47e5-934c-59d15df90531 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:06.729346 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-3ee645e1-4ddb-47e5-934c-59d15df90531 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:06.729346 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:06.729346 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:06.729346 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:06.729346 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:06.729346 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:06.729346 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:06.729346 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:06.729346 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:06.729346 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:06.729346 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:06.729346 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:06.729346 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:43:06.729346 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:43:06.729346 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:43:06.730250 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:43:06.730250 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:06.730250 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:06.730250 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:06.730250 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:06.730250 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:06.730250 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:06.730250 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:06.730250 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:06.730250 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:06.730250 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:06.730250 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:06.730250 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:06.730250 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:06.730250 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:06.730250 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:06.730250 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:06.732101 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:43:06.732101 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:43:06.732101 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:43:06.732101 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:43:06.732101 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:43:06.732101 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:43:06.732101 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:06.732101 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:06.732101 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 277/538] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:43:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:43:06.736921 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee645e1-4ddb-47e5-934c-59d15df90531 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:06.741659 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ba640-4c3c-4976-9b18-a2ddeb7f3068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:06.742360 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ba640-4c3c-4976-9b18-a2ddeb7f3068 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:06.742647 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ba640-4c3c-4976-9b18-a2ddeb7f3068 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:06.742929 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ba640-4c3c-4976-9b18-a2ddeb7f3068 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:06.743728 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ba640-4c3c-4976-9b18-a2ddeb7f3068 None admin] RBAC: Adding query filter params (role.id=a420b17212b94988beb75affe974355b, scope.project.id=488830167943488f85743236584113d7, user.id=3195fa62961c4d64972b88449d013380) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:06.744041 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ba640-4c3c-4976-9b18-a2ddeb7f3068 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:06.745474 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ba640-4c3c-4976-9b18-a2ddeb7f3068 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:06.752363 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 262/539] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 7 15:43:06 2022] GET /identity/v3/role_assignments?user.id=3195fa62961c4d64972b88449d013380&scope.project.id=488830167943488f85743236584113d7&role.id=a420b17212b94988beb75affe974355b => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:06.893571 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee645e1-4ddb-47e5-934c-59d15df90531 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:06.917186 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:06.953512 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b3251-21b8-4332-a901-3caa19ee61f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:06.954382 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b3251-21b8-4332-a901-3caa19ee61f3 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:06.954893 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b3251-21b8-4332-a901-3caa19ee61f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:06.955393 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b3251-21b8-4332-a901-3caa19ee61f3 None admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:06.956158 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b3251-21b8-4332-a901-3caa19ee61f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:06.956465 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b3251-21b8-4332-a901-3caa19ee61f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:06.957954 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b3251-21b8-4332-a901-3caa19ee61f3 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:06.971330 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 278/540] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 7 15:43:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:43:06.977366 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ba640-4c3c-4976-9b18-a2ddeb7f3068 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:07.106876 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:07.115690 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ba640-4c3c-4976-9b18-a2ddeb7f3068 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:07.177831 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebcfb42-b0ff-4899-91a5-b90296e13776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:07.178402 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebcfb42-b0ff-4899-91a5-b90296e13776 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:07.178683 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebcfb42-b0ff-4899-91a5-b90296e13776 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:07.178956 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebcfb42-b0ff-4899-91a5-b90296e13776 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:07.180271 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebcfb42-b0ff-4899-91a5-b90296e13776 None admin] RBAC: Adding query filter params (role.id=a420b17212b94988beb75affe974355b, scope.project.id=488830167943488f85743236584113d7, user.id=f9b13331a5fd48f5a2521ed1600f9f35) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:07.180812 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebcfb42-b0ff-4899-91a5-b90296e13776 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:07.182491 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebcfb42-b0ff-4899-91a5-b90296e13776 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:07.196830 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 263/541] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 7 15:43:06 2022] GET /identity/v3/role_assignments?user.id=f9b13331a5fd48f5a2521ed1600f9f35&scope.project.id=488830167943488f85743236584113d7&role.id=a420b17212b94988beb75affe974355b => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:07.588160 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd28f42-66a9-4140-b3a1-3c8090b8d178 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:07.588385 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd28f42-66a9-4140-b3a1-3c8090b8d178 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:07.588756 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd28f42-66a9-4140-b3a1-3c8090b8d178 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:07.590809 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 279/542] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:43:07.596988 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecdef0d-921d-466b-90b4-dc9e3c6b43a1 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:07.597571 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecdef0d-921d-466b-90b4-dc9e3c6b43a1 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:07.598054 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecdef0d-921d-466b-90b4-dc9e3c6b43a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:07.614069 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d51c14-8169-4cc0-8844-7a4a726dc865 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:07.614735 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d51c14-8169-4cc0-8844-7a4a726dc865 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:07.615319 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d51c14-8169-4cc0-8844-7a4a726dc865 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:07.616875 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 280/543] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:43:07.626204 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5bf266-2194-4f6c-8511-d0f03fd60f16 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:07.626204 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5bf266-2194-4f6c-8511-d0f03fd60f16 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:07.626204 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5bf266-2194-4f6c-8511-d0f03fd60f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:07.629567 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-2ecdef0d-921d-466b-90b4-dc9e3c6b43a1 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:07.631073 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-2ecdef0d-921d-466b-90b4-dc9e3c6b43a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:07.645780 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-5d5bf266-2194-4f6c-8511-d0f03fd60f16 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:07.647029 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-5d5bf266-2194-4f6c-8511-d0f03fd60f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:07.723620 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 281/544] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:43:07.772092 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 264/545] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:43:08.107062 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5bf266-2194-4f6c-8511-d0f03fd60f16 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:08.141726 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecdef0d-921d-466b-90b4-dc9e3c6b43a1 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:08.236169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5bf266-2194-4f6c-8511-d0f03fd60f16 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:08.250522 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:08.278629 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:08.301510 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a933aa3-8c26-45e9-91a9-391d66f1d568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:08.302773 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a933aa3-8c26-45e9-91a9-391d66f1d568 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:08.303058 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a933aa3-8c26-45e9-91a9-391d66f1d568 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:08.303331 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a933aa3-8c26-45e9-91a9-391d66f1d568 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:08.307240 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecdef0d-921d-466b-90b4-dc9e3c6b43a1 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:08.317764 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a933aa3-8c26-45e9-91a9-391d66f1d568 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:43:08.326229 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-1a933aa3-8c26-45e9-91a9-391d66f1d568 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:43:08.326229 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:08.326229 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:08.326229 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:08.326229 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:08.326229 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:08.326229 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:08.326229 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:08.326229 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:08.326229 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:08.326229 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:08.326229 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:08.326229 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:43:08.326229 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:43:08.326229 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:43:08.326229 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:43:08.327176 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:43:08.327176 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:43:08.327176 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:43:08.327176 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:43:08.327176 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:08.327176 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:08.327176 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:08.327176 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:08.327176 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:08.327176 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:08.327176 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:08.327176 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:08.327176 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:08.327176 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:08.327176 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:08.327176 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:08.327967 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:08.327967 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:08.327967 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:08.327967 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:08.327967 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:43:08.327967 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:43:08.327967 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:43:08.327967 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:43:08.327967 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:43:08.327967 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:43:08.327967 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:43:08.327967 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:08.327967 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 282/546] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 7 15:43:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:08.332998 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a933aa3-8c26-45e9-91a9-391d66f1d568 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:08.384936 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99905c-6c3a-4d5f-bfa6-566b7aa2227e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:08.385588 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99905c-6c3a-4d5f-bfa6-566b7aa2227e None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:08.385873 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99905c-6c3a-4d5f-bfa6-566b7aa2227e None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:08.386155 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99905c-6c3a-4d5f-bfa6-566b7aa2227e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:08.415816 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca99905c-6c3a-4d5f-bfa6-566b7aa2227e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:43:08.422099 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-ca99905c-6c3a-4d5f-bfa6-566b7aa2227e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:43:08.422099 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:08.422099 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:08.422099 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:08.422099 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:08.422099 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:08.422099 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:08.422099 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:08.422099 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:08.422099 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:08.422099 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:08.422099 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:08.422099 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:43:08.422099 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:43:08.422099 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:43:08.422099 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:43:08.423195 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:43:08.423195 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:43:08.423195 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:43:08.423195 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:43:08.423195 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:08.423195 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:08.423195 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:08.423195 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:08.423195 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:08.423195 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:08.423195 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:08.423195 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:08.423195 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:08.423195 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:08.423195 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:08.423195 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:08.424176 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:08.424176 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:08.424176 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:08.424176 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:08.424176 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:43:08.424176 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:43:08.424176 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:43:08.424176 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:43:08.424176 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:43:08.424176 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:43:08.424176 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:43:08.424176 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:08.428069 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 265/547] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 7 15:43:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:08.430126 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99905c-6c3a-4d5f-bfa6-566b7aa2227e None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:08.455961 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a933aa3-8c26-45e9-91a9-391d66f1d568 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:08.511107 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e156fc9-c127-45ce-840f-e774de6d00fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:08.512032 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e156fc9-c127-45ce-840f-e774de6d00fb None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:08.513007 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e156fc9-c127-45ce-840f-e774de6d00fb None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:08.513422 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e156fc9-c127-45ce-840f-e774de6d00fb None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:08.514259 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e156fc9-c127-45ce-840f-e774de6d00fb None admin] RBAC: Adding query filter params (name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:08.514811 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e156fc9-c127-45ce-840f-e774de6d00fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:08.516372 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e156fc9-c127-45ce-840f-e774de6d00fb None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:08.525885 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 283/548] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 7 15:43:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:43:08.537816 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e156fc9-c127-45ce-840f-e774de6d00fb None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:08.601452 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99905c-6c3a-4d5f-bfa6-566b7aa2227e None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:08.607864 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:08.658846 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42bd17-cbad-4de9-b011-748ec5cc95dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:08.659467 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42bd17-cbad-4de9-b011-748ec5cc95dc None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:08.659748 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42bd17-cbad-4de9-b011-748ec5cc95dc None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:08.660024 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42bd17-cbad-4de9-b011-748ec5cc95dc None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:08.660698 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a42bd17-cbad-4de9-b011-748ec5cc95dc None admin] RBAC: Adding query filter params (name=service) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:08.661003 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a42bd17-cbad-4de9-b011-748ec5cc95dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:08.662409 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a42bd17-cbad-4de9-b011-748ec5cc95dc None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:08.684238 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 266/549] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 7 15:43:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:08.687990 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42bd17-cbad-4de9-b011-748ec5cc95dc None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:08.700748 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:08.746941 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e156fc9-c127-45ce-840f-e774de6d00fb None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:08.812484 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a742e-cd68-4f08-8267-28ccf098cc02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:08.813123 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a742e-cd68-4f08-8267-28ccf098cc02 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:08.813402 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a742e-cd68-4f08-8267-28ccf098cc02 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:08.813677 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a742e-cd68-4f08-8267-28ccf098cc02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:08.836782 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3a742e-cd68-4f08-8267-28ccf098cc02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:08.839952 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3a742e-cd68-4f08-8267-28ccf098cc02 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:08.875373 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-6e3a742e-cd68-4f08-8267-28ccf098cc02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:08.875373 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:08.875373 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:08.875373 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:08.875373 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:08.875373 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:08.875373 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:08.875373 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:08.875373 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:08.875373 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:08.875373 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:08.875373 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:08.875373 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:08.875373 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:08.875373 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:08.875373 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:08.876511 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:08.876511 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:08.876511 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:08.876511 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:08.876511 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:08.876511 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:08.876511 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:08.876511 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:08.876511 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:08.876511 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:08.876511 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:08.876511 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:08.876511 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:08.876511 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:08.876511 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:08.876511 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:08.876511 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:08.877362 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:08.877362 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:08.877362 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:08.877362 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 284/550] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:43:08.883940 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a742e-cd68-4f08-8267-28ccf098cc02 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:08.891829 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42bd17-cbad-4de9-b011-748ec5cc95dc None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:08.953997 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ad1c6-b02f-4f54-9046-6e2034a8a6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:08.955294 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ad1c6-b02f-4f54-9046-6e2034a8a6c1 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:08.955574 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ad1c6-b02f-4f54-9046-6e2034a8a6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:08.955849 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ad1c6-b02f-4f54-9046-6e2034a8a6c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:08.978051 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5ad1c6-b02f-4f54-9046-6e2034a8a6c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:08.979586 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5ad1c6-b02f-4f54-9046-6e2034a8a6c1 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:08.999532 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-5a5ad1c6-b02f-4f54-9046-6e2034a8a6c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:08.999532 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:08.999532 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:08.999532 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:08.999532 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:08.999532 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:08.999532 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:08.999532 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:08.999532 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:08.999532 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:08.999532 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:08.999532 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:08.999532 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:08.999532 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:08.999532 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:08.999532 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:09.000507 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:09.000507 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:09.000507 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:09.000507 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:09.000507 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:09.000507 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:09.000507 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:09.000507 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:09.000507 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:09.000507 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:09.000507 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:09.000507 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:09.000507 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:09.000507 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:09.000507 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:09.000507 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:09.000507 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:09.001523 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:09.001523 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:09.001523 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:09.003741 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 267/551] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:09.005290 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de42d97-97ac-4a54-a6a6-3a4c155baabd None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:09.005797 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de42d97-97ac-4a54-a6a6-3a4c155baabd None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:09.006323 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de42d97-97ac-4a54-a6a6-3a4c155baabd None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:09.008067 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 268/552] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:43:09.009052 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de42d97-97ac-4a54-a6a6-3a4c155baabd None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:09.027128 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:09.050882 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a742e-cd68-4f08-8267-28ccf098cc02 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:09.088122 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8dbd6-f70e-4300-9873-052f28ad304f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:09.088734 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8dbd6-f70e-4300-9873-052f28ad304f None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:09.089015 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8dbd6-f70e-4300-9873-052f28ad304f None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:09.089291 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8dbd6-f70e-4300-9873-052f28ad304f None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:09.089971 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e8dbd6-f70e-4300-9873-052f28ad304f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:09.090279 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e8dbd6-f70e-4300-9873-052f28ad304f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:09.091687 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:09.092523 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e8dbd6-f70e-4300-9873-052f28ad304f None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:09.106212 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 285/553] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:09.108169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3da7f3-b35b-455a-a164-87cc1e8868a1 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:09.108285 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3da7f3-b35b-455a-a164-87cc1e8868a1 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:09.108740 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3da7f3-b35b-455a-a164-87cc1e8868a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:09.128395 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-ce3da7f3-b35b-455a-a164-87cc1e8868a1 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:09.129571 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-ce3da7f3-b35b-455a-a164-87cc1e8868a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:09.142848 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de42d97-97ac-4a54-a6a6-3a4c155baabd None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:09.180570 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1946dc8-3dc9-4de1-ba08-85114d9cdb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:09.181514 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1946dc8-3dc9-4de1-ba08-85114d9cdb4b None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:09.181998 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1946dc8-3dc9-4de1-ba08-85114d9cdb4b None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:09.182490 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1946dc8-3dc9-4de1-ba08-85114d9cdb4b None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:09.183420 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1946dc8-3dc9-4de1-ba08-85114d9cdb4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:09.184594 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1946dc8-3dc9-4de1-ba08-85114d9cdb4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:09.186337 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1946dc8-3dc9-4de1-ba08-85114d9cdb4b None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:09.199281 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 269/554] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:09.200501 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1946dc8-3dc9-4de1-ba08-85114d9cdb4b None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:09.206427 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 286/555] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:43:09.207508 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3da7f3-b35b-455a-a164-87cc1e8868a1 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:09.307350 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1946dc8-3dc9-4de1-ba08-85114d9cdb4b None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:09.322227 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:09.331560 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:09.347539 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1094a6-3193-47eb-9161-c12794f2c6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:09.348527 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1094a6-3193-47eb-9161-c12794f2c6b3 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:09.349131 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1094a6-3193-47eb-9161-c12794f2c6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:09.349610 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1094a6-3193-47eb-9161-c12794f2c6b3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:09.358643 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1094a6-3193-47eb-9161-c12794f2c6b3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:09.360457 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1094a6-3193-47eb-9161-c12794f2c6b3 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:09.373052 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-8c1094a6-3193-47eb-9161-c12794f2c6b3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 07 15:43:09.373052 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:09.373052 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:09.373052 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:09.373052 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:09.373052 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:09.373052 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:09.373052 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:09.373052 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:09.373052 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:09.373052 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:09.373052 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:09.373052 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:43:09.373052 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:43:09.373052 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:43:09.373052 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:43:09.373974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:09.373974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:09.373974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:43:09.373974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:09.373974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:43:09.373974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:09.373974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:09.373974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:09.373974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:09.373974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:09.373974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:09.373974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:09.373974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:09.373974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:09.373974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:09.373974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:09.373974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:09.373974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:09.374907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:09.374907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:09.374907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:43:09.374907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:43:09.374907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:43:09.374907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:43:09.374907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:43:09.374907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:43:09.374907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 07 15:43:09.374907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:09.378093 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 270/556] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 7 15:43:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:09.390476 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1094a6-3193-47eb-9161-c12794f2c6b3 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:09.403624 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3da7f3-b35b-455a-a164-87cc1e8868a1 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:09.494905 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d461e2b9-964c-4f04-acd3-856a9d6ae608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:09.495561 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461e2b9-964c-4f04-acd3-856a9d6ae608 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:09.495869 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461e2b9-964c-4f04-acd3-856a9d6ae608 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:09.496139 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461e2b9-964c-4f04-acd3-856a9d6ae608 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:09.517606 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d461e2b9-964c-4f04-acd3-856a9d6ae608 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:09.519122 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d461e2b9-964c-4f04-acd3-856a9d6ae608 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:09.533387 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-d461e2b9-964c-4f04-acd3-856a9d6ae608 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 07 15:43:09.533387 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:09.533387 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:09.533387 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:09.533387 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:09.533387 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:09.533387 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:09.533387 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:09.533387 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:09.533387 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:09.533387 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:09.533387 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:09.533387 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:43:09.533387 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:43:09.533387 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:43:09.533387 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:43:09.534817 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:09.534817 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:09.534817 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:43:09.534817 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:09.534817 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:43:09.534817 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:09.534817 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:09.534817 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:09.534817 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:09.534817 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:09.534817 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:09.534817 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:09.534817 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:09.534817 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:09.534817 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:09.534817 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:09.534817 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:09.534817 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:09.535751 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:09.535751 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:09.535751 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:43:09.535751 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:43:09.535751 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:43:09.535751 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:43:09.535751 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:43:09.535751 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:43:09.535751 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 07 15:43:09.535751 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:09.535751 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 287/557] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:43:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:09.536338 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb40691-369c-43b5-964d-1202b2abed53 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:09.536338 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb40691-369c-43b5-964d-1202b2abed53 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:09.538153 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb40691-369c-43b5-964d-1202b2abed53 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:09.542385 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 288/558] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:43:09.543164 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb40691-369c-43b5-964d-1202b2abed53 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:09.557792 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1094a6-3193-47eb-9161-c12794f2c6b3 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:09.594744 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d964c-f217-4826-b6e4-fd7aeecc46f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:09.595358 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d964c-f217-4826-b6e4-fd7aeecc46f8 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:09.595645 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d964c-f217-4826-b6e4-fd7aeecc46f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:09.595921 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d964c-f217-4826-b6e4-fd7aeecc46f8 None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:09.596656 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d964c-f217-4826-b6e4-fd7aeecc46f8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:09.596964 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d964c-f217-4826-b6e4-fd7aeecc46f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:09.598462 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d964c-f217-4826-b6e4-fd7aeecc46f8 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:09.618225 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 271/559] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Sep 7 15:43:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:43:09.618540 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5eb6cd-9c96-4cf2-b071-a6903e0c62c1 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:09.618792 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5eb6cd-9c96-4cf2-b071-a6903e0c62c1 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:09.619129 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5eb6cd-9c96-4cf2-b071-a6903e0c62c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:09.640274 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-7b5eb6cd-9c96-4cf2-b071-a6903e0c62c1 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:09.641596 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-7b5eb6cd-9c96-4cf2-b071-a6903e0c62c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:09.661396 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb40691-369c-43b5-964d-1202b2abed53 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:09.673895 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:09.691367 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:09.700761 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e744937-14dc-46f4-8a75-61d9fb413b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:09.701495 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e744937-14dc-46f4-8a75-61d9fb413b6f None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:09.701701 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e744937-14dc-46f4-8a75-61d9fb413b6f None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:09.701930 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e744937-14dc-46f4-8a75-61d9fb413b6f None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:09.702684 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e744937-14dc-46f4-8a75-61d9fb413b6f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:09.702995 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e744937-14dc-46f4-8a75-61d9fb413b6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:09.704440 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e744937-14dc-46f4-8a75-61d9fb413b6f None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:09.722368 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 272/560] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:43:09.722368 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5eb6cd-9c96-4cf2-b071-a6903e0c62c1 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:09.730205 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 289/561] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Sep 7 15:43:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:09.735171 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e744937-14dc-46f4-8a75-61d9fb413b6f None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:09.827460 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5eb6cd-9c96-4cf2-b071-a6903e0c62c1 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:09.875256 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6b56a-9f81-4b3f-9bd1-851bd3f9cdda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:09.876173 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6b56a-9f81-4b3f-9bd1-851bd3f9cdda None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:09.876403 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e744937-14dc-46f4-8a75-61d9fb413b6f None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:09.877080 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6b56a-9f81-4b3f-9bd1-851bd3f9cdda None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:09.877496 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6b56a-9f81-4b3f-9bd1-851bd3f9cdda None admin] PATH_INFO: `/v3/roles/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:09.889160 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f6b56a-9f81-4b3f-9bd1-851bd3f9cdda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:43:09.894627 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-a4f6b56a-9f81-4b3f-9bd1-851bd3f9cdda None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:43:09.894627 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:09.894627 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:09.894627 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:09.894627 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:09.894627 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:09.894627 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:09.894627 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:09.894627 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:09.894627 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:09.894627 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:09.894627 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:09.894627 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:43:09.894627 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:43:09.894627 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:43:09.894627 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:43:09.896097 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:43:09.896097 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:43:09.896097 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:43:09.896097 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:43:09.896097 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:09.896097 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:09.896097 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:09.896097 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:09.896097 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:09.896097 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:09.896097 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:09.896097 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:09.896097 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:09.896097 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:09.896097 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:09.896097 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:09.897124 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:09.897124 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:09.897124 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:09.897124 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:09.897124 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:43:09.897124 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:43:09.897124 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:43:09.897124 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:43:09.897124 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:43:09.897124 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:43:09.897124 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:43:09.897124 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:09.899605 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 273/562] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 7 15:43:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:09.900654 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6b56a-9f81-4b3f-9bd1-851bd3f9cdda None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:09.920563 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e89a1f-dd55-4dfc-92ee-5bf094dbae1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:09.921183 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e89a1f-dd55-4dfc-92ee-5bf094dbae1d None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:09.921457 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e89a1f-dd55-4dfc-92ee-5bf094dbae1d None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:09.921737 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e89a1f-dd55-4dfc-92ee-5bf094dbae1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:09.932425 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:09.994049 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:10.010443 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6b56a-9f81-4b3f-9bd1-851bd3f9cdda None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:10.010611 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e89a1f-dd55-4dfc-92ee-5bf094dbae1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:10.012977 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e89a1f-dd55-4dfc-92ee-5bf094dbae1d None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:10.046216 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495722f4-f912-4ffb-9a2b-e62272e58cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:10.046845 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495722f4-f912-4ffb-9a2b-e62272e58cfa None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:10.047103 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495722f4-f912-4ffb-9a2b-e62272e58cfa None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:10.047372 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495722f4-f912-4ffb-9a2b-e62272e58cfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:10.057252 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495722f4-f912-4ffb-9a2b-e62272e58cfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:10.058754 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495722f4-f912-4ffb-9a2b-e62272e58cfa None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:10.073468 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-495722f4-f912-4ffb-9a2b-e62272e58cfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:10.073468 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:10.073468 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:10.073468 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:10.073468 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:10.073468 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:10.073468 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:10.073468 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:10.073468 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:10.073468 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:10.073468 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:10.073468 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:10.073468 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:10.073468 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:10.073468 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:10.073468 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:10.074456 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:10.074456 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:10.074456 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:10.074456 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:10.074456 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:10.074456 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:10.074456 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:10.074456 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:10.074456 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:10.074456 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:10.074456 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:10.074456 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:10.074456 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:10.074456 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:10.074456 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:10.074456 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:10.074456 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:10.076221 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:10.076221 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:10.076221 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:10.076221 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 274/563] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:10.076221 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495722f4-f912-4ffb-9a2b-e62272e58cfa None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:10.121365 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 290/564] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:43:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:43:10.122748 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219a73c-f450-46b1-8b2c-67c545c7e683 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:10.123034 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219a73c-f450-46b1-8b2c-67c545c7e683 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:10.123305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219a73c-f450-46b1-8b2c-67c545c7e683 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:10.126213 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 291/565] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:43:10.126213 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7219a73c-f450-46b1-8b2c-67c545c7e683 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:10.156622 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:10.178054 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495722f4-f912-4ffb-9a2b-e62272e58cfa None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:10.212160 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4609fe61-fffc-4b2f-969f-cfde8e4a3b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:10.212759 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4609fe61-fffc-4b2f-969f-cfde8e4a3b74 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:10.213040 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4609fe61-fffc-4b2f-969f-cfde8e4a3b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:10.213317 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4609fe61-fffc-4b2f-969f-cfde8e4a3b74 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:10.213973 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4609fe61-fffc-4b2f-969f-cfde8e4a3b74 None admin] RBAC: Adding query filter params (name=service) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:10.214307 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4609fe61-fffc-4b2f-969f-cfde8e4a3b74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:10.216316 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4609fe61-fffc-4b2f-969f-cfde8e4a3b74 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:10.220080 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:10.224413 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 275/566] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 7 15:43:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:10.225203 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4609fe61-fffc-4b2f-969f-cfde8e4a3b74 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:10.236682 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7219a73c-f450-46b1-8b2c-67c545c7e683 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:10.270262 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35917e8c-dcd1-465e-82fc-f464006bbe49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:10.270886 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35917e8c-dcd1-465e-82fc-f464006bbe49 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:10.271164 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35917e8c-dcd1-465e-82fc-f464006bbe49 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:10.271435 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35917e8c-dcd1-465e-82fc-f464006bbe49 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:10.282147 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35917e8c-dcd1-465e-82fc-f464006bbe49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:43:10.287154 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-35917e8c-dcd1-465e-82fc-f464006bbe49 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:43:10.287154 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:10.287154 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:10.287154 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:10.287154 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:10.287154 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:10.287154 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:10.287154 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:10.287154 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:10.287154 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:10.287154 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:10.287154 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:10.287154 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:43:10.287154 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:43:10.287154 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:43:10.287154 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:43:10.288085 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:43:10.288085 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:43:10.288085 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:43:10.288085 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:43:10.288085 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:10.288085 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:10.288085 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:10.288085 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:10.288085 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:10.288085 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:10.288085 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:10.288085 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:10.288085 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:10.288085 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:10.288085 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:10.288085 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:10.288937 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:10.288937 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:10.288937 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:10.288937 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:10.288937 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:43:10.288937 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:43:10.288937 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:43:10.288937 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:43:10.288937 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:43:10.288937 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:43:10.288937 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:43:10.288937 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:10.288937 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 292/567] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 7 15:43:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:10.289634 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35917e8c-dcd1-465e-82fc-f464006bbe49 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:10.330324 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4609fe61-fffc-4b2f-969f-cfde8e4a3b74 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:10.363735 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6757d03e-09e0-43f9-a132-41da6ffe5b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:10.364340 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757d03e-09e0-43f9-a132-41da6ffe5b2c None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:10.364623 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757d03e-09e0-43f9-a132-41da6ffe5b2c None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:10.364907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757d03e-09e0-43f9-a132-41da6ffe5b2c None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:10.365547 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6757d03e-09e0-43f9-a132-41da6ffe5b2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:10.365853 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6757d03e-09e0-43f9-a132-41da6ffe5b2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:10.367259 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6757d03e-09e0-43f9-a132-41da6ffe5b2c None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:10.376950 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:10.380266 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 276/568] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:10.381563 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce65494-fd8a-4237-9892-71abb026e014 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:10.381855 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce65494-fd8a-4237-9892-71abb026e014 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:10.382131 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce65494-fd8a-4237-9892-71abb026e014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:10.393975 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35917e8c-dcd1-465e-82fc-f464006bbe49 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:10.400349 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-fce65494-fd8a-4237-9892-71abb026e014 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:10.401543 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-fce65494-fd8a-4237-9892-71abb026e014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:10.428290 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44006147-d0e4-4a77-a4b2-1590cf62c003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:10.428914 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44006147-d0e4-4a77-a4b2-1590cf62c003 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:10.429192 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44006147-d0e4-4a77-a4b2-1590cf62c003 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:10.429461 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44006147-d0e4-4a77-a4b2-1590cf62c003 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:10.439534 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44006147-d0e4-4a77-a4b2-1590cf62c003 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:10.440953 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44006147-d0e4-4a77-a4b2-1590cf62c003 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:10.447730 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:10.456672 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-44006147-d0e4-4a77-a4b2-1590cf62c003 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:10.456672 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:10.456672 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:10.456672 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:10.456672 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:10.456672 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:10.456672 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:10.456672 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:10.456672 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:10.456672 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:10.456672 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:10.456672 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:10.456672 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:10.456672 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:10.456672 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:10.456672 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:10.457630 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:10.457630 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:10.457630 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:10.457630 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:10.457630 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:10.457630 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:10.457630 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:10.457630 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:10.457630 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:10.457630 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:10.457630 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:10.457630 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:10.457630 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:10.457630 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:10.457630 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:10.457630 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:10.457630 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:10.458858 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:10.458858 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:10.458858 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:10.458858 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 293/569] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:10.458858 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44006147-d0e4-4a77-a4b2-1590cf62c003 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:10.471472 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 277/570] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:43:10.472396 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce65494-fd8a-4237-9892-71abb026e014 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:10.575290 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44006147-d0e4-4a77-a4b2-1590cf62c003 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:10.591999 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce65494-fd8a-4237-9892-71abb026e014 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:10.610654 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca46e3-a6a9-4203-ae23-c437b65d4ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:10.611276 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca46e3-a6a9-4203-ae23-c437b65d4ecf None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:10.611559 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca46e3-a6a9-4203-ae23-c437b65d4ecf None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:10.611834 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca46e3-a6a9-4203-ae23-c437b65d4ecf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:10.621300 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:10.623099 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca46e3-a6a9-4203-ae23-c437b65d4ecf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:10.624656 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca46e3-a6a9-4203-ae23-c437b65d4ecf None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:10.628787 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69859b3f-8669-4d0b-b855-9686c1aeb994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:10.629612 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69859b3f-8669-4d0b-b855-9686c1aeb994 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:10.630066 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69859b3f-8669-4d0b-b855-9686c1aeb994 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:10.630538 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69859b3f-8669-4d0b-b855-9686c1aeb994 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:10.631780 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69859b3f-8669-4d0b-b855-9686c1aeb994 None admin] RBAC: Adding query filter params (name=service) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:10.632263 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69859b3f-8669-4d0b-b855-9686c1aeb994 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:10.634254 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69859b3f-8669-4d0b-b855-9686c1aeb994 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:10.639608 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-0dca46e3-a6a9-4203-ae23-c437b65d4ecf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:10.639608 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:10.639608 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:10.639608 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:10.639608 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:10.639608 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:10.639608 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:10.639608 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:10.639608 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:10.639608 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:10.639608 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:10.639608 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:10.639608 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:10.639608 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:10.639608 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:10.639608 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:10.640531 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:10.640531 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:10.640531 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:10.640531 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:10.640531 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:10.640531 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:10.640531 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:10.640531 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:10.640531 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:10.640531 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:10.640531 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:10.640531 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:10.640531 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:10.640531 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:10.640531 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:10.640531 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:10.640531 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:10.641416 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:10.641416 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:10.641416 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:10.641416 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 294/571] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:10.641733 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca46e3-a6a9-4203-ae23-c437b65d4ecf None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:10.648826 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 278/572] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 7 15:43:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:10.649830 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69859b3f-8669-4d0b-b855-9686c1aeb994 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:10.700846 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:10.754154 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca46e3-a6a9-4203-ae23-c437b65d4ecf None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:10.756292 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69859b3f-8669-4d0b-b855-9686c1aeb994 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:10.787746 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81359bc8-cdf6-49ec-8ab6-51b2451b95e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:10.788367 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81359bc8-cdf6-49ec-8ab6-51b2451b95e7 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:10.788644 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81359bc8-cdf6-49ec-8ab6-51b2451b95e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:10.788915 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81359bc8-cdf6-49ec-8ab6-51b2451b95e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:10.790241 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586df865-bf6d-45a0-a385-ae197c4af46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:10.790844 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586df865-bf6d-45a0-a385-ae197c4af46d None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:10.791123 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586df865-bf6d-45a0-a385-ae197c4af46d None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:10.791398 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586df865-bf6d-45a0-a385-ae197c4af46d None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:10.792039 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586df865-bf6d-45a0-a385-ae197c4af46d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:10.792343 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586df865-bf6d-45a0-a385-ae197c4af46d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:10.794266 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586df865-bf6d-45a0-a385-ae197c4af46d None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:10.795997 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81359bc8-cdf6-49ec-8ab6-51b2451b95e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:10.797404 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81359bc8-cdf6-49ec-8ab6-51b2451b95e7 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:10.805740 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 279/573] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:10.811008 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586df865-bf6d-45a0-a385-ae197c4af46d None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:10.811104 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-81359bc8-cdf6-49ec-8ab6-51b2451b95e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:10.811104 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:10.811104 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:10.811104 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:10.811104 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:10.811104 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:10.811104 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:10.811104 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:10.811104 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:10.811104 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:10.811104 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:10.811104 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:10.811104 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:43:10.811104 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:43:10.811104 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:43:10.811993 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:43:10.811993 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:10.811993 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:10.811993 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:10.811993 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:10.811993 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:10.811993 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:10.811993 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:10.811993 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:10.811993 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:10.811993 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:10.811993 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:10.811993 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:10.811993 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:10.811993 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:10.811993 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:10.811993 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:10.812881 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:43:10.812881 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:43:10.812881 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:43:10.812881 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:43:10.812881 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:43:10.812881 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:43:10.812881 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:10.812881 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:10.812881 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 295/574] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:43:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:10.812881 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81359bc8-cdf6-49ec-8ab6-51b2451b95e7 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:10.865315 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:10.909144 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81359bc8-cdf6-49ec-8ab6-51b2451b95e7 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:10.911678 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586df865-bf6d-45a0-a385-ae197c4af46d None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:10.924622 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:10.946507 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a7a550-8b70-4616-9cf8-db7b52f7182a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:10.947362 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a7a550-8b70-4616-9cf8-db7b52f7182a None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:10.947646 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a7a550-8b70-4616-9cf8-db7b52f7182a None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:10.947920 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a7a550-8b70-4616-9cf8-db7b52f7182a None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:10.948560 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a7a550-8b70-4616-9cf8-db7b52f7182a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:10.948864 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a7a550-8b70-4616-9cf8-db7b52f7182a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:10.950997 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a7a550-8b70-4616-9cf8-db7b52f7182a None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:10.951164 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e2dfd-6a4a-4849-90c0-8952ee08cb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:10.951787 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e2dfd-6a4a-4849-90c0-8952ee08cb74 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:10.952065 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e2dfd-6a4a-4849-90c0-8952ee08cb74 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:10.952339 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e2dfd-6a4a-4849-90c0-8952ee08cb74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:10.962682 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e2dfd-6a4a-4849-90c0-8952ee08cb74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:10.962841 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 280/575] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:10.963551 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a7a550-8b70-4616-9cf8-db7b52f7182a None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:10.964114 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e2dfd-6a4a-4849-90c0-8952ee08cb74 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:10.981122 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-f27e2dfd-6a4a-4849-90c0-8952ee08cb74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:10.981122 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:10.981122 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:10.981122 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:10.981122 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:10.981122 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:10.981122 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:10.981122 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:10.981122 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:10.981122 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:10.981122 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:10.981122 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:10.981122 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:10.981122 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:10.981122 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:10.981122 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:10.982583 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:10.982583 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:10.982583 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:10.982583 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:10.982583 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:10.982583 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:10.982583 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:10.982583 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:10.982583 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:10.982583 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:10.982583 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:10.982583 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:10.982583 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:10.982583 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:10.982583 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:10.982583 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:10.982583 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:10.983473 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:10.983473 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:10.983473 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:10.983473 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 296/576] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:10.983473 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e2dfd-6a4a-4849-90c0-8952ee08cb74 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:11.072330 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a7a550-8b70-4616-9cf8-db7b52f7182a None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:11.085242 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:11.088280 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e2dfd-6a4a-4849-90c0-8952ee08cb74 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:11.106643 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3acfca-e069-40bc-903b-4d706232fa6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:11.107542 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3acfca-e069-40bc-903b-4d706232fa6e None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:11.107818 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3acfca-e069-40bc-903b-4d706232fa6e None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:11.108095 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3acfca-e069-40bc-903b-4d706232fa6e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:11.117807 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3acfca-e069-40bc-903b-4d706232fa6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:43:11.121140 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f86447-d8b8-401d-9b2c-e2af275a740c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:11.121821 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f86447-d8b8-401d-9b2c-e2af275a740c None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:11.122097 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f86447-d8b8-401d-9b2c-e2af275a740c None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:11.122484 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f86447-d8b8-401d-9b2c-e2af275a740c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:11.123056 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-1e3acfca-e069-40bc-903b-4d706232fa6e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:43:11.123056 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:11.123056 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:11.123056 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:11.123056 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:11.123056 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:11.123056 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:11.123056 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:11.123056 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:11.123056 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:11.123056 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:11.123056 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:11.123056 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:43:11.123056 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:43:11.123056 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:43:11.123056 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:43:11.124148 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:43:11.124148 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:43:11.124148 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:43:11.124148 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:43:11.124148 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:11.124148 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:11.124148 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:11.124148 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:11.124148 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:11.124148 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:11.124148 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:11.124148 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:11.124148 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:11.124148 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:11.124148 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:11.124148 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:11.125125 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:11.125125 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:11.125125 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:11.125125 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:11.125125 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:43:11.125125 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:43:11.125125 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:43:11.125125 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:43:11.125125 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:43:11.125125 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:43:11.125125 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:43:11.125125 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:11.125125 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 281/577] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 7 15:43:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:11.125824 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3acfca-e069-40bc-903b-4d706232fa6e None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:11.135290 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f86447-d8b8-401d-9b2c-e2af275a740c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:11.136787 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f86447-d8b8-401d-9b2c-e2af275a740c None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:11.148229 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-88f86447-d8b8-401d-9b2c-e2af275a740c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:11.148229 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:11.148229 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:11.148229 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:11.148229 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:11.148229 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:11.148229 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:11.148229 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:11.148229 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:11.148229 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:11.148229 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:11.148229 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:11.148229 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:43:11.148229 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:43:11.148229 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:43:11.149225 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:43:11.149225 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:11.149225 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:11.149225 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:11.149225 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:11.149225 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:11.149225 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:11.149225 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:11.149225 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:11.149225 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:11.149225 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:11.149225 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:11.149225 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:11.149225 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:11.149225 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:11.149225 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:11.149225 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:11.150123 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:43:11.150123 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:43:11.150123 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:43:11.150123 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:43:11.150123 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:43:11.150123 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:43:11.150123 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:11.150123 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:11.150123 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 297/578] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:43:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:11.150123 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f86447-d8b8-401d-9b2c-e2af275a740c None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:11.174450 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:11.226407 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3acfca-e069-40bc-903b-4d706232fa6e None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:11.250198 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f86447-d8b8-401d-9b2c-e2af275a740c None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:11.258963 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b7281-f819-4a8e-b42c-f1d78b72dd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:11.259556 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b7281-f819-4a8e-b42c-f1d78b72dd73 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:11.259833 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b7281-f819-4a8e-b42c-f1d78b72dd73 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:11.260101 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b7281-f819-4a8e-b42c-f1d78b72dd73 None admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:11.260777 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24b7281-f819-4a8e-b42c-f1d78b72dd73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:11.261081 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24b7281-f819-4a8e-b42c-f1d78b72dd73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:11.262682 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24b7281-f819-4a8e-b42c-f1d78b72dd73 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:11.274317 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 282/579] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 7 15:43:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:11.275277 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b7281-f819-4a8e-b42c-f1d78b72dd73 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:11.283854 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ac608-0fa2-49cb-964d-a8112b603ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:11.284481 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ac608-0fa2-49cb-964d-a8112b603ec8 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:11.284761 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ac608-0fa2-49cb-964d-a8112b603ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:11.285035 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ac608-0fa2-49cb-964d-a8112b603ec8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:11.292407 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ac608-0fa2-49cb-964d-a8112b603ec8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:11.293884 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ac608-0fa2-49cb-964d-a8112b603ec8 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:11.304972 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-162ac608-0fa2-49cb-964d-a8112b603ec8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 15:43:11.304972 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:11.304972 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:11.304972 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:11.304972 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:11.304972 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:11.304972 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:11.304972 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:11.304972 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:11.304972 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:11.304972 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:11.304972 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:11.304972 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:43:11.304972 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:43:11.304972 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:43:11.304972 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:43:11.305943 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:11.305943 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:11.305943 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:43:11.305943 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:11.305943 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:43:11.305943 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:11.305943 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:11.305943 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:11.305943 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:11.305943 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:11.305943 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:11.305943 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:11.305943 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:11.305943 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:11.305943 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:11.305943 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:11.305943 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:11.305943 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:11.307103 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:11.307103 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:11.307103 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:43:11.307103 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:43:11.307103 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:43:11.307103 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:43:11.307103 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:43:11.307103 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:43:11.307103 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 15:43:11.307103 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:11.307103 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 298/580] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:43:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:11.307103 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ac608-0fa2-49cb-964d-a8112b603ec8 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:11.312553 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:11.381875 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b7281-f819-4a8e-b42c-f1d78b72dd73 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:11.389695 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:11.408063 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ac608-0fa2-49cb-964d-a8112b603ec8 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:11.415353 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826a243-85af-4145-8e5d-f6c07f4111c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:11.415960 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826a243-85af-4145-8e5d-f6c07f4111c1 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:11.416246 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826a243-85af-4145-8e5d-f6c07f4111c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:11.416526 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826a243-85af-4145-8e5d-f6c07f4111c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:11.417193 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e826a243-85af-4145-8e5d-f6c07f4111c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:11.417492 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e826a243-85af-4145-8e5d-f6c07f4111c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:11.419460 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e826a243-85af-4145-8e5d-f6c07f4111c1 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:11.430558 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 283/581] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:11.431340 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826a243-85af-4145-8e5d-f6c07f4111c1 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:11.441771 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966c4f2-1288-4ba7-8109-41e48e77ccc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:11.442411 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966c4f2-1288-4ba7-8109-41e48e77ccc6 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:11.442698 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966c4f2-1288-4ba7-8109-41e48e77ccc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:11.442978 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966c4f2-1288-4ba7-8109-41e48e77ccc6 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:11.443646 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3966c4f2-1288-4ba7-8109-41e48e77ccc6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:11.443954 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3966c4f2-1288-4ba7-8109-41e48e77ccc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:11.445329 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3966c4f2-1288-4ba7-8109-41e48e77ccc6 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:11.453305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 299/582] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 7 15:43:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:11.454068 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966c4f2-1288-4ba7-8109-41e48e77ccc6 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:11.527429 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:11.536356 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826a243-85af-4145-8e5d-f6c07f4111c1 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:11.551989 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966c4f2-1288-4ba7-8109-41e48e77ccc6 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:11.570449 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad718be-48b0-4811-900c-1e99ae6c8832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:11.571055 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad718be-48b0-4811-900c-1e99ae6c8832 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:11.571339 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad718be-48b0-4811-900c-1e99ae6c8832 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:11.571619 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad718be-48b0-4811-900c-1e99ae6c8832 None admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:11.572303 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad718be-48b0-4811-900c-1e99ae6c8832 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:11.572609 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad718be-48b0-4811-900c-1e99ae6c8832 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:11.574036 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad718be-48b0-4811-900c-1e99ae6c8832 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:11.585355 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0239ab-854b-4c86-a39c-1bdcab33b380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:11.586007 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0239ab-854b-4c86-a39c-1bdcab33b380 None admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:11.586315 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0239ab-854b-4c86-a39c-1bdcab33b380 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:11.586590 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0239ab-854b-4c86-a39c-1bdcab33b380 None admin] PATH_INFO: `/v3/projects/488830167943488f85743236584113d7/users/5753fea47f5944cd93dbea90fb9ad9b3/roles/a420b17212b94988beb75affe974355b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:11.588559 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 284/583] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 7 15:43:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:11.589361 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad718be-48b0-4811-900c-1e99ae6c8832 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:11.602691 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0239ab-854b-4c86-a39c-1bdcab33b380 None admin] RBAC: Authorizing `identity:create_grant(project_id=488830167943488f85743236584113d7, user_id=5753fea47f5944cd93dbea90fb9ad9b3, role_id=a420b17212b94988beb75affe974355b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:11.604135 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0239ab-854b-4c86-a39c-1bdcab33b380 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:11.606890 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:11.618151 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 300/584] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 7 15:43:11 2022] PUT /identity/v3/projects/488830167943488f85743236584113d7/users/5753fea47f5944cd93dbea90fb9ad9b3/roles/a420b17212b94988beb75affe974355b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:43:11.618954 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0239ab-854b-4c86-a39c-1bdcab33b380 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:11.709713 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad718be-48b0-4811-900c-1e99ae6c8832 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:11.737113 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0239ab-854b-4c86-a39c-1bdcab33b380 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:11.760612 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5eca59-a1d6-43b1-9a8d-dbe6c09373c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:11.761229 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5eca59-a1d6-43b1-9a8d-dbe6c09373c4 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:11.761789 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5eca59-a1d6-43b1-9a8d-dbe6c09373c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:11.762126 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5eca59-a1d6-43b1-9a8d-dbe6c09373c4 None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:11.762965 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5eca59-a1d6-43b1-9a8d-dbe6c09373c4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:11.763624 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5eca59-a1d6-43b1-9a8d-dbe6c09373c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:11.765874 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5eca59-a1d6-43b1-9a8d-dbe6c09373c4 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:11.775442 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed819cd-2a1a-4ca7-ac36-55a3457a9b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:11.776099 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed819cd-2a1a-4ca7-ac36-55a3457a9b3a None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:11.776377 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed819cd-2a1a-4ca7-ac36-55a3457a9b3a None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:11.776650 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed819cd-2a1a-4ca7-ac36-55a3457a9b3a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:11.784651 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed819cd-2a1a-4ca7-ac36-55a3457a9b3a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:11.787128 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed819cd-2a1a-4ca7-ac36-55a3457a9b3a None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:11.791574 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 285/585] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Sep 7 15:43:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:11.792631 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5eca59-a1d6-43b1-9a8d-dbe6c09373c4 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:11.802397 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-2ed819cd-2a1a-4ca7-ac36-55a3457a9b3a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 07 15:43:11.802397 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:11.802397 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:11.802397 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:11.802397 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:11.802397 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:11.802397 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:11.802397 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:11.802397 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:11.802397 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:11.802397 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:11.802397 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:11.802397 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:43:11.802397 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:43:11.802397 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:43:11.802397 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:43:11.803379 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:11.803379 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:11.803379 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:43:11.803379 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:11.803379 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:43:11.803379 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:11.803379 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:11.803379 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:11.803379 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:11.803379 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:11.803379 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:11.803379 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:11.803379 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:11.803379 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:11.803379 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:11.803379 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:11.803379 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:11.803379 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:11.804313 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:11.804313 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:11.804313 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:43:11.804313 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:43:11.804313 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:43:11.804313 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:43:11.804313 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:43:11.804313 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:43:11.804313 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 07 15:43:11.804313 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:11.804313 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 301/586] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 7 15:43:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:11.804892 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed819cd-2a1a-4ca7-ac36-55a3457a9b3a None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:11.810819 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:11.872493 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:11.903498 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5eca59-a1d6-43b1-9a8d-dbe6c09373c4 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:11.933810 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed819cd-2a1a-4ca7-ac36-55a3457a9b3a None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:11.939881 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd9b3e-d8db-43f0-ae3e-10eb39ef2548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:11.940516 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd9b3e-d8db-43f0-ae3e-10eb39ef2548 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:11.940794 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd9b3e-d8db-43f0-ae3e-10eb39ef2548 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:11.941070 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd9b3e-d8db-43f0-ae3e-10eb39ef2548 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:11.952140 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd9b3e-d8db-43f0-ae3e-10eb39ef2548 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:11.953594 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd9b3e-d8db-43f0-ae3e-10eb39ef2548 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:11.968337 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-adfd9b3e-d8db-43f0-ae3e-10eb39ef2548 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:11.968337 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:11.968337 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:11.968337 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:11.968337 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:11.968337 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:11.968337 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:11.968337 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:11.968337 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:11.968337 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:11.968337 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:11.968337 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:11.968337 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:11.968337 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:11.968337 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:11.968337 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:11.969322 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:11.969322 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:11.969322 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:11.969322 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:11.969322 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:11.969322 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:11.969322 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:11.969322 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:11.969322 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:11.969322 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:11.969322 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:11.969322 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:11.969322 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:11.969322 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:11.969322 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:11.969322 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:11.969322 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:11.970230 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:11.970230 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:11.970230 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:11.970230 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 286/587] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:11.970230 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd9b3e-d8db-43f0-ae3e-10eb39ef2548 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:11.975429 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7906ca-7001-4b44-b799-03008f873b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:11.976296 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7906ca-7001-4b44-b799-03008f873b05 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:11.976750 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7906ca-7001-4b44-b799-03008f873b05 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:11.977214 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7906ca-7001-4b44-b799-03008f873b05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:11.978113 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7906ca-7001-4b44-b799-03008f873b05 None admin] RBAC: Adding query filter params (role.id=a420b17212b94988beb75affe974355b, scope.project.id=488830167943488f85743236584113d7, user.id=16c4b090a4aa4d56a90ccf090b9caba8) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:11.978596 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7906ca-7001-4b44-b799-03008f873b05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:11.980157 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7906ca-7001-4b44-b799-03008f873b05 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:11.986788 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 302/588] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 7 15:43:11 2022] GET /identity/v3/role_assignments?user.id=16c4b090a4aa4d56a90ccf090b9caba8&scope.project.id=488830167943488f85743236584113d7&role.id=a420b17212b94988beb75affe974355b => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:11.987582 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7906ca-7001-4b44-b799-03008f873b05 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:12.067487 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:12.126553 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7906ca-7001-4b44-b799-03008f873b05 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:12.127320 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd9b3e-d8db-43f0-ae3e-10eb39ef2548 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:12.147508 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:12.170719 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada655e-5980-42d5-a271-6173b01d9a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:12.171341 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada655e-5980-42d5-a271-6173b01d9a14 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:12.171653 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada655e-5980-42d5-a271-6173b01d9a14 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:12.172002 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada655e-5980-42d5-a271-6173b01d9a14 None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:12.173034 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ada655e-5980-42d5-a271-6173b01d9a14 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:12.173211 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ada655e-5980-42d5-a271-6173b01d9a14 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:12.175404 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ada655e-5980-42d5-a271-6173b01d9a14 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:12.179922 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8dbbd-c017-4d54-a90a-329677eec5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:12.180680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8dbbd-c017-4d54-a90a-329677eec5ee None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:12.181064 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8dbbd-c017-4d54-a90a-329677eec5ee None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:12.181444 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8dbbd-c017-4d54-a90a-329677eec5ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:12.194483 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8dbbd-c017-4d54-a90a-329677eec5ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:12.196097 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8dbbd-c017-4d54-a90a-329677eec5ee None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:12.201791 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 303/589] 10.222.0.16 () {56 vars in 1139 bytes} [Wed Sep 7 15:43:11 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:12.202680 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada655e-5980-42d5-a271-6173b01d9a14 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:12.212865 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-8bb8dbbd-c017-4d54-a90a-329677eec5ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:12.212865 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:12.212865 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:12.212865 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:12.212865 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:12.212865 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:12.212865 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:12.212865 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:12.212865 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:12.212865 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:12.212865 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:12.212865 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:12.212865 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:12.212865 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:12.212865 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:12.212865 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:12.214032 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:12.214032 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:12.214032 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:12.214032 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:12.214032 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:12.214032 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:12.214032 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:12.214032 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:12.214032 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:12.214032 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:12.214032 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:12.214032 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:12.214032 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:12.214032 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:12.214032 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:12.214032 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:12.214032 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:12.215319 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:12.215319 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:12.215319 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:12.216420 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 287/590] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:12.217231 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8dbbd-c017-4d54-a90a-329677eec5ee None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:12.316590 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada655e-5980-42d5-a271-6173b01d9a14 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:12.326462 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8dbbd-c017-4d54-a90a-329677eec5ee None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:12.341715 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:12.358744 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e381a40-2328-4e27-9212-01ff4d95e846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:12.359565 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e381a40-2328-4e27-9212-01ff4d95e846 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:12.359920 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e381a40-2328-4e27-9212-01ff4d95e846 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:12.360342 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e381a40-2328-4e27-9212-01ff4d95e846 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:12.361095 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e381a40-2328-4e27-9212-01ff4d95e846 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:12.361497 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e381a40-2328-4e27-9212-01ff4d95e846 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:12.363060 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e381a40-2328-4e27-9212-01ff4d95e846 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:12.371671 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab307890-b2dc-4b31-b1b6-e628d106bf73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:12.372669 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab307890-b2dc-4b31-b1b6-e628d106bf73 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:12.373147 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab307890-b2dc-4b31-b1b6-e628d106bf73 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:12.374026 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab307890-b2dc-4b31-b1b6-e628d106bf73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:12.381310 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 304/591] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:12.381310 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e381a40-2328-4e27-9212-01ff4d95e846 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:12.392743 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab307890-b2dc-4b31-b1b6-e628d106bf73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:12.394780 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab307890-b2dc-4b31-b1b6-e628d106bf73 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:12.413543 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-ab307890-b2dc-4b31-b1b6-e628d106bf73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:12.413543 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:12.413543 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:12.413543 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:12.413543 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:12.413543 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:12.413543 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:12.413543 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:12.413543 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:12.413543 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:12.413543 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:12.413543 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:12.413543 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:12.413543 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:12.413543 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:12.413543 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:12.414759 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:12.414759 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:12.414759 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:12.414759 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:12.414759 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:12.414759 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:12.414759 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:12.414759 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:12.414759 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:12.414759 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:12.414759 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:12.414759 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:12.414759 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:12.414759 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:12.414759 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:12.414759 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:12.414759 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:12.415844 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:12.415844 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:12.415844 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:12.417238 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 288/592] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:12.418271 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab307890-b2dc-4b31-b1b6-e628d106bf73 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:12.426538 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:12.517834 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e381a40-2328-4e27-9212-01ff4d95e846 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:12.540338 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab307890-b2dc-4b31-b1b6-e628d106bf73 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:12.562815 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d958d-7dd2-4020-be42-e1d0867a1b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:12.564166 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d958d-7dd2-4020-be42-e1d0867a1b99 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:12.564604 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d958d-7dd2-4020-be42-e1d0867a1b99 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:12.565167 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d958d-7dd2-4020-be42-e1d0867a1b99 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:12.566058 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042d958d-7dd2-4020-be42-e1d0867a1b99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:12.566868 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042d958d-7dd2-4020-be42-e1d0867a1b99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:12.569086 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042d958d-7dd2-4020-be42-e1d0867a1b99 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:12.579570 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c896b8b-b987-4e0d-978b-18f7f9f304e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:12.579996 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c896b8b-b987-4e0d-978b-18f7f9f304e9 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:12.580379 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c896b8b-b987-4e0d-978b-18f7f9f304e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:12.580752 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c896b8b-b987-4e0d-978b-18f7f9f304e9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:12.586146 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 305/593] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:12.591714 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d958d-7dd2-4020-be42-e1d0867a1b99 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:12.593190 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c896b8b-b987-4e0d-978b-18f7f9f304e9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:12.594799 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c896b8b-b987-4e0d-978b-18f7f9f304e9 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:12.607763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-2c896b8b-b987-4e0d-978b-18f7f9f304e9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 15:43:12.607763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:12.607763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:12.607763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:12.607763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:12.607763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:12.607763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:12.607763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:12.607763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:12.607763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:12.607763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:12.607763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:12.607763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:43:12.607763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:43:12.607763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:43:12.607763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:43:12.608891 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:12.608891 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:12.608891 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:43:12.608891 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:12.608891 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:43:12.608891 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:12.608891 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:12.608891 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:12.608891 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:12.608891 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:12.608891 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:12.608891 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:12.608891 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:12.608891 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:12.608891 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:12.608891 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:12.608891 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:12.608891 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:12.610037 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:12.610037 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:12.610037 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:43:12.610037 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:43:12.610037 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:43:12.610037 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:43:12.610037 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:43:12.610037 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:43:12.610037 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 15:43:12.610037 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:12.616112 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 289/594] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Sep 7 15:43:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:12.617038 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c896b8b-b987-4e0d-978b-18f7f9f304e9 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:12.647652 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:12.724966 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:12.729480 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c896b8b-b987-4e0d-978b-18f7f9f304e9 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:12.734493 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d958d-7dd2-4020-be42-e1d0867a1b99 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:12.771722 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd711c-e888-4cbb-a3f5-d4972a7693ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:12.772493 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd711c-e888-4cbb-a3f5-d4972a7693ea None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:12.772895 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd711c-e888-4cbb-a3f5-d4972a7693ea None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:12.773268 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd711c-e888-4cbb-a3f5-d4972a7693ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:12.780543 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05cd99-aff4-407e-b82b-22c1b8d3fb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:12.781609 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05cd99-aff4-407e-b82b-22c1b8d3fb67 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:12.781957 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fd711c-e888-4cbb-a3f5-d4972a7693ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:12.782251 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05cd99-aff4-407e-b82b-22c1b8d3fb67 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:12.782673 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05cd99-aff4-407e-b82b-22c1b8d3fb67 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:12.783458 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f05cd99-aff4-407e-b82b-22c1b8d3fb67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:12.783864 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fd711c-e888-4cbb-a3f5-d4972a7693ea None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:12.784058 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f05cd99-aff4-407e-b82b-22c1b8d3fb67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:12.786012 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f05cd99-aff4-407e-b82b-22c1b8d3fb67 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:12.796893 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-66fd711c-e888-4cbb-a3f5-d4972a7693ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:12.796893 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:12.796893 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:12.796893 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:12.796893 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:12.796893 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:12.796893 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:12.796893 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:12.796893 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:12.796893 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:12.796893 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:12.796893 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:12.796893 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:43:12.796893 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:43:12.796893 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:43:12.797975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:43:12.797975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:12.797975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:12.797975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:12.797975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:12.797975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:12.797975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:12.797975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:12.797975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:12.797975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:12.797975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:12.797975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:12.797975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:12.797975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:12.797975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:12.797975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:12.797975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:12.799122 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:43:12.799122 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:43:12.799122 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:43:12.799122 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:43:12.799122 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:43:12.799122 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:43:12.799122 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:12.799122 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:12.805170 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 290/595] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:43:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:12.805170 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd711c-e888-4cbb-a3f5-d4972a7693ea None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:12.808012 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 306/596] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:12.809547 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05cd99-aff4-407e-b82b-22c1b8d3fb67 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:12.920876 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05cd99-aff4-407e-b82b-22c1b8d3fb67 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:12.924492 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:12.946859 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd711c-e888-4cbb-a3f5-d4972a7693ea None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:12.961439 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cdb532-7416-4b41-8997-c4be7c3bb2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:12.962595 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cdb532-7416-4b41-8997-c4be7c3bb2d7 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:12.963017 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cdb532-7416-4b41-8997-c4be7c3bb2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:12.963453 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cdb532-7416-4b41-8997-c4be7c3bb2d7 None admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:12.964475 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cdb532-7416-4b41-8997-c4be7c3bb2d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:12.964921 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cdb532-7416-4b41-8997-c4be7c3bb2d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:12.967201 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cdb532-7416-4b41-8997-c4be7c3bb2d7 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:12.981737 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 307/597] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 7 15:43:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:12.983243 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cdb532-7416-4b41-8997-c4be7c3bb2d7 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:12.993967 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab7997-5e4b-4329-a3a3-9073ada19b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:12.994831 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab7997-5e4b-4329-a3a3-9073ada19b19 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:12.995254 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab7997-5e4b-4329-a3a3-9073ada19b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:12.995666 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab7997-5e4b-4329-a3a3-9073ada19b19 None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:12.997759 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab7997-5e4b-4329-a3a3-9073ada19b19 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:12.998228 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab7997-5e4b-4329-a3a3-9073ada19b19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:13.000239 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab7997-5e4b-4329-a3a3-9073ada19b19 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:13.007722 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:13.030212 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 291/598] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Sep 7 15:43:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:13.030212 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab7997-5e4b-4329-a3a3-9073ada19b19 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:13.110523 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cdb532-7416-4b41-8997-c4be7c3bb2d7 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:13.147406 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0020c5e-b47a-478f-9546-108f59a994f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:13.148087 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0020c5e-b47a-478f-9546-108f59a994f9 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:13.148372 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0020c5e-b47a-478f-9546-108f59a994f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:13.148646 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0020c5e-b47a-478f-9546-108f59a994f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:13.155709 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0020c5e-b47a-478f-9546-108f59a994f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:13.157220 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0020c5e-b47a-478f-9546-108f59a994f9 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:13.164247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab7997-5e4b-4329-a3a3-9073ada19b19 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:13.169582 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-e0020c5e-b47a-478f-9546-108f59a994f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:13.169582 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:13.169582 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:13.169582 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:13.169582 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:13.169582 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:13.169582 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:13.169582 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:13.169582 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:13.169582 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:13.169582 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:13.169582 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:13.169582 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:43:13.169582 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:43:13.169582 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:43:13.170683 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:43:13.170683 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:13.170683 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:13.170683 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:13.170683 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:13.170683 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:13.170683 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:13.170683 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:13.170683 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:13.170683 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:13.170683 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:13.170683 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:13.170683 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:13.170683 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:13.170683 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:13.170683 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:13.170683 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:13.171679 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:43:13.171679 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:43:13.171679 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:43:13.171679 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:43:13.171679 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:43:13.171679 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:43:13.171679 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:13.171679 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:13.171679 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 308/599] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:43:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:13.172170 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0020c5e-b47a-478f-9546-108f59a994f9 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:13.215760 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e3083e-6f8f-4cd0-b2dc-d2b606bd1493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:13.216728 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3083e-6f8f-4cd0-b2dc-d2b606bd1493 None admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:13.217151 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3083e-6f8f-4cd0-b2dc-d2b606bd1493 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:13.217564 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3083e-6f8f-4cd0-b2dc-d2b606bd1493 None admin] PATH_INFO: `/v3/projects/488830167943488f85743236584113d7/users/99f8fac7bf3842cba115fa03ef9291d8/roles/a420b17212b94988beb75affe974355b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:13.235838 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e3083e-6f8f-4cd0-b2dc-d2b606bd1493 None admin] RBAC: Authorizing `identity:create_grant(project_id=488830167943488f85743236584113d7, user_id=99f8fac7bf3842cba115fa03ef9291d8, role_id=a420b17212b94988beb75affe974355b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:13.237496 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e3083e-6f8f-4cd0-b2dc-d2b606bd1493 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:13.240001 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:13.256774 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 292/600] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 7 15:43:13 2022] PUT /identity/v3/projects/488830167943488f85743236584113d7/users/99f8fac7bf3842cba115fa03ef9291d8/roles/a420b17212b94988beb75affe974355b => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:43:13.258140 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e3083e-6f8f-4cd0-b2dc-d2b606bd1493 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:13.268103 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:13.296543 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0020c5e-b47a-478f-9546-108f59a994f9 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:13.337066 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ca716-e55a-4dd3-ab61-274de7d999e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:13.337962 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ca716-e55a-4dd3-ab61-274de7d999e5 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:13.338284 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ca716-e55a-4dd3-ab61-274de7d999e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:13.338605 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ca716-e55a-4dd3-ab61-274de7d999e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:13.352414 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6ca716-e55a-4dd3-ab61-274de7d999e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:13.353908 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6ca716-e55a-4dd3-ab61-274de7d999e5 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:13.373114 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-be6ca716-e55a-4dd3-ab61-274de7d999e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:13.373114 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:13.373114 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:13.373114 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:13.373114 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:13.373114 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:13.373114 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:13.373114 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:13.373114 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:13.373114 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:13.373114 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:13.373114 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:13.373114 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:13.373114 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:13.373114 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:13.373114 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:13.374337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:13.374337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:13.374337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:13.374337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:13.374337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:13.374337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:13.374337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:13.374337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:13.374337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:13.374337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:13.374337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:13.374337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:13.374337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:13.374337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:13.374337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:13.374337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:13.374337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:13.375281 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:13.375281 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:13.375281 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:13.375281 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 309/601] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:13.380569 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ca716-e55a-4dd3-ab61-274de7d999e5 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:13.397179 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e3083e-6f8f-4cd0-b2dc-d2b606bd1493 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:13.444646 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed69924-67ba-4aff-90b7-542167e84e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:13.445712 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed69924-67ba-4aff-90b7-542167e84e0c None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:13.446549 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed69924-67ba-4aff-90b7-542167e84e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:13.447612 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed69924-67ba-4aff-90b7-542167e84e0c None admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:13.448604 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed69924-67ba-4aff-90b7-542167e84e0c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:13.450535 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed69924-67ba-4aff-90b7-542167e84e0c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:13.452075 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed69924-67ba-4aff-90b7-542167e84e0c None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:13.466328 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 293/602] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 7 15:43:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:13.472247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed69924-67ba-4aff-90b7-542167e84e0c None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:13.508120 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ca716-e55a-4dd3-ab61-274de7d999e5 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:13.534329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:13.545192 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:13.561543 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc76434-3781-4855-8c18-9f8f3d17a4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:13.562574 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc76434-3781-4855-8c18-9f8f3d17a4d0 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:13.565139 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc76434-3781-4855-8c18-9f8f3d17a4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:13.566982 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc76434-3781-4855-8c18-9f8f3d17a4d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:13.568616 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc76434-3781-4855-8c18-9f8f3d17a4d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:13.569304 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc76434-3781-4855-8c18-9f8f3d17a4d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:13.572446 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc76434-3781-4855-8c18-9f8f3d17a4d0 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:13.589089 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 310/603] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:13.595397 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc76434-3781-4855-8c18-9f8f3d17a4d0 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:13.602113 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed69924-67ba-4aff-90b7-542167e84e0c None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:13.657054 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100cadb1-c78d-4399-8b85-79208b6fdca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:13.657728 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100cadb1-c78d-4399-8b85-79208b6fdca9 None admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:13.658031 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100cadb1-c78d-4399-8b85-79208b6fdca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:13.658574 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100cadb1-c78d-4399-8b85-79208b6fdca9 None admin] PATH_INFO: `/v3/projects/488830167943488f85743236584113d7/users/3195fa62961c4d64972b88449d013380/roles/a420b17212b94988beb75affe974355b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:13.678596 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100cadb1-c78d-4399-8b85-79208b6fdca9 None admin] RBAC: Authorizing `identity:create_grant(project_id=488830167943488f85743236584113d7, user_id=3195fa62961c4d64972b88449d013380, role_id=a420b17212b94988beb75affe974355b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:13.680990 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100cadb1-c78d-4399-8b85-79208b6fdca9 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:13.702590 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 294/604] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 7 15:43:13 2022] PUT /identity/v3/projects/488830167943488f85743236584113d7/users/3195fa62961c4d64972b88449d013380/roles/a420b17212b94988beb75affe974355b => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:43:13.725787 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc76434-3781-4855-8c18-9f8f3d17a4d0 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:13.767811 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c431a44-7554-4439-bda1-34f9aa0bf33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:13.768470 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c431a44-7554-4439-bda1-34f9aa0bf33c None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:13.768754 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c431a44-7554-4439-bda1-34f9aa0bf33c None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:13.769030 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c431a44-7554-4439-bda1-34f9aa0bf33c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:13.776774 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c431a44-7554-4439-bda1-34f9aa0bf33c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:13.779044 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c431a44-7554-4439-bda1-34f9aa0bf33c None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:13.792752 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-5c431a44-7554-4439-bda1-34f9aa0bf33c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:13.792752 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:13.792752 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:13.792752 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:13.792752 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:13.792752 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:13.792752 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:13.792752 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:13.792752 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:13.792752 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:13.792752 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:13.792752 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:13.792752 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:43:13.792752 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:43:13.792752 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:43:13.794287 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:43:13.794287 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:13.794287 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:13.794287 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:13.794287 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:13.794287 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:13.794287 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:13.794287 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:13.794287 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:13.794287 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:13.794287 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:13.794287 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:13.794287 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:13.794287 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:13.794287 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:13.794287 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:13.794287 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:13.795650 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:43:13.795650 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:43:13.795650 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:43:13.795650 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:43:13.795650 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:43:13.795650 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:43:13.795650 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:13.795650 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:13.795650 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 311/605] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:43:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:13.803215 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100cadb1-c78d-4399-8b85-79208b6fdca9 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:13.927730 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12f920-e770-48cd-a36d-ca3390997f07 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:13.928069 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12f920-e770-48cd-a36d-ca3390997f07 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:13.928280 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12f920-e770-48cd-a36d-ca3390997f07 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:13.929782 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 312/606] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:43:13.934725 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100cadb1-c78d-4399-8b85-79208b6fdca9 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:13.936621 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97387bd-4530-402d-97d6-8f0572d14cf6 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:13.937121 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97387bd-4530-402d-97d6-8f0572d14cf6 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:13.937595 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97387bd-4530-402d-97d6-8f0572d14cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:13.946897 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:13.962166 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-b97387bd-4530-402d-97d6-8f0572d14cf6 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:13.964164 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-b97387bd-4530-402d-97d6-8f0572d14cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:13.978120 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9824512-cf3d-4ff7-84ec-b867014ffb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:13.978765 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9824512-cf3d-4ff7-84ec-b867014ffb33 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:13.979042 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9824512-cf3d-4ff7-84ec-b867014ffb33 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:13.979314 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9824512-cf3d-4ff7-84ec-b867014ffb33 None admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:13.980290 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9824512-cf3d-4ff7-84ec-b867014ffb33 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:13.980599 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9824512-cf3d-4ff7-84ec-b867014ffb33 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:13.983560 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9824512-cf3d-4ff7-84ec-b867014ffb33 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:14.000999 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 295/607] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 7 15:43:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:14.006322 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9824512-cf3d-4ff7-84ec-b867014ffb33 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:14.023847 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:14.057254 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 313/608] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:43:14.121759 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9824512-cf3d-4ff7-84ec-b867014ffb33 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:14.155998 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b93819-1177-4e68-b8f8-8298970a851f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:14.156656 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b93819-1177-4e68-b8f8-8298970a851f None admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:14.156934 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b93819-1177-4e68-b8f8-8298970a851f None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:14.157204 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b93819-1177-4e68-b8f8-8298970a851f None admin] PATH_INFO: `/v3/projects/488830167943488f85743236584113d7/users/f9b13331a5fd48f5a2521ed1600f9f35/roles/a420b17212b94988beb75affe974355b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:14.172915 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b93819-1177-4e68-b8f8-8298970a851f None admin] RBAC: Authorizing `identity:create_grant(project_id=488830167943488f85743236584113d7, user_id=f9b13331a5fd48f5a2521ed1600f9f35, role_id=a420b17212b94988beb75affe974355b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:14.174385 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b93819-1177-4e68-b8f8-8298970a851f None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:14.189661 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 296/609] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 7 15:43:14 2022] PUT /identity/v3/projects/488830167943488f85743236584113d7/users/f9b13331a5fd48f5a2521ed1600f9f35/roles/a420b17212b94988beb75affe974355b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:43:14.345617 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97387bd-4530-402d-97d6-8f0572d14cf6 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:14.469611 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de59e51-9a04-464a-8790-fdfb5891ca84 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:14.470035 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de59e51-9a04-464a-8790-fdfb5891ca84 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:14.470161 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de59e51-9a04-464a-8790-fdfb5891ca84 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:14.471887 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 297/610] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:43:14.477439 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322cd0bf-1615-46ae-9eec-26c41748945e None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:14.477771 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322cd0bf-1615-46ae-9eec-26c41748945e None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:14.477995 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322cd0bf-1615-46ae-9eec-26c41748945e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:14.479707 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97387bd-4530-402d-97d6-8f0572d14cf6 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:14.509049 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-322cd0bf-1615-46ae-9eec-26c41748945e None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:14.510314 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-322cd0bf-1615-46ae-9eec-26c41748945e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:14.529856 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:14.530975 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923aac3a-246a-41dc-b4e8-c5eddef0f0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:14.531657 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923aac3a-246a-41dc-b4e8-c5eddef0f0ab None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:14.531935 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923aac3a-246a-41dc-b4e8-c5eddef0f0ab None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:14.532210 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923aac3a-246a-41dc-b4e8-c5eddef0f0ab None admin] PATH_INFO: `/v3/roles/service` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:14.554256 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923aac3a-246a-41dc-b4e8-c5eddef0f0ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:43:14.560104 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-923aac3a-246a-41dc-b4e8-c5eddef0f0ab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:43:14.560104 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:14.560104 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:14.560104 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:14.560104 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:14.560104 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:14.560104 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:14.560104 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:14.560104 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:14.560104 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:14.560104 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:14.560104 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:14.560104 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:43:14.560104 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:43:14.560104 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:43:14.560104 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:43:14.561080 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:43:14.561080 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:43:14.561080 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:43:14.561080 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:43:14.561080 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:14.561080 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:14.561080 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:14.561080 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:14.561080 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:14.561080 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:14.561080 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:14.561080 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:14.561080 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:14.561080 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:14.561080 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:14.561080 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:14.561983 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:14.561983 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:14.561983 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:14.561983 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:14.561983 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:43:14.561983 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:43:14.561983 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:43:14.561983 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:43:14.561983 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:43:14.561983 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:43:14.561983 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:43:14.561983 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:14.561983 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 314/611] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 7 15:43:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:14.568309 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923aac3a-246a-41dc-b4e8-c5eddef0f0ab None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:14.617439 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:14.622500 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 298/612] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:43:14.688618 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923aac3a-246a-41dc-b4e8-c5eddef0f0ab None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:14.723858 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86301f1-050a-4628-ad05-8a9d00eb1d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:14.724473 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86301f1-050a-4628-ad05-8a9d00eb1d8b None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:14.724811 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86301f1-050a-4628-ad05-8a9d00eb1d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:14.725088 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86301f1-050a-4628-ad05-8a9d00eb1d8b None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:14.725804 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86301f1-050a-4628-ad05-8a9d00eb1d8b None admin] RBAC: Adding query filter params (name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:14.726115 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86301f1-050a-4628-ad05-8a9d00eb1d8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:14.727528 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86301f1-050a-4628-ad05-8a9d00eb1d8b None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:14.741316 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 315/613] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 7 15:43:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:14.747736 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322cd0bf-1615-46ae-9eec-26c41748945e None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:14.859799 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322cd0bf-1615-46ae-9eec-26c41748945e None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:14.895783 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db7a7b-910a-4450-bc20-446d2442e3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:14.896338 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db7a7b-910a-4450-bc20-446d2442e3df None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:14.896620 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db7a7b-910a-4450-bc20-446d2442e3df None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:14.896891 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db7a7b-910a-4450-bc20-446d2442e3df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:14.908472 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db7a7b-910a-4450-bc20-446d2442e3df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:14.909922 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db7a7b-910a-4450-bc20-446d2442e3df None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:14.912566 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:14.925680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-b2db7a7b-910a-4450-bc20-446d2442e3df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:14.925680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:14.925680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:14.925680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:14.925680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:14.925680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:14.925680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:14.925680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:14.925680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:14.925680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:14.925680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:14.925680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:14.925680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:14.925680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:14.925680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:14.925680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:14.926763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:14.926763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:14.926763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:14.926763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:14.926763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:14.926763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:14.926763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:14.926763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:14.926763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:14.926763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:14.926763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:14.926763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:14.926763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:14.926763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:14.926763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:14.926763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:14.926763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:14.927635 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:14.927635 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:14.927635 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:14.931493 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 299/614] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:14.937617 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86301f1-050a-4628-ad05-8a9d00eb1d8b None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:14.969889 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db7a7b-910a-4450-bc20-446d2442e3df None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:15.086657 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:15.093288 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86301f1-050a-4628-ad05-8a9d00eb1d8b None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:15.166146 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c841ff-809d-457c-8d9f-fbbfd30339ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:15.166743 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c841ff-809d-457c-8d9f-fbbfd30339ef None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:15.167025 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c841ff-809d-457c-8d9f-fbbfd30339ef None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:15.167305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c841ff-809d-457c-8d9f-fbbfd30339ef None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:15.167953 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c841ff-809d-457c-8d9f-fbbfd30339ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:15.168278 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c841ff-809d-457c-8d9f-fbbfd30339ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:15.170123 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c841ff-809d-457c-8d9f-fbbfd30339ef None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:15.198157 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db7a7b-910a-4450-bc20-446d2442e3df None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:15.199960 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 316/615] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:15.202031 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c841ff-809d-457c-8d9f-fbbfd30339ef None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:15.267986 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e58701-ca7d-49d0-8179-97e9940a38b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:15.268627 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e58701-ca7d-49d0-8179-97e9940a38b7 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:15.268909 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e58701-ca7d-49d0-8179-97e9940a38b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:15.269184 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e58701-ca7d-49d0-8179-97e9940a38b7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:15.291105 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e58701-ca7d-49d0-8179-97e9940a38b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:43:15.302466 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-43e58701-ca7d-49d0-8179-97e9940a38b7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:43:15.302466 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:15.302466 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:15.302466 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:15.302466 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:15.302466 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:15.302466 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:15.302466 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:15.302466 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:15.302466 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:15.302466 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:15.302466 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:15.302466 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:43:15.302466 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:43:15.302466 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:43:15.302466 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:43:15.303417 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:43:15.303417 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:43:15.303417 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:43:15.303417 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:43:15.303417 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:15.303417 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:15.303417 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:15.303417 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:15.303417 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:15.303417 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:15.303417 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:15.303417 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:15.303417 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:15.303417 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:15.303417 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:15.303417 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:15.309061 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:15.309061 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:15.309061 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:15.309061 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:15.309061 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:43:15.309061 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:43:15.309061 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:43:15.309061 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:43:15.309061 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:43:15.309061 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:43:15.309061 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:43:15.309061 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:15.309061 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 300/616] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 7 15:43:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:43:15.317707 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e58701-ca7d-49d0-8179-97e9940a38b7 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:15.398389 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:15.416770 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c841ff-809d-457c-8d9f-fbbfd30339ef None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:15.457037 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e2ce0-b949-4e35-a280-7bb5f4ad06d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:15.457732 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e2ce0-b949-4e35-a280-7bb5f4ad06d5 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:15.458017 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e2ce0-b949-4e35-a280-7bb5f4ad06d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:15.459725 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e2ce0-b949-4e35-a280-7bb5f4ad06d5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:15.465053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e58701-ca7d-49d0-8179-97e9940a38b7 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:15.478204 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e2ce0-b949-4e35-a280-7bb5f4ad06d5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:15.479694 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e2ce0-b949-4e35-a280-7bb5f4ad06d5 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:15.502298 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-421e2ce0-b949-4e35-a280-7bb5f4ad06d5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 07 15:43:15.502298 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:15.502298 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:15.502298 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:15.502298 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:15.502298 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:15.502298 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:15.502298 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:15.502298 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:15.502298 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:15.502298 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:15.502298 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:15.502298 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:43:15.502298 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:43:15.502298 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:43:15.502298 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:43:15.504615 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:15.504615 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:15.504615 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:43:15.504615 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:15.504615 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:43:15.504615 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:15.504615 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:15.504615 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:15.504615 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:15.504615 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:15.504615 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:15.504615 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:15.504615 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:15.504615 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:15.504615 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:15.504615 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:15.504615 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:15.504615 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:15.506930 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:15.506930 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:15.506930 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:43:15.506930 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:43:15.506930 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:43:15.506930 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:43:15.506930 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:43:15.506930 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:43:15.506930 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 07 15:43:15.506930 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:15.506930 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 317/617] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:43:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:15.510923 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e2ce0-b949-4e35-a280-7bb5f4ad06d5 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:15.539378 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2219f8e-d907-4df8-af5c-0dda435b9c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:15.539993 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2219f8e-d907-4df8-af5c-0dda435b9c39 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:15.540271 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2219f8e-d907-4df8-af5c-0dda435b9c39 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:15.540523 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2219f8e-d907-4df8-af5c-0dda435b9c39 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:15.541198 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2219f8e-d907-4df8-af5c-0dda435b9c39 None admin] RBAC: Adding query filter params (name=service) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:15.541499 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2219f8e-d907-4df8-af5c-0dda435b9c39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:15.542904 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2219f8e-d907-4df8-af5c-0dda435b9c39 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:15.557609 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 301/618] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 7 15:43:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:15.558565 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:15.564755 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2219f8e-d907-4df8-af5c-0dda435b9c39 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:15.694360 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e2ce0-b949-4e35-a280-7bb5f4ad06d5 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:15.730528 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f705e35-a61f-49bb-b7e9-077345675d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:15.731937 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f705e35-a61f-49bb-b7e9-077345675d87 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:15.732737 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f705e35-a61f-49bb-b7e9-077345675d87 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:15.733247 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f705e35-a61f-49bb-b7e9-077345675d87 None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:15.734285 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f705e35-a61f-49bb-b7e9-077345675d87 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:15.734814 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f705e35-a61f-49bb-b7e9-077345675d87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:15.736474 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f705e35-a61f-49bb-b7e9-077345675d87 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:15.748816 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2219f8e-d907-4df8-af5c-0dda435b9c39 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:15.757758 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 318/619] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Sep 7 15:43:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:15.765057 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f705e35-a61f-49bb-b7e9-077345675d87 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:15.782313 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:15.804350 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0e0f6-d99d-4feb-81d4-ec29a30509ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:15.805054 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0e0f6-d99d-4feb-81d4-ec29a30509ab None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:15.805343 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0e0f6-d99d-4feb-81d4-ec29a30509ab None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:15.805618 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0e0f6-d99d-4feb-81d4-ec29a30509ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:15.831974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0e0f6-d99d-4feb-81d4-ec29a30509ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:15.833453 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0e0f6-d99d-4feb-81d4-ec29a30509ab None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:15.860975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-38d0e0f6-d99d-4feb-81d4-ec29a30509ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:15.860975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:15.860975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:15.860975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:15.860975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:15.860975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:15.860975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:15.860975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:15.860975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:15.860975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:15.860975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:15.860975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:15.860975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:15.860975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:15.860975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:15.860975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:15.862065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:15.862065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:15.862065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:15.862065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:15.862065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:15.862065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:15.862065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:15.862065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:15.862065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:15.862065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:15.862065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:15.862065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:15.862065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:15.862065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:15.862065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:15.862065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:15.862065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:15.863033 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:15.863033 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:15.863033 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:15.870746 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 302/620] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:43:15.877384 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0e0f6-d99d-4feb-81d4-ec29a30509ab None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:15.882658 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:15.888277 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f705e35-a61f-49bb-b7e9-077345675d87 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:15.962309 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d3b031-bedd-4217-8331-219401ba6ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:15.962844 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3b031-bedd-4217-8331-219401ba6ef3 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:15.963119 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3b031-bedd-4217-8331-219401ba6ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:15.963389 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3b031-bedd-4217-8331-219401ba6ef3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:16.079675 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d3b031-bedd-4217-8331-219401ba6ef3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:16.081134 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d3b031-bedd-4217-8331-219401ba6ef3 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:16.084159 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0e0f6-d99d-4feb-81d4-ec29a30509ab None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:16.164255 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c59bb-6674-4bf7-ba6e-2e2b1a3595cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:16.165270 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c59bb-6674-4bf7-ba6e-2e2b1a3595cb None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:16.165776 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c59bb-6674-4bf7-ba6e-2e2b1a3595cb None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:16.166299 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c59bb-6674-4bf7-ba6e-2e2b1a3595cb None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:16.167166 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6c59bb-6674-4bf7-ba6e-2e2b1a3595cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:16.167683 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6c59bb-6674-4bf7-ba6e-2e2b1a3595cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:16.169899 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6c59bb-6674-4bf7-ba6e-2e2b1a3595cb None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:16.183252 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 319/621] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:43:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:43:16.186614 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:16.188727 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d3b031-bedd-4217-8331-219401ba6ef3 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:16.216843 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 303/622] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:43:16.227471 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c59bb-6674-4bf7-ba6e-2e2b1a3595cb None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:16.302522 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d3b031-bedd-4217-8331-219401ba6ef3 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:16.346529 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:16.353049 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d6ed9-6b6b-495f-b964-6ce4f1ab1949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:16.353703 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d6ed9-6b6b-495f-b964-6ce4f1ab1949 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:16.353981 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d6ed9-6b6b-495f-b964-6ce4f1ab1949 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:16.354284 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d6ed9-6b6b-495f-b964-6ce4f1ab1949 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:16.374587 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d6ed9-6b6b-495f-b964-6ce4f1ab1949 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:16.376146 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d6ed9-6b6b-495f-b964-6ce4f1ab1949 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:16.406299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-075d6ed9-6b6b-495f-b964-6ce4f1ab1949 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:16.406299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:16.406299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:16.406299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:16.406299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:16.406299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:16.406299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:16.406299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:16.406299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:16.406299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:16.406299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:16.406299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:16.406299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:16.406299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:16.406299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:16.406299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:16.407358 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:16.407358 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:16.407358 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:16.407358 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:16.407358 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:16.407358 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:16.407358 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:16.407358 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:16.407358 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:16.407358 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:16.407358 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:16.407358 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:16.407358 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:16.407358 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:16.407358 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:16.407358 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:16.407358 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:16.408751 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:16.408751 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:16.408751 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:16.408751 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 320/623] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:43:16.409219 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9bc0f-f1ed-4665-af55-00c156d0f709 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:16.409391 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9bc0f-f1ed-4665-af55-00c156d0f709 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:16.409622 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9bc0f-f1ed-4665-af55-00c156d0f709 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:16.419924 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 321/624] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:43:16.420193 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9bc0f-f1ed-4665-af55-00c156d0f709 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:16.452283 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c59bb-6674-4bf7-ba6e-2e2b1a3595cb None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:16.459978 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:16.495283 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db73ced-7ba3-460a-abca-f327102fdfc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:16.497046 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db73ced-7ba3-460a-abca-f327102fdfc9 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:16.497782 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db73ced-7ba3-460a-abca-f327102fdfc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:16.498351 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db73ced-7ba3-460a-abca-f327102fdfc9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:16.506738 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db73ced-7ba3-460a-abca-f327102fdfc9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:16.508529 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db73ced-7ba3-460a-abca-f327102fdfc9 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:16.521880 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-7db73ced-7ba3-460a-abca-f327102fdfc9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 07 15:43:16.521880 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:16.521880 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:16.521880 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:16.521880 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:16.521880 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:16.521880 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:16.521880 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:16.521880 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:16.521880 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:16.521880 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:16.521880 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:16.521880 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:43:16.521880 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:43:16.521880 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:43:16.521880 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:43:16.522930 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:16.522930 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:16.522930 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:43:16.522930 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:16.522930 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:43:16.522930 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:16.522930 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:16.522930 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:16.522930 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:16.522930 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:16.522930 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:16.522930 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:16.522930 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:16.522930 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:16.522930 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:16.522930 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:16.522930 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:16.522930 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:16.523879 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:16.523879 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:16.523879 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:43:16.523879 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:43:16.523879 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:43:16.523879 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:43:16.523879 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:43:16.523879 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:43:16.523879 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 07 15:43:16.523879 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:16.523879 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 304/625] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 7 15:43:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:16.524480 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f458171d-8ba0-428c-b6d4-512779941bbb None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:16.524480 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f458171d-8ba0-428c-b6d4-512779941bbb None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:16.525119 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f458171d-8ba0-428c-b6d4-512779941bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:16.543126 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-f458171d-8ba0-428c-b6d4-512779941bbb None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:16.544904 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-f458171d-8ba0-428c-b6d4-512779941bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:16.546522 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9bc0f-f1ed-4665-af55-00c156d0f709 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:16.584321 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f52ad4-2e84-4461-840d-8a9800e1d0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:16.584925 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f52ad4-2e84-4461-840d-8a9800e1d0c1 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:16.585203 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f52ad4-2e84-4461-840d-8a9800e1d0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:16.585475 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f52ad4-2e84-4461-840d-8a9800e1d0c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:16.586235 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f52ad4-2e84-4461-840d-8a9800e1d0c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:16.586544 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f52ad4-2e84-4461-840d-8a9800e1d0c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:16.588068 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f52ad4-2e84-4461-840d-8a9800e1d0c1 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:16.605486 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 322/626] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:16.605486 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf995769-3b98-4c69-98e1-5118ee9b3f15 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:16.605486 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf995769-3b98-4c69-98e1-5118ee9b3f15 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:16.605486 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf995769-3b98-4c69-98e1-5118ee9b3f15 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:16.605486 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 323/627] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:43:16.605486 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf995769-3b98-4c69-98e1-5118ee9b3f15 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:16.626548 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 305/628] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:43:16.627781 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f458171d-8ba0-428c-b6d4-512779941bbb None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:16.658374 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:16.705978 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:16.718764 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf995769-3b98-4c69-98e1-5118ee9b3f15 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:16.755594 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b906ecb-b250-43b3-9dba-c70c8d89c8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:16.756247 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b906ecb-b250-43b3-9dba-c70c8d89c8dc None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:16.756596 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b906ecb-b250-43b3-9dba-c70c8d89c8dc None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:16.756959 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b906ecb-b250-43b3-9dba-c70c8d89c8dc None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:16.757736 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b906ecb-b250-43b3-9dba-c70c8d89c8dc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:16.758102 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b906ecb-b250-43b3-9dba-c70c8d89c8dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:16.759859 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b906ecb-b250-43b3-9dba-c70c8d89c8dc None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:16.771015 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f458171d-8ba0-428c-b6d4-512779941bbb None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:16.785848 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 324/629] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Sep 7 15:43:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:16.785848 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f4649-9949-43fa-a0a1-3be0ba29bb26 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:16.785848 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f4649-9949-43fa-a0a1-3be0ba29bb26 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:16.785848 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f4649-9949-43fa-a0a1-3be0ba29bb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:16.809581 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-268f4649-9949-43fa-a0a1-3be0ba29bb26 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:16.811860 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-268f4649-9949-43fa-a0a1-3be0ba29bb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:16.820099 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1624f7-855f-447a-9d8e-1773612b98fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:16.820739 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1624f7-855f-447a-9d8e-1773612b98fb None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:16.821016 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1624f7-855f-447a-9d8e-1773612b98fb None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:16.821285 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1624f7-855f-447a-9d8e-1773612b98fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:16.829394 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1624f7-855f-447a-9d8e-1773612b98fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:16.830944 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1624f7-855f-447a-9d8e-1773612b98fb None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:16.842722 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-2f1624f7-855f-447a-9d8e-1773612b98fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:16.842722 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:16.842722 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:16.842722 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:16.842722 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:16.842722 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:16.842722 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:16.842722 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:16.842722 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:16.842722 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:16.842722 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:16.842722 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:16.842722 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:43:16.842722 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:43:16.842722 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:43:16.843652 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:43:16.843652 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:16.843652 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:16.843652 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:16.843652 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:16.843652 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:16.843652 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:16.843652 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:16.843652 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:16.843652 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:16.843652 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:16.843652 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:16.843652 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:16.843652 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:16.843652 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:16.843652 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:16.843652 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:16.844545 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:43:16.844545 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:43:16.844545 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:43:16.844545 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:43:16.844545 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:43:16.844545 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:43:16.844545 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:16.844545 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:16.848660 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 306/630] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:43:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:16.849542 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1624f7-855f-447a-9d8e-1773612b98fb None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:16.905250 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 325/631] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:43:16.906431 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f4649-9949-43fa-a0a1-3be0ba29bb26 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:16.941189 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:16.963001 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1624f7-855f-447a-9d8e-1773612b98fb None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:16.990135 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:17.000033 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa28777-380d-44da-9243-385d398b9ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:17.000665 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa28777-380d-44da-9243-385d398b9ad5 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:17.000944 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa28777-380d-44da-9243-385d398b9ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:17.001222 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa28777-380d-44da-9243-385d398b9ad5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:17.012878 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa28777-380d-44da-9243-385d398b9ad5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:17.014282 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa28777-380d-44da-9243-385d398b9ad5 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:17.014669 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f4649-9949-43fa-a0a1-3be0ba29bb26 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:17.036171 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-5aa28777-380d-44da-9243-385d398b9ad5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:17.036171 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:17.036171 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:17.036171 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:17.036171 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:17.036171 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:17.036171 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:17.036171 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:17.036171 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:17.036171 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:17.036171 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:17.036171 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:17.036171 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:17.036171 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:17.036171 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:17.036171 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:17.037998 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:17.037998 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:17.037998 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:17.037998 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:17.037998 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:17.037998 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:17.037998 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:17.037998 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:17.037998 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:17.037998 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:17.037998 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:17.037998 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:17.037998 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:17.037998 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:17.037998 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:17.037998 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:17.037998 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:17.042684 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:17.042684 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:17.042684 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:17.042684 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 307/632] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:17.042684 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa28777-380d-44da-9243-385d398b9ad5 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:17.055907 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf44989-2128-43c5-8761-b72eb0779d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:17.056723 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf44989-2128-43c5-8761-b72eb0779d04 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:17.057168 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf44989-2128-43c5-8761-b72eb0779d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:17.057589 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf44989-2128-43c5-8761-b72eb0779d04 None admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:17.058457 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf44989-2128-43c5-8761-b72eb0779d04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:17.058980 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf44989-2128-43c5-8761-b72eb0779d04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:17.060941 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf44989-2128-43c5-8761-b72eb0779d04 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:17.073207 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 326/633] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 7 15:43:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:17.074414 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5f0b1-5db1-45c7-a344-f5f7508d1ab4 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:17.075403 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5f0b1-5db1-45c7-a344-f5f7508d1ab4 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:17.075760 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5f0b1-5db1-45c7-a344-f5f7508d1ab4 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:17.077153 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 327/634] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:43:17.077677 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea5f0b1-5db1-45c7-a344-f5f7508d1ab4 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:17.157300 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa28777-380d-44da-9243-385d398b9ad5 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:17.184950 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea5f0b1-5db1-45c7-a344-f5f7508d1ab4 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:17.189900 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:17.195418 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d4fb4-22a5-45be-99ad-f440f6a62f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:17.196047 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d4fb4-22a5-45be-99ad-f440f6a62f36 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:17.196326 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d4fb4-22a5-45be-99ad-f440f6a62f36 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:17.196597 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d4fb4-22a5-45be-99ad-f440f6a62f36 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:17.207382 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7d4fb4-22a5-45be-99ad-f440f6a62f36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:43:17.212588 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-4f7d4fb4-22a5-45be-99ad-f440f6a62f36 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:43:17.212588 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:17.212588 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:17.212588 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:17.212588 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:17.212588 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:17.212588 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:17.212588 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:17.212588 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:17.212588 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:17.212588 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:17.212588 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:17.212588 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:43:17.212588 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:43:17.212588 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:43:17.212588 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:43:17.213575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:43:17.213575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:43:17.213575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:43:17.213575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:43:17.213575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:17.213575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:17.213575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:17.213575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:17.213575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:17.213575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:17.213575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:17.213575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:17.213575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:17.213575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:17.213575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:17.213575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:17.214984 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:17.214984 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:17.214984 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:17.214984 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:17.214984 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:43:17.214984 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:43:17.214984 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:43:17.214984 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:43:17.214984 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:43:17.214984 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:43:17.214984 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:43:17.214984 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:17.214984 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 308/635] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 7 15:43:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:17.215799 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417da09e-db5c-4133-9456-ed6c6292a10d None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:17.215799 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417da09e-db5c-4133-9456-ed6c6292a10d None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:17.215799 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417da09e-db5c-4133-9456-ed6c6292a10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:17.219833 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a07227c-87e4-4359-aef3-7958e67672ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:17.220436 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07227c-87e4-4359-aef3-7958e67672ee None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:17.220714 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07227c-87e4-4359-aef3-7958e67672ee None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:17.220986 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07227c-87e4-4359-aef3-7958e67672ee None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:17.221619 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a07227c-87e4-4359-aef3-7958e67672ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:17.221919 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a07227c-87e4-4359-aef3-7958e67672ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:17.223315 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a07227c-87e4-4359-aef3-7958e67672ee None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:17.230302 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:17.233520 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-417da09e-db5c-4133-9456-ed6c6292a10d None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:17.234747 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-417da09e-db5c-4133-9456-ed6c6292a10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:17.236453 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 328/636] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:17.237228 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a07227c-87e4-4359-aef3-7958e67672ee None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:17.307528 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 309/637] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:43:17.308292 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417da09e-db5c-4133-9456-ed6c6292a10d None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:17.340907 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a07227c-87e4-4359-aef3-7958e67672ee None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:17.379825 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba132c-4eab-4945-887b-8b93ec654c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:17.380539 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba132c-4eab-4945-887b-8b93ec654c06 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:17.380821 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba132c-4eab-4945-887b-8b93ec654c06 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:17.381209 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba132c-4eab-4945-887b-8b93ec654c06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:17.381920 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba132c-4eab-4945-887b-8b93ec654c06 None admin] RBAC: Adding query filter params (role.id=a420b17212b94988beb75affe974355b, scope.project.id=488830167943488f85743236584113d7, user.id=5753fea47f5944cd93dbea90fb9ad9b3) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:17.382257 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba132c-4eab-4945-887b-8b93ec654c06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:17.383677 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba132c-4eab-4945-887b-8b93ec654c06 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:17.398210 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 329/638] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 7 15:43:17 2022] GET /identity/v3/role_assignments?user.id=5753fea47f5944cd93dbea90fb9ad9b3&scope.project.id=488830167943488f85743236584113d7&role.id=a420b17212b94988beb75affe974355b => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:17.398210 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba132c-4eab-4945-887b-8b93ec654c06 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:17.425499 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417da09e-db5c-4133-9456-ed6c6292a10d None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:17.458412 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:17.473179 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb53869-a5f5-462b-8640-9890cbb9c5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:17.473826 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb53869-a5f5-462b-8640-9890cbb9c5f1 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:17.474109 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb53869-a5f5-462b-8640-9890cbb9c5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:17.474409 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb53869-a5f5-462b-8640-9890cbb9c5f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:17.481315 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:17.488682 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb53869-a5f5-462b-8640-9890cbb9c5f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:43:17.494394 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-0cb53869-a5f5-462b-8640-9890cbb9c5f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:43:17.494394 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:17.494394 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:17.494394 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:17.494394 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:17.494394 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:17.494394 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:17.494394 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:17.494394 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:17.494394 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:17.494394 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:17.494394 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:17.494394 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:43:17.494394 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:43:17.494394 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:43:17.494394 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:43:17.495394 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:43:17.495394 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:43:17.495394 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:43:17.495394 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:43:17.495394 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:17.495394 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:17.495394 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:17.495394 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:17.495394 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:17.495394 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:17.495394 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:17.495394 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:17.495394 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:17.495394 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:17.495394 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:17.495394 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:17.496257 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:17.496257 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:17.496257 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:17.496257 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:17.496257 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:43:17.496257 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:43:17.496257 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:43:17.496257 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:43:17.496257 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:43:17.496257 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:43:17.496257 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:43:17.496257 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:17.504105 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 310/639] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 7 15:43:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:17.505266 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb53869-a5f5-462b-8640-9890cbb9c5f1 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:17.532472 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba132c-4eab-4945-887b-8b93ec654c06 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:17.583926 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905fd4c5-c491-456e-9864-86e71384448c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:17.584481 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fd4c5-c491-456e-9864-86e71384448c None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:17.584761 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fd4c5-c491-456e-9864-86e71384448c None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:17.585036 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fd4c5-c491-456e-9864-86e71384448c None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:17.585726 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905fd4c5-c491-456e-9864-86e71384448c None admin] RBAC: Adding query filter params (name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:17.586037 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905fd4c5-c491-456e-9864-86e71384448c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:17.587836 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905fd4c5-c491-456e-9864-86e71384448c None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:17.599222 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 330/640] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 7 15:43:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:17.600461 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905fd4c5-c491-456e-9864-86e71384448c None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:17.632023 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb53869-a5f5-462b-8640-9890cbb9c5f1 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:17.671728 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f6a38-7444-450f-a1d0-a36fc5d678b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:17.672620 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f6a38-7444-450f-a1d0-a36fc5d678b3 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:17.673060 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f6a38-7444-450f-a1d0-a36fc5d678b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:17.673475 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f6a38-7444-450f-a1d0-a36fc5d678b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:17.680470 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f6a38-7444-450f-a1d0-a36fc5d678b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:17.681912 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f6a38-7444-450f-a1d0-a36fc5d678b3 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:17.693910 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-dd4f6a38-7444-450f-a1d0-a36fc5d678b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:17.693910 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:17.693910 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:17.693910 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:17.693910 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:17.693910 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:17.693910 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:17.693910 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:17.693910 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:17.693910 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:17.693910 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:17.693910 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:17.693910 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:43:17.693910 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:43:17.693910 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:43:17.694864 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:43:17.694864 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:17.694864 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:17.694864 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:17.694864 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:17.694864 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:17.694864 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:17.694864 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:17.694864 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:17.694864 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:17.694864 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:17.694864 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:17.694864 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:17.694864 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:17.694864 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:17.694864 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:17.694864 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:17.695752 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:43:17.695752 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:43:17.695752 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:43:17.695752 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:43:17.695752 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:43:17.695752 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:43:17.695752 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:17.695752 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:17.695752 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 311/641] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:43:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:17.696244 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f6a38-7444-450f-a1d0-a36fc5d678b3 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:17.719385 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905fd4c5-c491-456e-9864-86e71384448c None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:17.743588 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:17.750327 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:17.755946 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408a5b5-6969-4b82-be44-6c9598373361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:17.756559 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408a5b5-6969-4b82-be44-6c9598373361 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:17.756848 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408a5b5-6969-4b82-be44-6c9598373361 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:17.757120 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408a5b5-6969-4b82-be44-6c9598373361 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:17.757772 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9408a5b5-6969-4b82-be44-6c9598373361 None admin] RBAC: Adding query filter params (name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:17.758084 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9408a5b5-6969-4b82-be44-6c9598373361 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:17.759485 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9408a5b5-6969-4b82-be44-6c9598373361 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:17.768877 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 331/642] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 7 15:43:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:17.769681 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408a5b5-6969-4b82-be44-6c9598373361 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:17.818529 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f6a38-7444-450f-a1d0-a36fc5d678b3 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:17.859388 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c78d061-18ec-4f13-8c49-f1fd9d98a377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:17.859943 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78d061-18ec-4f13-8c49-f1fd9d98a377 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:17.860233 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78d061-18ec-4f13-8c49-f1fd9d98a377 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:17.860507 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78d061-18ec-4f13-8c49-f1fd9d98a377 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:17.871518 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c78d061-18ec-4f13-8c49-f1fd9d98a377 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:43:17.876816 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408a5b5-6969-4b82-be44-6c9598373361 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:17.877063 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-2c78d061-18ec-4f13-8c49-f1fd9d98a377 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:43:17.877063 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:17.877063 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:17.877063 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:17.877063 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:17.877063 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:17.877063 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:17.877063 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:17.877063 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:17.877063 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:17.877063 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:17.877063 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:17.877063 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:43:17.877063 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:43:17.877063 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:43:17.877063 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:43:17.878047 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:43:17.878047 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:43:17.878047 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:43:17.878047 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:43:17.878047 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:17.878047 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:17.878047 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:17.878047 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:17.878047 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:17.878047 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:17.878047 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:17.878047 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:17.878047 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:17.878047 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:17.878047 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:17.878047 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:17.879329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:17.879329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:17.879329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:17.879329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:17.879329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:43:17.879329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:43:17.879329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:43:17.879329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:43:17.879329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:43:17.879329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:43:17.879329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:43:17.879329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:17.879329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 312/643] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 7 15:43:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:17.879329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c78d061-18ec-4f13-8c49-f1fd9d98a377 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:17.919243 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f31f7-2bdf-4891-96ef-91eb4850bf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:17.919894 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f31f7-2bdf-4891-96ef-91eb4850bf14 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:17.920174 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f31f7-2bdf-4891-96ef-91eb4850bf14 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:17.920443 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f31f7-2bdf-4891-96ef-91eb4850bf14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:17.932287 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f31f7-2bdf-4891-96ef-91eb4850bf14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:17.933732 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f31f7-2bdf-4891-96ef-91eb4850bf14 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:17.948892 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-395f31f7-2bdf-4891-96ef-91eb4850bf14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:17.948892 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:17.948892 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:17.948892 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:17.948892 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:17.948892 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:17.948892 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:17.948892 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:17.948892 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:17.948892 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:17.948892 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:17.948892 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:17.948892 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:17.948892 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:17.948892 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:17.948892 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:17.950657 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:17.950657 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:17.950657 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:17.950657 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:17.950657 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:17.950657 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:17.950657 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:17.950657 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:17.950657 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:17.950657 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:17.950657 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:17.950657 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:17.950657 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:17.950657 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:17.950657 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:17.950657 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:17.950657 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:17.952121 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:17.952121 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:17.952121 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:17.955240 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 332/644] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:17.956009 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f31f7-2bdf-4891-96ef-91eb4850bf14 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:17.990354 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c78d061-18ec-4f13-8c49-f1fd9d98a377 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:17.992333 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:18.002003 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:18.029593 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb7d5b-2710-4911-a807-91893746a4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:18.030111 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb7d5b-2710-4911-a807-91893746a4b3 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:18.030419 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb7d5b-2710-4911-a807-91893746a4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:18.030693 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb7d5b-2710-4911-a807-91893746a4b3 None admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:18.031380 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb7d5b-2710-4911-a807-91893746a4b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:18.031689 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb7d5b-2710-4911-a807-91893746a4b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:18.034613 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb7d5b-2710-4911-a807-91893746a4b3 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:18.050330 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 313/645] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 7 15:43:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:18.051270 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb7d5b-2710-4911-a807-91893746a4b3 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:18.072473 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f31f7-2bdf-4891-96ef-91eb4850bf14 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:18.107190 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9c585-e42d-4e07-bd03-7d6bdd44788f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:18.108180 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9c585-e42d-4e07-bd03-7d6bdd44788f None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:18.108535 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9c585-e42d-4e07-bd03-7d6bdd44788f None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:18.108886 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9c585-e42d-4e07-bd03-7d6bdd44788f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:18.120066 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf9c585-e42d-4e07-bd03-7d6bdd44788f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:18.122007 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf9c585-e42d-4e07-bd03-7d6bdd44788f None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:18.137416 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-4bf9c585-e42d-4e07-bd03-7d6bdd44788f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:18.137416 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:18.137416 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:18.137416 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:18.137416 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:18.137416 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:18.137416 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:18.137416 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:18.137416 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:18.137416 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:18.137416 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:18.137416 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:18.137416 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:18.137416 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:18.137416 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:18.137416 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:18.143326 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:18.143326 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:18.143326 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:18.143326 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:18.143326 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:18.143326 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:18.143326 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:18.143326 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:18.143326 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:18.143326 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:18.143326 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:18.143326 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:18.143326 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:18.143326 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:18.143326 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:18.143326 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:18.143326 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:18.144445 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:18.144445 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:18.144445 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:18.144445 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 333/646] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:18.144445 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9c585-e42d-4e07-bd03-7d6bdd44788f None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:18.167302 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb7d5b-2710-4911-a807-91893746a4b3 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:18.203283 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92096b69-395b-4ee7-956c-0f59fe66a995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:18.203917 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92096b69-395b-4ee7-956c-0f59fe66a995 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:18.204197 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92096b69-395b-4ee7-956c-0f59fe66a995 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:18.204469 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92096b69-395b-4ee7-956c-0f59fe66a995 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:18.205120 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92096b69-395b-4ee7-956c-0f59fe66a995 None admin] RBAC: Adding query filter params (name=service) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:18.205418 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92096b69-395b-4ee7-956c-0f59fe66a995 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:18.206800 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92096b69-395b-4ee7-956c-0f59fe66a995 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:18.214958 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 314/647] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 7 15:43:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:18.216412 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92096b69-395b-4ee7-956c-0f59fe66a995 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:18.242461 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:18.243192 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:18.256911 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9c585-e42d-4e07-bd03-7d6bdd44788f None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:18.291908 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f079157d-1a62-4973-962f-d87e72e0cec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:18.292670 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079157d-1a62-4973-962f-d87e72e0cec0 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:18.293059 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079157d-1a62-4973-962f-d87e72e0cec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:18.293965 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079157d-1a62-4973-962f-d87e72e0cec0 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:18.294757 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f079157d-1a62-4973-962f-d87e72e0cec0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:18.295170 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f079157d-1a62-4973-962f-d87e72e0cec0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:18.296636 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f079157d-1a62-4973-962f-d87e72e0cec0 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:18.313063 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 334/648] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:18.313063 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f079157d-1a62-4973-962f-d87e72e0cec0 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:18.326241 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92096b69-395b-4ee7-956c-0f59fe66a995 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:18.365720 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2460ba2-9bba-45d7-bdf1-9b55abbae41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:18.366601 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2460ba2-9bba-45d7-bdf1-9b55abbae41a None admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:18.366993 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2460ba2-9bba-45d7-bdf1-9b55abbae41a None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:18.367393 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2460ba2-9bba-45d7-bdf1-9b55abbae41a None admin] PATH_INFO: `/v3/projects/488830167943488f85743236584113d7/users/16c4b090a4aa4d56a90ccf090b9caba8/roles/a420b17212b94988beb75affe974355b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:18.386500 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2460ba2-9bba-45d7-bdf1-9b55abbae41a None admin] RBAC: Authorizing `identity:create_grant(project_id=488830167943488f85743236584113d7, user_id=16c4b090a4aa4d56a90ccf090b9caba8, role_id=a420b17212b94988beb75affe974355b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:18.388561 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2460ba2-9bba-45d7-bdf1-9b55abbae41a None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:18.402150 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 315/649] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 7 15:43:18 2022] PUT /identity/v3/projects/488830167943488f85743236584113d7/users/16c4b090a4aa4d56a90ccf090b9caba8/roles/a420b17212b94988beb75affe974355b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:43:18.403364 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2460ba2-9bba-45d7-bdf1-9b55abbae41a None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:18.443919 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f079157d-1a62-4973-962f-d87e72e0cec0 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:18.496663 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:18.499603 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f5c87-35b6-414a-8b7b-069cfa2bd34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:18.500491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f5c87-35b6-414a-8b7b-069cfa2bd34e None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:18.500880 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f5c87-35b6-414a-8b7b-069cfa2bd34e None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:18.501262 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f5c87-35b6-414a-8b7b-069cfa2bd34e None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:18.503558 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34f5c87-35b6-414a-8b7b-069cfa2bd34e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:18.503923 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34f5c87-35b6-414a-8b7b-069cfa2bd34e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:18.505936 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34f5c87-35b6-414a-8b7b-069cfa2bd34e None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:18.526222 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 335/650] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:18.526222 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f5c87-35b6-414a-8b7b-069cfa2bd34e None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:18.537648 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2460ba2-9bba-45d7-bdf1-9b55abbae41a None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:18.542435 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:18.578475 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495566c-9008-4918-916c-8467c146c0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:18.579135 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495566c-9008-4918-916c-8467c146c0c7 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:18.579652 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495566c-9008-4918-916c-8467c146c0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:18.579652 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495566c-9008-4918-916c-8467c146c0c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:18.592333 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495566c-9008-4918-916c-8467c146c0c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:18.593999 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495566c-9008-4918-916c-8467c146c0c7 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:18.612579 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-9495566c-9008-4918-916c-8467c146c0c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:18.612579 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:18.612579 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:18.612579 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:18.612579 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:18.612579 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:18.612579 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:18.612579 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:18.612579 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:18.612579 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:18.612579 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:18.612579 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:18.612579 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:18.612579 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:18.612579 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:18.612579 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:18.613726 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:18.613726 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:18.613726 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:18.613726 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:18.613726 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:18.613726 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:18.613726 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:18.613726 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:18.613726 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:18.613726 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:18.613726 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:18.613726 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:18.613726 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:18.613726 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:18.613726 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:18.613726 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:18.613726 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:18.614865 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:18.614865 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:18.614865 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:18.615375 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 316/651] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:18.616148 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495566c-9008-4918-916c-8467c146c0c7 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:18.677209 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f5c87-35b6-414a-8b7b-069cfa2bd34e None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:18.711780 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82afcf-4c25-43f8-9504-6f4ee97aff5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:18.712417 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82afcf-4c25-43f8-9504-6f4ee97aff5b None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:18.712696 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82afcf-4c25-43f8-9504-6f4ee97aff5b None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:18.712965 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82afcf-4c25-43f8-9504-6f4ee97aff5b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:18.722165 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e82afcf-4c25-43f8-9504-6f4ee97aff5b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:18.723731 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e82afcf-4c25-43f8-9504-6f4ee97aff5b None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:18.736500 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-0e82afcf-4c25-43f8-9504-6f4ee97aff5b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 15:43:18.736500 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:18.736500 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:18.736500 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:18.736500 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:18.736500 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:18.736500 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:18.736500 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:18.736500 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:18.736500 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:18.736500 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:18.736500 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:18.736500 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:43:18.736500 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:43:18.736500 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:43:18.736500 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:43:18.737665 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:18.737665 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:18.737665 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:43:18.737665 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:18.737665 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:43:18.737665 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:18.737665 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:18.737665 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:18.737665 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:18.737665 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:18.737665 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:18.737665 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:18.737665 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:18.737665 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:18.737665 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:18.737665 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:18.737665 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:18.737665 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:18.738786 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:18.738786 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:18.738786 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:43:18.738786 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:43:18.738786 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:43:18.738786 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:43:18.738786 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:43:18.738786 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:43:18.738786 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 15:43:18.738786 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:18.738786 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 336/652] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:43:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:18.738786 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82afcf-4c25-43f8-9504-6f4ee97aff5b None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:18.741263 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495566c-9008-4918-916c-8467c146c0c7 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:18.770378 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:18.780851 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76593c76-6d34-4479-98f9-dfc108508fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:18.781590 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76593c76-6d34-4479-98f9-dfc108508fbd None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:18.781945 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76593c76-6d34-4479-98f9-dfc108508fbd None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:18.782358 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76593c76-6d34-4479-98f9-dfc108508fbd None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:18.791027 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76593c76-6d34-4479-98f9-dfc108508fbd None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:18.792617 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76593c76-6d34-4479-98f9-dfc108508fbd None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:18.805765 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-76593c76-6d34-4479-98f9-dfc108508fbd None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 07 15:43:18.805765 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:18.805765 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:18.805765 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:18.805765 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:18.805765 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:18.805765 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:18.805765 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:18.805765 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:18.805765 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:18.805765 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:18.805765 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:18.805765 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:43:18.805765 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:43:18.805765 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:43:18.805765 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:43:18.807890 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:18.807890 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:18.807890 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:43:18.807890 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:18.807890 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:43:18.807890 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:18.807890 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:18.807890 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:18.807890 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:18.807890 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:18.807890 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:18.807890 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:18.807890 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:18.807890 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:18.807890 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:18.807890 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:18.807890 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:18.807890 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:18.809552 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:18.809552 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:18.809552 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:43:18.809552 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:43:18.809552 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:43:18.809552 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:43:18.809552 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:43:18.809552 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:43:18.809552 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 07 15:43:18.809552 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:18.809552 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 317/653] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 7 15:43:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:18.815374 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76593c76-6d34-4479-98f9-dfc108508fbd None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:18.815510 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:18.857776 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82afcf-4c25-43f8-9504-6f4ee97aff5b None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:18.896871 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5ec3f-2357-46f8-8dee-bee9a3631828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:18.897874 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5ec3f-2357-46f8-8dee-bee9a3631828 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:18.898372 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5ec3f-2357-46f8-8dee-bee9a3631828 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:18.898786 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5ec3f-2357-46f8-8dee-bee9a3631828 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:18.899617 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb5ec3f-2357-46f8-8dee-bee9a3631828 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:18.900134 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb5ec3f-2357-46f8-8dee-bee9a3631828 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:18.901833 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb5ec3f-2357-46f8-8dee-bee9a3631828 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:18.916053 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 337/654] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:18.917148 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5ec3f-2357-46f8-8dee-bee9a3631828 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:18.947795 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76593c76-6d34-4479-98f9-dfc108508fbd None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:18.985168 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78efe2fb-46bf-442b-8003-3c236f5d78f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:18.985930 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efe2fb-46bf-442b-8003-3c236f5d78f2 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:18.986363 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efe2fb-46bf-442b-8003-3c236f5d78f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:18.986741 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efe2fb-46bf-442b-8003-3c236f5d78f2 None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:18.987576 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78efe2fb-46bf-442b-8003-3c236f5d78f2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:18.987992 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78efe2fb-46bf-442b-8003-3c236f5d78f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:18.989575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78efe2fb-46bf-442b-8003-3c236f5d78f2 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:19.010228 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 318/655] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Sep 7 15:43:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:19.010228 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78efe2fb-46bf-442b-8003-3c236f5d78f2 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:19.051477 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5ec3f-2357-46f8-8dee-bee9a3631828 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:19.069637 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:19.091955 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:19.104641 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53eebe-8c04-4d22-8f6b-b5c1e42e11e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:19.105281 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53eebe-8c04-4d22-8f6b-b5c1e42e11e7 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:19.105567 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53eebe-8c04-4d22-8f6b-b5c1e42e11e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:19.106429 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53eebe-8c04-4d22-8f6b-b5c1e42e11e7 None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:19.107895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc53eebe-8c04-4d22-8f6b-b5c1e42e11e7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:19.108202 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc53eebe-8c04-4d22-8f6b-b5c1e42e11e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:19.110327 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc53eebe-8c04-4d22-8f6b-b5c1e42e11e7 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:19.134398 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 338/656] 10.222.0.16 () {56 vars in 1139 bytes} [Wed Sep 7 15:43:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:19.135689 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53eebe-8c04-4d22-8f6b-b5c1e42e11e7 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:19.140367 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78efe2fb-46bf-442b-8003-3c236f5d78f2 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:19.181559 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0102d59d-c9d8-4f31-aeeb-780fbb1afdb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:19.182339 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102d59d-c9d8-4f31-aeeb-780fbb1afdb6 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:19.182560 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102d59d-c9d8-4f31-aeeb-780fbb1afdb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:19.182831 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102d59d-c9d8-4f31-aeeb-780fbb1afdb6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:19.193190 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0102d59d-c9d8-4f31-aeeb-780fbb1afdb6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:19.195465 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0102d59d-c9d8-4f31-aeeb-780fbb1afdb6 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:19.212742 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-0102d59d-c9d8-4f31-aeeb-780fbb1afdb6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 15:43:19.212742 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:19.212742 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:19.212742 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:19.212742 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:19.212742 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:19.212742 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:19.212742 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:19.212742 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:19.212742 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:19.212742 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:19.212742 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:19.212742 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:43:19.212742 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:43:19.212742 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:43:19.212742 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:43:19.213899 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:19.213899 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:19.213899 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:43:19.213899 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:19.213899 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:43:19.213899 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:19.213899 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:19.213899 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:19.213899 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:19.213899 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:19.213899 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:19.213899 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:19.213899 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:19.213899 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:19.213899 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:19.213899 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:19.213899 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:19.213899 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:19.215061 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:19.215061 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:19.215061 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:43:19.215061 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:43:19.215061 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:43:19.215061 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:43:19.215061 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:43:19.215061 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:43:19.215061 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 15:43:19.215061 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:19.217552 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 319/657] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Sep 7 15:43:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:19.218601 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0102d59d-c9d8-4f31-aeeb-780fbb1afdb6 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:19.268613 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53eebe-8c04-4d22-8f6b-b5c1e42e11e7 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:19.306229 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae52a1-ef06-424c-bd8c-bab388476cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:19.307011 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae52a1-ef06-424c-bd8c-bab388476cca None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:19.307558 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae52a1-ef06-424c-bd8c-bab388476cca None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:19.308134 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae52a1-ef06-424c-bd8c-bab388476cca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:19.360621 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0102d59d-c9d8-4f31-aeeb-780fbb1afdb6 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:19.364038 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:19.372076 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:19.388164 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ae52a1-ef06-424c-bd8c-bab388476cca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:19.389741 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ae52a1-ef06-424c-bd8c-bab388476cca None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:19.415768 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ff7d1-ca09-43a3-b458-347a68cc2f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:19.417145 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ff7d1-ca09-43a3-b458-347a68cc2f71 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:19.417931 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ff7d1-ca09-43a3-b458-347a68cc2f71 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:19.418435 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ff7d1-ca09-43a3-b458-347a68cc2f71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:19.499621 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 339/658] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:43:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:43:19.504205 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae52a1-ef06-424c-bd8c-bab388476cca None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:19.519769 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9ff7d1-ca09-43a3-b458-347a68cc2f71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:19.522122 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9ff7d1-ca09-43a3-b458-347a68cc2f71 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:19.602805 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:19.618689 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae52a1-ef06-424c-bd8c-bab388476cca None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:19.654331 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 320/659] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:43:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:43:19.656319 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ff7d1-ca09-43a3-b458-347a68cc2f71 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:19.661276 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:19.671958 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fca67b-db3a-4dc1-a929-97793ac63903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:19.673067 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fca67b-db3a-4dc1-a929-97793ac63903 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:19.673067 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fca67b-db3a-4dc1-a929-97793ac63903 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:19.673529 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fca67b-db3a-4dc1-a929-97793ac63903 None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:19.674409 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fca67b-db3a-4dc1-a929-97793ac63903 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:19.674827 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fca67b-db3a-4dc1-a929-97793ac63903 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:19.676364 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fca67b-db3a-4dc1-a929-97793ac63903 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:19.700393 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 340/660] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Sep 7 15:43:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:19.701468 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fca67b-db3a-4dc1-a929-97793ac63903 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:19.774124 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ff7d1-ca09-43a3-b458-347a68cc2f71 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:19.810210 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fca67b-db3a-4dc1-a929-97793ac63903 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:19.812297 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec37ba9-bc9a-4119-951c-899ac76feb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:19.812932 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec37ba9-bc9a-4119-951c-899ac76feb1b None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:19.813209 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec37ba9-bc9a-4119-951c-899ac76feb1b None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:19.813481 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec37ba9-bc9a-4119-951c-899ac76feb1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:19.823866 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec37ba9-bc9a-4119-951c-899ac76feb1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:19.825324 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec37ba9-bc9a-4119-951c-899ac76feb1b None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:19.840023 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-0ec37ba9-bc9a-4119-951c-899ac76feb1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:19.840023 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:19.840023 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:19.840023 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:19.840023 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:19.840023 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:19.840023 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:19.840023 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:19.840023 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:19.840023 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:19.840023 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:19.840023 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:19.840023 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:19.840023 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:19.840023 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:19.840023 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:19.845709 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:19.845709 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:19.845709 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:19.845709 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:19.845709 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:19.845709 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:19.845709 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:19.845709 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:19.845709 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:19.845709 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:19.845709 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:19.845709 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:19.845709 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:19.845709 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:19.845709 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:19.845709 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:19.845709 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:19.846852 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:19.846852 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:19.846852 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:19.846852 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 321/661] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:19.846852 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec37ba9-bc9a-4119-951c-899ac76feb1b None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:19.853462 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac1eada-85b9-40bd-bf92-3ad7eceacc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:19.854232 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1eada-85b9-40bd-bf92-3ad7eceacc3c None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:19.854664 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1eada-85b9-40bd-bf92-3ad7eceacc3c None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:19.855042 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1eada-85b9-40bd-bf92-3ad7eceacc3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:19.866820 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac1eada-85b9-40bd-bf92-3ad7eceacc3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:19.868522 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac1eada-85b9-40bd-bf92-3ad7eceacc3c None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:19.876788 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:19.886352 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-5ac1eada-85b9-40bd-bf92-3ad7eceacc3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:19.886352 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:19.886352 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:19.886352 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:19.886352 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:19.886352 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:19.886352 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:19.886352 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:19.886352 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:19.886352 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:19.886352 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:19.886352 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:19.886352 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:19.886352 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:19.886352 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:19.886352 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:19.888237 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:19.888237 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:19.888237 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:19.888237 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:19.888237 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:19.888237 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:19.888237 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:19.888237 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:19.888237 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:19.888237 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:19.888237 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:19.888237 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:19.888237 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:19.888237 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:19.888237 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:19.888237 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:19.888237 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:19.889122 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:19.889122 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:19.889122 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:19.889122 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 341/662] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:19.889775 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2a9da-5e24-406f-9950-a53380cb85ee None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:19.890063 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2a9da-5e24-406f-9950-a53380cb85ee None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:19.890368 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2a9da-5e24-406f-9950-a53380cb85ee None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:19.894206 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 342/663] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:43:19.894206 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d2a9da-5e24-406f-9950-a53380cb85ee None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:19.911307 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:19.960102 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec37ba9-bc9a-4119-951c-899ac76feb1b None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:19.998013 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d0b27-e5ec-42ba-8c49-fc0ccd0e856f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:19.998649 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d0b27-e5ec-42ba-8c49-fc0ccd0e856f None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:19.998932 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d0b27-e5ec-42ba-8c49-fc0ccd0e856f None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:19.999210 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d0b27-e5ec-42ba-8c49-fc0ccd0e856f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:20.004013 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d2a9da-5e24-406f-9950-a53380cb85ee None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:20.041690 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9b250-2048-4ad6-9967-c157cbe2862a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:20.042404 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9b250-2048-4ad6-9967-c157cbe2862a None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:20.042731 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9b250-2048-4ad6-9967-c157cbe2862a None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:20.043011 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9b250-2048-4ad6-9967-c157cbe2862a None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:20.044161 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c9b250-2048-4ad6-9967-c157cbe2862a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:20.044490 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c9b250-2048-4ad6-9967-c157cbe2862a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:20.045869 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c9b250-2048-4ad6-9967-c157cbe2862a None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:20.058141 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 343/664] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:20.059057 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9b250-2048-4ad6-9967-c157cbe2862a None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:20.085683 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634d0b27-e5ec-42ba-8c49-fc0ccd0e856f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:20.087698 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634d0b27-e5ec-42ba-8c49-fc0ccd0e856f None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:20.118315 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:20.149387 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:20.165543 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9b250-2048-4ad6-9967-c157cbe2862a None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:20.198988 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 322/665] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:43:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:43:20.203537 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41913c4f-21de-4a17-8a22-c71100920bf2 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:20.204316 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41913c4f-21de-4a17-8a22-c71100920bf2 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:20.204592 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41913c4f-21de-4a17-8a22-c71100920bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:20.207460 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aac3cf-65d5-4acc-b5f7-dee8511c1d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:20.208173 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aac3cf-65d5-4acc-b5f7-dee8511c1d68 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:20.208432 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aac3cf-65d5-4acc-b5f7-dee8511c1d68 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:20.208714 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aac3cf-65d5-4acc-b5f7-dee8511c1d68 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:20.209359 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aac3cf-65d5-4acc-b5f7-dee8511c1d68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:20.209668 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aac3cf-65d5-4acc-b5f7-dee8511c1d68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:20.211069 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aac3cf-65d5-4acc-b5f7-dee8511c1d68 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:20.223547 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-41913c4f-21de-4a17-8a22-c71100920bf2 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:20.224046 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 344/666] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:20.224943 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aac3cf-65d5-4acc-b5f7-dee8511c1d68 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:20.229062 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-41913c4f-21de-4a17-8a22-c71100920bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:20.310287 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 323/667] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:43:20.310287 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41913c4f-21de-4a17-8a22-c71100920bf2 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:20.342647 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aac3cf-65d5-4acc-b5f7-dee8511c1d68 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:20.365606 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:20.385869 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a0b962-e895-4b29-9e19-186a65f279d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:20.386547 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0b962-e895-4b29-9e19-186a65f279d7 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:20.386838 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0b962-e895-4b29-9e19-186a65f279d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:20.387716 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0b962-e895-4b29-9e19-186a65f279d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:20.395863 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a0b962-e895-4b29-9e19-186a65f279d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:20.397348 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a0b962-e895-4b29-9e19-186a65f279d7 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:20.410299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-31a0b962-e895-4b29-9e19-186a65f279d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:20.410299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:20.410299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:20.410299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:20.410299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:20.410299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:20.410299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:20.410299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:20.410299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:20.410299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:20.410299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:20.410299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:20.410299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:43:20.410299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:43:20.410299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:43:20.411214 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:43:20.411214 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:20.411214 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:20.411214 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:20.411214 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:20.411214 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:20.411214 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:20.411214 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:20.411214 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:20.411214 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:20.411214 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:20.411214 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:20.411214 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:20.411214 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:20.411214 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:20.411214 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:20.411214 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:20.412084 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:43:20.412084 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:43:20.412084 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:43:20.412084 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:43:20.412084 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:43:20.412084 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:43:20.412084 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:20.412084 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:20.412084 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 345/668] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:43:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:20.413031 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a0b962-e895-4b29-9e19-186a65f279d7 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:20.422874 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:20.440055 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41913c4f-21de-4a17-8a22-c71100920bf2 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:20.477095 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a9d0e-562c-4ef6-a9cd-fcafe0f18b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:20.478124 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a9d0e-562c-4ef6-a9cd-fcafe0f18b8a None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:20.478639 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a9d0e-562c-4ef6-a9cd-fcafe0f18b8a None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:20.479108 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a9d0e-562c-4ef6-a9cd-fcafe0f18b8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:20.490670 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a9d0e-562c-4ef6-a9cd-fcafe0f18b8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:20.492389 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a9d0e-562c-4ef6-a9cd-fcafe0f18b8a None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:20.508781 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-a45a9d0e-562c-4ef6-a9cd-fcafe0f18b8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:20.508781 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:20.508781 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:20.508781 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:20.508781 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:20.508781 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:20.508781 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:20.508781 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:20.508781 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:20.508781 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:20.508781 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:20.508781 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:20.508781 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:20.508781 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:20.508781 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:20.508781 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:20.509830 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:20.509830 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:20.509830 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:20.509830 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:20.509830 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:20.509830 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:20.509830 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:20.509830 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:20.509830 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:20.509830 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:20.509830 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:20.509830 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:20.509830 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:20.509830 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:20.509830 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:20.509830 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:20.509830 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:20.510770 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:20.510770 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:20.510770 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:20.512756 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 324/669] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:20.513800 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a9d0e-562c-4ef6-a9cd-fcafe0f18b8a None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:20.533261 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a0b962-e895-4b29-9e19-186a65f279d7 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:20.575306 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029378f-24e9-4f2a-8e5d-c9ff39e4cd69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:20.575630 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029378f-24e9-4f2a-8e5d-c9ff39e4cd69 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:20.575922 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029378f-24e9-4f2a-8e5d-c9ff39e4cd69 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:20.576202 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029378f-24e9-4f2a-8e5d-c9ff39e4cd69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:20.584773 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7029378f-24e9-4f2a-8e5d-c9ff39e4cd69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:20.586296 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7029378f-24e9-4f2a-8e5d-c9ff39e4cd69 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:20.600287 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-7029378f-24e9-4f2a-8e5d-c9ff39e4cd69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:20.600287 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:20.600287 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:20.600287 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:20.600287 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:20.600287 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:20.600287 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:20.600287 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:20.600287 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:20.600287 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:20.600287 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:20.600287 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:20.600287 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:43:20.600287 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:43:20.600287 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:43:20.601271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:43:20.601271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:20.601271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:20.601271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:20.601271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:20.601271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:20.601271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:20.601271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:20.601271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:20.601271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:20.601271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:20.601271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:20.601271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:20.601271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:20.601271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:20.601271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:20.601271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:20.602168 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:43:20.602168 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:43:20.602168 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:43:20.602168 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:43:20.602168 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:43:20.602168 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:43:20.602168 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:20.602168 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:20.602168 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 346/670] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:43:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:20.602706 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029378f-24e9-4f2a-8e5d-c9ff39e4cd69 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:20.629254 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a9d0e-562c-4ef6-a9cd-fcafe0f18b8a None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:20.647592 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:20.665576 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e34d4df-5e2d-4c36-a426-9ee1e13abb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:20.666210 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34d4df-5e2d-4c36-a426-9ee1e13abb14 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:20.666489 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34d4df-5e2d-4c36-a426-9ee1e13abb14 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:20.666755 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34d4df-5e2d-4c36-a426-9ee1e13abb14 None admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:20.667437 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e34d4df-5e2d-4c36-a426-9ee1e13abb14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:20.667739 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e34d4df-5e2d-4c36-a426-9ee1e13abb14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:20.669181 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e34d4df-5e2d-4c36-a426-9ee1e13abb14 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:20.677018 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:20.683261 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 325/671] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 7 15:43:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:20.684081 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e34d4df-5e2d-4c36-a426-9ee1e13abb14 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:20.712147 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029378f-24e9-4f2a-8e5d-c9ff39e4cd69 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:20.746101 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc47fd-13c5-42fa-bf27-37098bd3a430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:20.747053 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc47fd-13c5-42fa-bf27-37098bd3a430 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:20.747053 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc47fd-13c5-42fa-bf27-37098bd3a430 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:20.747350 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc47fd-13c5-42fa-bf27-37098bd3a430 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:20.747959 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc47fd-13c5-42fa-bf27-37098bd3a430 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:20.748258 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc47fd-13c5-42fa-bf27-37098bd3a430 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:20.749639 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc47fd-13c5-42fa-bf27-37098bd3a430 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:20.760960 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 347/672] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:20.761741 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc47fd-13c5-42fa-bf27-37098bd3a430 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:20.784579 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e34d4df-5e2d-4c36-a426-9ee1e13abb14 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:20.818120 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2f868-2de1-4a19-9b4e-b3c842f7eeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:20.818774 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2f868-2de1-4a19-9b4e-b3c842f7eeef None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:20.819056 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2f868-2de1-4a19-9b4e-b3c842f7eeef None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:20.819333 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2f868-2de1-4a19-9b4e-b3c842f7eeef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:20.830214 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e2f868-2de1-4a19-9b4e-b3c842f7eeef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:20.831603 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e2f868-2de1-4a19-9b4e-b3c842f7eeef None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:20.846603 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-01e2f868-2de1-4a19-9b4e-b3c842f7eeef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:20.846603 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:20.846603 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:20.846603 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:20.846603 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:20.846603 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:20.846603 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:20.846603 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:20.846603 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:20.846603 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:20.846603 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:20.846603 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:20.846603 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:20.846603 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:20.846603 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:20.846603 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:20.847775 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:20.847775 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:20.847775 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:20.847775 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:20.847775 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:20.847775 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:20.847775 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:20.847775 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:20.847775 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:20.847775 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:20.847775 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:20.847775 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:20.847775 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:20.847775 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:20.847775 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:20.847775 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:20.847775 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:20.848842 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:20.848842 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:20.848842 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:20.848842 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 326/673] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:20.849247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d575aba-39ea-4b27-b8e4-3601e4f26342 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:20.849538 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d575aba-39ea-4b27-b8e4-3601e4f26342 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:20.849819 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d575aba-39ea-4b27-b8e4-3601e4f26342 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:20.851166 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 327/674] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:43:20.851860 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d575aba-39ea-4b27-b8e4-3601e4f26342 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:20.863259 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:20.867390 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc47fd-13c5-42fa-bf27-37098bd3a430 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:20.902473 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5f9ba-287e-4f13-bcc4-8db9446a0803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:20.903802 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5f9ba-287e-4f13-bcc4-8db9446a0803 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:20.904171 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5f9ba-287e-4f13-bcc4-8db9446a0803 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:20.904521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5f9ba-287e-4f13-bcc4-8db9446a0803 None admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:20.904723 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:20.905334 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc5f9ba-287e-4f13-bcc4-8db9446a0803 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:20.905652 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc5f9ba-287e-4f13-bcc4-8db9446a0803 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:20.907118 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc5f9ba-287e-4f13-bcc4-8db9446a0803 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:20.918583 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 348/675] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 7 15:43:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:20.919361 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5f9ba-287e-4f13-bcc4-8db9446a0803 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:20.955340 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d575aba-39ea-4b27-b8e4-3601e4f26342 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:20.989578 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab70cd70-ab13-4f66-9eda-ff835c54eac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:20.990171 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab70cd70-ab13-4f66-9eda-ff835c54eac3 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:20.990479 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab70cd70-ab13-4f66-9eda-ff835c54eac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:20.990753 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab70cd70-ab13-4f66-9eda-ff835c54eac3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:20.991557 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab70cd70-ab13-4f66-9eda-ff835c54eac3 None admin] RBAC: Adding query filter params (role.id=a420b17212b94988beb75affe974355b, scope.project.id=488830167943488f85743236584113d7, user.id=99f8fac7bf3842cba115fa03ef9291d8) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:20.991859 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab70cd70-ab13-4f66-9eda-ff835c54eac3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:20.993282 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab70cd70-ab13-4f66-9eda-ff835c54eac3 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:20.999727 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 328/676] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 7 15:43:20 2022] GET /identity/v3/role_assignments?user.id=99f8fac7bf3842cba115fa03ef9291d8&scope.project.id=488830167943488f85743236584113d7&role.id=a420b17212b94988beb75affe974355b => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:21.000520 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab70cd70-ab13-4f66-9eda-ff835c54eac3 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:21.024615 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5f9ba-287e-4f13-bcc4-8db9446a0803 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:21.062780 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77433d2d-91a1-4292-a113-7915038a8872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:21.063438 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77433d2d-91a1-4292-a113-7915038a8872 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:21.063726 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77433d2d-91a1-4292-a113-7915038a8872 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:21.064008 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77433d2d-91a1-4292-a113-7915038a8872 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:21.071592 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77433d2d-91a1-4292-a113-7915038a8872 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:21.073063 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77433d2d-91a1-4292-a113-7915038a8872 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:21.086547 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-77433d2d-91a1-4292-a113-7915038a8872 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:21.086547 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:21.086547 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:21.086547 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:21.086547 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:21.086547 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:21.086547 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:21.086547 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:21.086547 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:21.086547 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:21.086547 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:21.086547 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:21.086547 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:43:21.086547 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:43:21.086547 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:43:21.087495 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:43:21.087495 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:21.087495 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:21.087495 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:21.087495 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:21.087495 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:21.087495 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:21.087495 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:21.087495 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:21.087495 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:21.087495 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:21.087495 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:21.087495 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:21.087495 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:21.087495 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:21.087495 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:21.087495 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:21.088383 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:43:21.088383 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:43:21.088383 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:43:21.088383 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:43:21.088383 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:43:21.088383 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:43:21.088383 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:21.088383 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:21.093434 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 349/677] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:43:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:21.094912 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366926a-994d-4dbf-899d-6178ad238d68 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:21.095197 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366926a-994d-4dbf-899d-6178ad238d68 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:21.095476 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366926a-994d-4dbf-899d-6178ad238d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:21.115783 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-f366926a-994d-4dbf-899d-6178ad238d68 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:21.117002 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-f366926a-994d-4dbf-899d-6178ad238d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:21.122087 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab70cd70-ab13-4f66-9eda-ff835c54eac3 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:21.132012 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:21.140371 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:21.165095 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65764d5-1409-4594-b77c-dcb7e5612ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:21.166124 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65764d5-1409-4594-b77c-dcb7e5612ace None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:21.166735 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65764d5-1409-4594-b77c-dcb7e5612ace None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:21.167177 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65764d5-1409-4594-b77c-dcb7e5612ace None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:21.167980 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65764d5-1409-4594-b77c-dcb7e5612ace None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:21.168513 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65764d5-1409-4594-b77c-dcb7e5612ace None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:21.169905 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65764d5-1409-4594-b77c-dcb7e5612ace None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:21.182512 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 329/678] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:21.183235 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65764d5-1409-4594-b77c-dcb7e5612ace None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:21.199608 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 350/679] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:43:21.200802 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366926a-994d-4dbf-899d-6178ad238d68 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:21.302911 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65764d5-1409-4594-b77c-dcb7e5612ace None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:21.316763 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366926a-994d-4dbf-899d-6178ad238d68 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:21.338565 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d60a7c7-6b3e-4088-a511-8e151d9fe1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:21.339091 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60a7c7-6b3e-4088-a511-8e151d9fe1bb None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:21.339365 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60a7c7-6b3e-4088-a511-8e151d9fe1bb None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:21.339631 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60a7c7-6b3e-4088-a511-8e151d9fe1bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:21.340676 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d60a7c7-6b3e-4088-a511-8e151d9fe1bb None admin] RBAC: Adding query filter params (role.id=a420b17212b94988beb75affe974355b, scope.project.id=488830167943488f85743236584113d7, user.id=3195fa62961c4d64972b88449d013380) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:21.340676 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d60a7c7-6b3e-4088-a511-8e151d9fe1bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:21.342079 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d60a7c7-6b3e-4088-a511-8e151d9fe1bb None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:21.348361 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 330/680] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 7 15:43:21 2022] GET /identity/v3/role_assignments?user.id=3195fa62961c4d64972b88449d013380&scope.project.id=488830167943488f85743236584113d7&role.id=a420b17212b94988beb75affe974355b => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:21.354344 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d60a7c7-6b3e-4088-a511-8e151d9fe1bb None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:21.375745 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a9a2f-af65-4fe4-a593-5f220e33d3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:21.376409 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a9a2f-af65-4fe4-a593-5f220e33d3d8 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:21.376649 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a9a2f-af65-4fe4-a593-5f220e33d3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:21.376917 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a9a2f-af65-4fe4-a593-5f220e33d3d8 None admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:21.377619 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24a9a2f-af65-4fe4-a593-5f220e33d3d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:21.377920 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24a9a2f-af65-4fe4-a593-5f220e33d3d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:21.379415 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24a9a2f-af65-4fe4-a593-5f220e33d3d8 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:21.408526 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 351/681] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 7 15:43:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:21.414365 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a9a2f-af65-4fe4-a593-5f220e33d3d8 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:21.424050 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:21.438945 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:21.519165 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d60a7c7-6b3e-4088-a511-8e151d9fe1bb None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:21.565748 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614794ec-6a22-4fee-a50c-95c46959bb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:21.566395 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614794ec-6a22-4fee-a50c-95c46959bb5a None admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:21.566586 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a9a2f-af65-4fe4-a593-5f220e33d3d8 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:21.566710 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614794ec-6a22-4fee-a50c-95c46959bb5a None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:21.566926 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614794ec-6a22-4fee-a50c-95c46959bb5a None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:21.567576 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614794ec-6a22-4fee-a50c-95c46959bb5a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:21.569206 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614794ec-6a22-4fee-a50c-95c46959bb5a None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:21.599289 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 331/682] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Sep 7 15:43:21 2022] POST /identity/v3/users => generated 254 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:43:21.600326 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614794ec-6a22-4fee-a50c-95c46959bb5a None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:21.626630 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29e6bd-29c0-48d7-a590-d509b5759b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:21.627463 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29e6bd-29c0-48d7-a590-d509b5759b83 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:21.627808 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29e6bd-29c0-48d7-a590-d509b5759b83 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:21.628153 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29e6bd-29c0-48d7-a590-d509b5759b83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:21.628970 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a29e6bd-29c0-48d7-a590-d509b5759b83 None admin] RBAC: Adding query filter params (role.id=a420b17212b94988beb75affe974355b, scope.project.id=488830167943488f85743236584113d7, user.id=f9b13331a5fd48f5a2521ed1600f9f35) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:21.629354 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a29e6bd-29c0-48d7-a590-d509b5759b83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:21.631070 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a29e6bd-29c0-48d7-a590-d509b5759b83 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:21.638581 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 352/683] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 7 15:43:21 2022] GET /identity/v3/role_assignments?user.id=f9b13331a5fd48f5a2521ed1600f9f35&scope.project.id=488830167943488f85743236584113d7&role.id=a420b17212b94988beb75affe974355b => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:43:21.734006 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:21.744194 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614794ec-6a22-4fee-a50c-95c46959bb5a None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:21.788725 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c435cb2-2a70-48c1-bb2d-fa8c38636edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:21.789734 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c435cb2-2a70-48c1-bb2d-fa8c38636edf None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:21.790243 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c435cb2-2a70-48c1-bb2d-fa8c38636edf None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:21.790707 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c435cb2-2a70-48c1-bb2d-fa8c38636edf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:21.804809 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c435cb2-2a70-48c1-bb2d-fa8c38636edf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:43:21.812057 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-5c435cb2-2a70-48c1-bb2d-fa8c38636edf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:43:21.812057 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:21.812057 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:21.812057 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:21.812057 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:21.812057 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:21.812057 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:21.812057 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:21.812057 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:21.812057 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:21.812057 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:21.812057 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:21.812057 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:43:21.812057 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:43:21.812057 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:43:21.812057 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:43:21.813179 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:43:21.813179 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:43:21.813179 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:43:21.813179 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:43:21.813179 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:21.813179 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:21.813179 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:21.813179 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:21.813179 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:21.813179 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:21.813179 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:21.813179 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:21.813179 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:21.813179 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:21.813179 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:21.813179 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:21.814038 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:21.814038 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:21.814038 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:21.814038 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:21.814038 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:43:21.814038 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:43:21.814038 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:43:21.814038 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:43:21.814038 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:43:21.814038 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:43:21.814038 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:43:21.814038 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:21.816624 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 332/684] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 7 15:43:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:21.822606 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29e6bd-29c0-48d7-a590-d509b5759b83 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:21.910985 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:21.944473 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29e6bd-29c0-48d7-a590-d509b5759b83 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:21.983433 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1e363-91ad-46fa-8ade-1a1c160cf7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:21.984301 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1e363-91ad-46fa-8ade-1a1c160cf7ba None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:21.984757 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1e363-91ad-46fa-8ade-1a1c160cf7ba None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:21.985198 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1e363-91ad-46fa-8ade-1a1c160cf7ba None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:21.986044 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da1e363-91ad-46fa-8ade-1a1c160cf7ba None admin] RBAC: Adding query filter params (name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:21.986518 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da1e363-91ad-46fa-8ade-1a1c160cf7ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:21.988033 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da1e363-91ad-46fa-8ade-1a1c160cf7ba None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:21.997837 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 353/685] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 7 15:43:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:22.004527 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c435cb2-2a70-48c1-bb2d-fa8c38636edf None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:22.117598 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c435cb2-2a70-48c1-bb2d-fa8c38636edf None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:22.157303 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff6150-1a12-4801-9971-e5d4c694745d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:22.157944 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff6150-1a12-4801-9971-e5d4c694745d None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:22.159266 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff6150-1a12-4801-9971-e5d4c694745d None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:22.159266 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff6150-1a12-4801-9971-e5d4c694745d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:22.173668 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff6150-1a12-4801-9971-e5d4c694745d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:22.175092 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff6150-1a12-4801-9971-e5d4c694745d None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:22.193911 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-16ff6150-1a12-4801-9971-e5d4c694745d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:22.193911 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:22.193911 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:22.193911 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:22.193911 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:22.193911 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:22.193911 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:22.193911 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:22.193911 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:22.193911 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:22.193911 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:22.193911 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:22.193911 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:22.193911 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:22.193911 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:22.193911 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:22.194932 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:22.194932 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:22.194932 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:22.194932 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:22.194932 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:22.194932 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:22.194932 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:22.194932 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:22.194932 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:22.194932 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:22.194932 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:22.194932 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:22.194932 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:22.194932 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:22.194932 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:22.194932 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:22.194932 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:22.195825 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:22.195825 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:22.195825 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:22.195825 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 333/686] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:22.201538 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1e363-91ad-46fa-8ade-1a1c160cf7ba None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:22.350864 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1e363-91ad-46fa-8ade-1a1c160cf7ba None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:22.395845 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b58351-7473-402a-9b1f-9808c744b116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:22.396495 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b58351-7473-402a-9b1f-9808c744b116 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:22.396745 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b58351-7473-402a-9b1f-9808c744b116 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:22.396999 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b58351-7473-402a-9b1f-9808c744b116 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:22.397650 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b58351-7473-402a-9b1f-9808c744b116 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:22.397952 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b58351-7473-402a-9b1f-9808c744b116 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:22.399355 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b58351-7473-402a-9b1f-9808c744b116 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:22.400970 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:22.421077 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 354/687] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:22.426454 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff6150-1a12-4801-9971-e5d4c694745d None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:22.440693 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:22.555268 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff6150-1a12-4801-9971-e5d4c694745d None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:22.590782 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a059dd-3233-48cb-a8f5-c12f91f7bb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:22.591789 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a059dd-3233-48cb-a8f5-c12f91f7bb4c None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:22.592280 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a059dd-3233-48cb-a8f5-c12f91f7bb4c None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:22.592746 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a059dd-3233-48cb-a8f5-c12f91f7bb4c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:22.600869 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a059dd-3233-48cb-a8f5-c12f91f7bb4c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:22.602615 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a059dd-3233-48cb-a8f5-c12f91f7bb4c None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:22.614912 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-d7a059dd-3233-48cb-a8f5-c12f91f7bb4c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 07 15:43:22.614912 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:22.614912 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:22.614912 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:22.614912 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:22.614912 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:22.614912 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:22.614912 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:22.614912 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:22.614912 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:22.614912 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:22.614912 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:22.614912 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:43:22.614912 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:43:22.614912 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:43:22.614912 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:43:22.615872 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:22.615872 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:22.615872 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:43:22.615872 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:22.615872 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:43:22.615872 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:22.615872 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:22.615872 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:22.615872 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:22.615872 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:22.615872 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:22.615872 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:22.615872 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:22.615872 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:22.615872 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:22.615872 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:22.615872 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:22.615872 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:22.616788 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:22.616788 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:22.616788 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:43:22.616788 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:43:22.616788 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:43:22.616788 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:43:22.616788 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:43:22.616788 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:43:22.616788 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 07 15:43:22.616788 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:22.619243 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 334/688] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 7 15:43:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:22.625626 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b58351-7473-402a-9b1f-9808c744b116 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:22.776604 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b58351-7473-402a-9b1f-9808c744b116 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:22.824384 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3b6b5-fcdd-4295-8009-48d01c7abdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:22.825607 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3b6b5-fcdd-4295-8009-48d01c7abdf7 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:22.825962 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3b6b5-fcdd-4295-8009-48d01c7abdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:22.826292 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3b6b5-fcdd-4295-8009-48d01c7abdf7 None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:22.827030 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a3b6b5-fcdd-4295-8009-48d01c7abdf7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:22.827338 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a3b6b5-fcdd-4295-8009-48d01c7abdf7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:22.828771 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a3b6b5-fcdd-4295-8009-48d01c7abdf7 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:22.854270 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 355/689] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Sep 7 15:43:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:22.860440 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a059dd-3233-48cb-a8f5-c12f91f7bb4c None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:22.944917 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:22.996601 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a059dd-3233-48cb-a8f5-c12f91f7bb4c None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:23.046598 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a9446-1e20-49a5-bbd3-475e1c4bf1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:23.047231 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a9446-1e20-49a5-bbd3-475e1c4bf1d0 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:23.047511 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a9446-1e20-49a5-bbd3-475e1c4bf1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:23.047787 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a9446-1e20-49a5-bbd3-475e1c4bf1d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:23.133811 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3a9446-1e20-49a5-bbd3-475e1c4bf1d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:23.139889 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3a9446-1e20-49a5-bbd3-475e1c4bf1d0 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:23.211650 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:23.261859 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 335/690] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:43:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:43:23.267269 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3b6b5-fcdd-4295-8009-48d01c7abdf7 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:23.375259 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:23.447725 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3b6b5-fcdd-4295-8009-48d01c7abdf7 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:23.502897 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95aa59-86eb-4325-9018-90faf68d92b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:23.503540 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95aa59-86eb-4325-9018-90faf68d92b4 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:23.503825 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95aa59-86eb-4325-9018-90faf68d92b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:23.504103 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95aa59-86eb-4325-9018-90faf68d92b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:23.521532 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3ad00-a5f3-46ca-84e5-d8a4acffcc3b None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:23.522012 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3ad00-a5f3-46ca-84e5-d8a4acffcc3b None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:23.522088 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3ad00-a5f3-46ca-84e5-d8a4acffcc3b None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:23.523405 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e95aa59-86eb-4325-9018-90faf68d92b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:23.523723 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 336/691] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:43:23.524896 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e95aa59-86eb-4325-9018-90faf68d92b4 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:23.529184 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6fbbc-20f6-4e09-a027-00786331548e None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:23.529474 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6fbbc-20f6-4e09-a027-00786331548e None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:23.529747 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6fbbc-20f6-4e09-a027-00786331548e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:23.550779 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-7e95aa59-86eb-4325-9018-90faf68d92b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:23.550779 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:23.550779 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:23.550779 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:23.550779 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:23.550779 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:23.550779 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:23.550779 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:23.550779 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:23.550779 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:23.550779 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:23.550779 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:23.550779 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:23.550779 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:23.550779 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:23.550779 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:23.551744 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:23.551744 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:23.551744 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:23.551744 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:23.551744 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:23.551744 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:23.551744 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:23.551744 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:23.551744 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:23.551744 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:23.551744 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:23.551744 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:23.551744 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:23.551744 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:23.551744 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:23.551744 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:23.551744 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:23.552673 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:23.552673 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:23.552673 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:23.554219 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 356/692] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:23.557258 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95aa59-86eb-4325-9018-90faf68d92b4 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:23.558502 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-95c6fbbc-20f6-4e09-a027-00786331548e None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:23.559771 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-95c6fbbc-20f6-4e09-a027-00786331548e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:23.688285 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 337/693] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 15:43:23.726092 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95aa59-86eb-4325-9018-90faf68d92b4 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:23.731678 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:23.774669 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649b5c1-a858-478e-868b-249eb478bf52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:23.775282 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649b5c1-a858-478e-868b-249eb478bf52 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:23.775562 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649b5c1-a858-478e-868b-249eb478bf52 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:23.775836 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649b5c1-a858-478e-868b-249eb478bf52 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:23.776481 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f649b5c1-a858-478e-868b-249eb478bf52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:23.776786 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f649b5c1-a858-478e-868b-249eb478bf52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:23.778687 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f649b5c1-a858-478e-868b-249eb478bf52 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:23.794683 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 357/694] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:23.799626 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6fbbc-20f6-4e09-a027-00786331548e None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:23.930508 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:23.936852 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6fbbc-20f6-4e09-a027-00786331548e None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:23.976759 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725bea7c-ecc3-4dc6-a543-58037a4a1880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:23.977313 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725bea7c-ecc3-4dc6-a543-58037a4a1880 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:23.977659 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725bea7c-ecc3-4dc6-a543-58037a4a1880 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:23.977937 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725bea7c-ecc3-4dc6-a543-58037a4a1880 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:23.989160 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725bea7c-ecc3-4dc6-a543-58037a4a1880 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:23.990582 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725bea7c-ecc3-4dc6-a543-58037a4a1880 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:24.007105 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-725bea7c-ecc3-4dc6-a543-58037a4a1880 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:24.007105 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:24.007105 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:24.007105 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:24.007105 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:24.007105 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:24.007105 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:24.007105 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:24.007105 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:24.007105 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:24.007105 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:24.007105 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:24.007105 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:43:24.007105 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:43:24.007105 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:43:24.007993 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:43:24.007993 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:24.007993 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:24.007993 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:24.007993 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:24.007993 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:24.007993 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:24.007993 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:24.007993 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:24.007993 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:24.007993 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:24.007993 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:24.007993 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:24.007993 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:24.007993 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:24.007993 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:24.007993 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:24.008890 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:43:24.008890 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:43:24.008890 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:43:24.008890 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:43:24.008890 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:43:24.008890 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:43:24.008890 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:24.008890 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:24.008890 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 338/695] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:43:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:24.013927 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649b5c1-a858-478e-868b-249eb478bf52 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:24.144379 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649b5c1-a858-478e-868b-249eb478bf52 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:24.166913 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725bea7c-ecc3-4dc6-a543-58037a4a1880 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:24.180982 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5fa9e5-f59f-424c-98a0-89c2580cdeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:24.181907 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fa9e5-f59f-424c-98a0-89c2580cdeb4 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:24.182448 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fa9e5-f59f-424c-98a0-89c2580cdeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:24.182947 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fa9e5-f59f-424c-98a0-89c2580cdeb4 None admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:24.184368 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5fa9e5-f59f-424c-98a0-89c2580cdeb4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:24.184892 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5fa9e5-f59f-424c-98a0-89c2580cdeb4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:24.186597 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5fa9e5-f59f-424c-98a0-89c2580cdeb4 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:24.200527 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 358/696] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 7 15:43:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:24.207331 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5fa9e5-f59f-424c-98a0-89c2580cdeb4 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:24.259578 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:24.355574 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725bea7c-ecc3-4dc6-a543-58037a4a1880 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:24.359119 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5fa9e5-f59f-424c-98a0-89c2580cdeb4 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:24.393815 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11aa765-5cee-458b-9496-f164fec5da46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:24.394504 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11aa765-5cee-458b-9496-f164fec5da46 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:24.394788 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11aa765-5cee-458b-9496-f164fec5da46 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:24.395067 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11aa765-5cee-458b-9496-f164fec5da46 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:24.395674 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11aa765-5cee-458b-9496-f164fec5da46 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:24.397325 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11aa765-5cee-458b-9496-f164fec5da46 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:24.397875 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369c9ef-e17e-4ad9-88d0-3becde981818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:24.398833 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369c9ef-e17e-4ad9-88d0-3becde981818 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:24.399358 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369c9ef-e17e-4ad9-88d0-3becde981818 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:24.399895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369c9ef-e17e-4ad9-88d0-3becde981818 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:24.400908 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3369c9ef-e17e-4ad9-88d0-3becde981818 None admin] RBAC: Adding query filter params (role.id=a420b17212b94988beb75affe974355b, scope.project.id=488830167943488f85743236584113d7, user.id=16c4b090a4aa4d56a90ccf090b9caba8) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:24.401587 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3369c9ef-e17e-4ad9-88d0-3becde981818 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:24.403770 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3369c9ef-e17e-4ad9-88d0-3becde981818 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:24.411409 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 359/697] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 7 15:43:24 2022] GET /identity/v3/role_assignments?user.id=16c4b090a4aa4d56a90ccf090b9caba8&scope.project.id=488830167943488f85743236584113d7&role.id=a420b17212b94988beb75affe974355b => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:24.411828 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-c11aa765-5cee-458b-9496-f164fec5da46 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 15:43:24.411828 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:24.411828 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 15:43:24.411828 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 15:43:24.411828 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 15:43:24.411828 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 15:43:24.411828 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 15:43:24.411828 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:43:24.411828 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 15:43:24.411828 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:24.411828 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:43:24.411828 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:24.411828 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:24.411828 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:24.411828 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:24.411828 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:24.411828 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:24.412840 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:24.412840 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:24.412840 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:24.412840 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:24.412840 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:24.412840 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:24.412840 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 15:43:24.412840 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 15:43:24.412840 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 15:43:24.412840 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 15:43:24.412840 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:24.412840 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:24.412840 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:24.412840 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:24.412840 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:24.412840 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:24.413703 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:24.413703 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:24.413703 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:24.413703 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:24.413703 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:24.413703 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:24.413703 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:24.413703 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:24.413703 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:24.413703 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:24.413703 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 15:43:24.413703 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:43:24.413703 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 15:43:24.413703 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:24.416578 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1821e0c-1f03-44a5-bff3-763573b7afc1 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:24.417242 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1821e0c-1f03-44a5-bff3-763573b7afc1 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:24.417729 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1821e0c-1f03-44a5-bff3-763573b7afc1 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:24.418095 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 339/698] 10.222.0.16 () {56 vars in 1129 bytes} [Wed Sep 7 15:43:24 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:24.420673 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11aa765-5cee-458b-9496-f164fec5da46 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:24.420948 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 360/699] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:43:24.439715 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f6bc6-d39f-4867-a620-ec7a8e9905cd None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:24.440355 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f6bc6-d39f-4867-a620-ec7a8e9905cd None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:24.440840 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f6bc6-d39f-4867-a620-ec7a8e9905cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:24.452486 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:24.498712 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-949f6bc6-d39f-4867-a620-ec7a8e9905cd None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:24.500046 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-949f6bc6-d39f-4867-a620-ec7a8e9905cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:24.549030 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11aa765-5cee-458b-9496-f164fec5da46 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:24.596281 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684082fb-3ad4-4728-9322-777fbcd6a94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:24.596906 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684082fb-3ad4-4728-9322-777fbcd6a94d None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:24.597191 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684082fb-3ad4-4728-9322-777fbcd6a94d None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:24.597471 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684082fb-3ad4-4728-9322-777fbcd6a94d None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:24.598117 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684082fb-3ad4-4728-9322-777fbcd6a94d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:24.598456 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684082fb-3ad4-4728-9322-777fbcd6a94d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:24.600339 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684082fb-3ad4-4728-9322-777fbcd6a94d None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:24.608019 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 340/700] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Sep 7 15:43:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:24.609647 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6b323-edc9-4838-8815-97a53aa85b50 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:24.609647 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6b323-edc9-4838-8815-97a53aa85b50 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:24.609647 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6b323-edc9-4838-8815-97a53aa85b50 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:24.615272 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 341/701] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:43:24.616823 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6b323-edc9-4838-8815-97a53aa85b50 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:24.619194 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 361/702] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:43:24.620993 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4fa94-6b12-46ef-8948-03902a0cfd1e None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:24.621573 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4fa94-6b12-46ef-8948-03902a0cfd1e None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:24.622035 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4fa94-6b12-46ef-8948-03902a0cfd1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:24.644988 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-a3b4fa94-6b12-46ef-8948-03902a0cfd1e None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:24.646499 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-a3b4fa94-6b12-46ef-8948-03902a0cfd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:24.664227 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:24.735694 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 362/703] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:43:24.746846 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:24.765030 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6b323-edc9-4838-8815-97a53aa85b50 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:24.801672 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e1cef5-7df1-4c59-a96c-b55b1b462db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:24.802215 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1cef5-7df1-4c59-a96c-b55b1b462db0 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:24.802499 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1cef5-7df1-4c59-a96c-b55b1b462db0 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:24.802768 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1cef5-7df1-4c59-a96c-b55b1b462db0 None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:24.803388 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e1cef5-7df1-4c59-a96c-b55b1b462db0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:24.803739 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e1cef5-7df1-4c59-a96c-b55b1b462db0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:24.805105 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e1cef5-7df1-4c59-a96c-b55b1b462db0 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:24.811896 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 342/704] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Sep 7 15:43:24 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:43:24.816845 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243fea98-aed9-4b12-a957-e88a806174e9 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:24.817136 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243fea98-aed9-4b12-a957-e88a806174e9 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:24.818277 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243fea98-aed9-4b12-a957-e88a806174e9 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:24.820093 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 363/705] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:43:24.825191 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494f0ec-f038-4a7b-aa89-4f7f5250e4f9 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:24.825473 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494f0ec-f038-4a7b-aa89-4f7f5250e4f9 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:24.825808 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494f0ec-f038-4a7b-aa89-4f7f5250e4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:24.851163 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-5494f0ec-f038-4a7b-aa89-4f7f5250e4f9 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:24.852739 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-5494f0ec-f038-4a7b-aa89-4f7f5250e4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:24.934964 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243fea98-aed9-4b12-a957-e88a806174e9 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:24.943677 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 343/706] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:43:25.063598 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494f0ec-f038-4a7b-aa89-4f7f5250e4f9 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:25.110866 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243fea98-aed9-4b12-a957-e88a806174e9 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:25.172258 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98074dd2-a86a-48a9-b743-0d72c55ce065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:25.172898 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98074dd2-a86a-48a9-b743-0d72c55ce065 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:25.173177 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98074dd2-a86a-48a9-b743-0d72c55ce065 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:25.173449 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98074dd2-a86a-48a9-b743-0d72c55ce065 None admin] PATH_INFO: `/v3/services/network` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:25.174029 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98074dd2-a86a-48a9-b743-0d72c55ce065 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:25.175423 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98074dd2-a86a-48a9-b743-0d72c55ce065 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:25.195752 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-98074dd2-a86a-48a9-b743-0d72c55ce065 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 15:43:25.195752 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:25.195752 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 15:43:25.195752 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 15:43:25.195752 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 15:43:25.195752 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 15:43:25.195752 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 15:43:25.195752 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:43:25.195752 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 15:43:25.195752 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:25.195752 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:43:25.195752 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:25.195752 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:25.195752 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:25.195752 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:25.195752 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:25.195752 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:25.196878 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:25.196878 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:25.196878 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:25.196878 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:25.196878 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:25.196878 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:25.196878 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 15:43:25.196878 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 15:43:25.196878 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 15:43:25.196878 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 15:43:25.196878 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:25.196878 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:25.196878 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:25.196878 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:25.196878 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:25.196878 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:25.197705 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:25.197705 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:25.197705 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:25.197705 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:25.197705 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:25.197705 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:25.197705 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:25.197705 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:25.197705 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:25.197705 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:25.197705 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 15:43:25.197705 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:43:25.197705 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 15:43:25.197705 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:25.202346 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:25.202446 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 364/707] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:43:24 2022] GET /identity/v3/services/network => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:25.206823 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98074dd2-a86a-48a9-b743-0d72c55ce065 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:25.225953 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:25.252306 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494f0ec-f038-4a7b-aa89-4f7f5250e4f9 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:25.315929 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff3842-5605-4280-8948-5c219b888001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:25.316484 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff3842-5605-4280-8948-5c219b888001 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:25.316768 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff3842-5605-4280-8948-5c219b888001 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:25.317038 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff3842-5605-4280-8948-5c219b888001 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:25.329232 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff3842-5605-4280-8948-5c219b888001 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:43:25.330902 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98074dd2-a86a-48a9-b743-0d72c55ce065 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:25.334333 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-e7ff3842-5605-4280-8948-5c219b888001 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:43:25.334333 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:25.334333 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:25.334333 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:25.334333 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:25.334333 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:25.334333 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:25.334333 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:25.334333 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:25.334333 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:25.334333 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:25.334333 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:25.334333 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:43:25.334333 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:43:25.334333 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:43:25.334333 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:43:25.335247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:43:25.335247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:43:25.335247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:43:25.335247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:43:25.335247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:25.335247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:25.335247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:25.335247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:25.335247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:25.335247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:25.335247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:25.335247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:25.335247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:25.335247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:25.335247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:25.335247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:25.336086 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:25.336086 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:25.336086 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:25.336086 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:25.336086 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:43:25.336086 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:43:25.336086 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:43:25.336086 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:43:25.336086 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:43:25.336086 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:43:25.336086 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:43:25.336086 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:25.336086 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 344/708] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 7 15:43:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:43:25.336765 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff3842-5605-4280-8948-5c219b888001 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:25.373607 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f91c34-1568-43ac-abaa-c09628e4708e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:25.374259 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f91c34-1568-43ac-abaa-c09628e4708e None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:25.374553 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f91c34-1568-43ac-abaa-c09628e4708e None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:25.374829 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f91c34-1568-43ac-abaa-c09628e4708e None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:25.375460 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f91c34-1568-43ac-abaa-c09628e4708e None admin] RBAC: Adding query filter params (name=network) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:25.375763 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f91c34-1568-43ac-abaa-c09628e4708e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:25.377141 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f91c34-1568-43ac-abaa-c09628e4708e None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:25.382142 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 365/709] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Sep 7 15:43:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:43:25.383051 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f91c34-1568-43ac-abaa-c09628e4708e None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:25.444468 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff3842-5605-4280-8948-5c219b888001 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:25.462299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:25.485627 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb72afc-060a-436d-a266-05eaf87d4926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:25.486725 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb72afc-060a-436d-a266-05eaf87d4926 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:25.487177 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb72afc-060a-436d-a266-05eaf87d4926 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:25.487642 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb72afc-060a-436d-a266-05eaf87d4926 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:25.489089 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f91c34-1568-43ac-abaa-c09628e4708e None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:25.495593 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:25.502338 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb72afc-060a-436d-a266-05eaf87d4926 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:43:25.507935 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-2eb72afc-060a-436d-a266-05eaf87d4926 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:43:25.507935 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:25.507935 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:25.507935 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:25.507935 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:25.507935 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:25.507935 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:25.507935 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:25.507935 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:25.507935 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:25.507935 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:25.507935 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:25.507935 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:43:25.507935 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:43:25.507935 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:43:25.507935 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:43:25.509001 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:43:25.509001 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:43:25.509001 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:43:25.509001 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:43:25.509001 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:25.509001 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:25.509001 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:25.509001 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:25.509001 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:25.509001 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:25.509001 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:25.509001 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:25.509001 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:25.509001 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:25.509001 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:25.509001 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:25.509859 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:25.509859 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:25.509859 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:25.509859 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:25.509859 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:43:25.509859 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:43:25.509859 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:43:25.509859 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:43:25.509859 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:43:25.509859 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:43:25.509859 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:43:25.509859 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:25.512464 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 345/710] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 7 15:43:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:25.513534 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb72afc-060a-436d-a266-05eaf87d4926 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:25.526931 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ab4b0-b790-487a-8503-24b12201215f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:25.528162 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ab4b0-b790-487a-8503-24b12201215f None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:25.528530 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ab4b0-b790-487a-8503-24b12201215f None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:25.529110 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ab4b0-b790-487a-8503-24b12201215f None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:25.529688 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ab4b0-b790-487a-8503-24b12201215f None admin] RBAC: Adding query filter params (name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:25.530065 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ab4b0-b790-487a-8503-24b12201215f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:25.531559 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ab4b0-b790-487a-8503-24b12201215f None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:25.545545 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 366/711] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 7 15:43:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:25.546680 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ab4b0-b790-487a-8503-24b12201215f None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:25.625980 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb72afc-060a-436d-a266-05eaf87d4926 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:25.655630 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ab4b0-b790-487a-8503-24b12201215f None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:25.664434 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b674261-8e05-4e11-a37e-f701c7c6642a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:25.665398 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b674261-8e05-4e11-a37e-f701c7c6642a None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:25.665861 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b674261-8e05-4e11-a37e-f701c7c6642a None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:25.666343 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b674261-8e05-4e11-a37e-f701c7c6642a None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:25.667317 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b674261-8e05-4e11-a37e-f701c7c6642a None admin] RBAC: Adding query filter params (type=network) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:25.667816 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b674261-8e05-4e11-a37e-f701c7c6642a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:25.669794 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b674261-8e05-4e11-a37e-f701c7c6642a None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:25.682522 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 346/712] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Sep 7 15:43:25 2022] GET /identity/v3/services?type=network => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:25.684532 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b674261-8e05-4e11-a37e-f701c7c6642a None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:25.700415 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8af7be-51c7-429a-ad80-a65d4278a4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:25.700415 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8af7be-51c7-429a-ad80-a65d4278a4dc None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:25.700415 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8af7be-51c7-429a-ad80-a65d4278a4dc None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:25.700415 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8af7be-51c7-429a-ad80-a65d4278a4dc None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:25.700813 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8af7be-51c7-429a-ad80-a65d4278a4dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:25.700813 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8af7be-51c7-429a-ad80-a65d4278a4dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:25.700813 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8af7be-51c7-429a-ad80-a65d4278a4dc None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:25.705642 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:25.710142 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 367/713] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:43:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:25.717435 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8af7be-51c7-429a-ad80-a65d4278a4dc None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:25.771094 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:25.808148 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b674261-8e05-4e11-a37e-f701c7c6642a None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:25.846656 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a4dcb-c6e7-40c3-935a-717b1ebc7939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:25.847773 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a4dcb-c6e7-40c3-935a-717b1ebc7939 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:25.848257 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a4dcb-c6e7-40c3-935a-717b1ebc7939 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:25.848760 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a4dcb-c6e7-40c3-935a-717b1ebc7939 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:25.861737 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a4dcb-c6e7-40c3-935a-717b1ebc7939 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:25.863800 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a4dcb-c6e7-40c3-935a-717b1ebc7939 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:25.880616 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-386a4dcb-c6e7-40c3-935a-717b1ebc7939 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:25.880616 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:25.880616 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:25.880616 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:25.880616 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:25.880616 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:25.880616 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:25.880616 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:25.880616 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:25.880616 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:25.880616 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:25.880616 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:25.880616 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:25.880616 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:25.880616 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:25.880616 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:25.881612 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:25.881612 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:25.881612 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:25.881612 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:25.881612 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:25.881612 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:25.881612 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:25.881612 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:25.881612 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:25.881612 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:25.881612 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:25.881612 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:25.881612 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:25.881612 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:25.881612 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:25.881612 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:25.881612 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:25.882533 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:25.882533 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:25.882533 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:25.885606 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 347/714] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:25.891839 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a4dcb-c6e7-40c3-935a-717b1ebc7939 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:25.976266 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8af7be-51c7-429a-ad80-a65d4278a4dc None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:26.007346 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a4dcb-c6e7-40c3-935a-717b1ebc7939 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:26.023911 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:26.029217 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34941d1f-1f4d-4083-9e9c-c9ccb9312a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:26.030128 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34941d1f-1f4d-4083-9e9c-c9ccb9312a65 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:26.030660 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34941d1f-1f4d-4083-9e9c-c9ccb9312a65 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:26.031345 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34941d1f-1f4d-4083-9e9c-c9ccb9312a65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:26.047129 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34941d1f-1f4d-4083-9e9c-c9ccb9312a65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:26.048966 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34941d1f-1f4d-4083-9e9c-c9ccb9312a65 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:26.058023 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd5ec9-1ed2-4dea-a987-b48be6a6caa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:26.058684 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd5ec9-1ed2-4dea-a987-b48be6a6caa7 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:26.059699 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd5ec9-1ed2-4dea-a987-b48be6a6caa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:26.060382 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd5ec9-1ed2-4dea-a987-b48be6a6caa7 None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:26.061037 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd5ec9-1ed2-4dea-a987-b48be6a6caa7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:26.061627 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd5ec9-1ed2-4dea-a987-b48be6a6caa7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:26.063078 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd5ec9-1ed2-4dea-a987-b48be6a6caa7 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:26.067324 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-34941d1f-1f4d-4083-9e9c-c9ccb9312a65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:26.067324 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:26.067324 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:26.067324 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:26.067324 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:26.067324 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:26.067324 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:26.067324 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:26.067324 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:26.067324 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:26.067324 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:26.067324 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:26.067324 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:26.067324 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:26.067324 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:26.067324 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:26.068306 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:26.068306 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:26.068306 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:26.068306 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:26.068306 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:26.068306 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:26.068306 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:26.068306 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:26.068306 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:26.068306 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:26.068306 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:26.068306 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:26.068306 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:26.068306 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:26.068306 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:26.068306 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:26.068306 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:26.069212 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:26.069212 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:26.069212 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:26.069788 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 368/715] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:26.076519 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34941d1f-1f4d-4083-9e9c-c9ccb9312a65 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:26.078256 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 348/716] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:26.083803 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd5ec9-1ed2-4dea-a987-b48be6a6caa7 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:26.140112 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:26.192384 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34941d1f-1f4d-4083-9e9c-c9ccb9312a65 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:26.236764 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca7b49-833e-40a4-aa11-113c490ad183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:26.237644 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca7b49-833e-40a4-aa11-113c490ad183 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:26.237925 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca7b49-833e-40a4-aa11-113c490ad183 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:26.238209 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca7b49-833e-40a4-aa11-113c490ad183 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:26.238861 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ca7b49-833e-40a4-aa11-113c490ad183 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:26.239165 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ca7b49-833e-40a4-aa11-113c490ad183 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:26.241247 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ca7b49-833e-40a4-aa11-113c490ad183 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:26.256996 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd5ec9-1ed2-4dea-a987-b48be6a6caa7 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:26.269397 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 369/717] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:26.274734 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca7b49-833e-40a4-aa11-113c490ad183 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:26.334902 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb6537-3b4d-4dc6-bde3-83b4253722b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:26.335720 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb6537-3b4d-4dc6-bde3-83b4253722b7 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:26.336004 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb6537-3b4d-4dc6-bde3-83b4253722b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:26.336278 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb6537-3b4d-4dc6-bde3-83b4253722b7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:26.344678 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb6537-3b4d-4dc6-bde3-83b4253722b7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:26.346119 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb6537-3b4d-4dc6-bde3-83b4253722b7 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:26.358545 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-60bb6537-3b4d-4dc6-bde3-83b4253722b7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 15:43:26.358545 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:26.358545 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:26.358545 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:26.358545 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:26.358545 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:26.358545 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:26.358545 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:26.358545 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:26.358545 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:26.358545 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:26.358545 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:26.358545 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:43:26.358545 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:43:26.358545 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:43:26.358545 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:43:26.359522 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:26.359522 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:26.359522 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:43:26.359522 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:26.359522 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:43:26.359522 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:26.359522 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:26.359522 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:26.359522 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:26.359522 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:26.359522 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:26.359522 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:26.359522 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:26.359522 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:26.359522 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:26.359522 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:26.359522 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:26.359522 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:26.360798 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:26.360798 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:26.360798 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:43:26.360798 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:43:26.360798 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:43:26.360798 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:43:26.360798 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:43:26.360798 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:43:26.360798 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 15:43:26.360798 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:26.360798 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 349/718] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Sep 7 15:43:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:43:26.368305 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb6537-3b4d-4dc6-bde3-83b4253722b7 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:26.379378 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca7b49-833e-40a4-aa11-113c490ad183 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:26.395444 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:26.416600 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b376b328-0dd3-4b84-a607-da9e49921d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:26.417236 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b376b328-0dd3-4b84-a607-da9e49921d5d None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:26.417515 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b376b328-0dd3-4b84-a607-da9e49921d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:26.417853 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b376b328-0dd3-4b84-a607-da9e49921d5d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:26.426151 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b376b328-0dd3-4b84-a607-da9e49921d5d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:26.427625 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b376b328-0dd3-4b84-a607-da9e49921d5d None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:26.428677 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:26.442198 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-b376b328-0dd3-4b84-a607-da9e49921d5d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 15:43:26.442198 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:26.442198 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:26.442198 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:26.442198 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:26.442198 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:26.442198 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:26.442198 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:26.442198 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:26.442198 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:26.442198 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:26.442198 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:26.442198 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:43:26.442198 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:43:26.442198 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:43:26.442198 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:43:26.443244 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:26.443244 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:26.443244 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:43:26.443244 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:26.443244 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:43:26.443244 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:26.443244 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:26.443244 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:26.443244 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:26.443244 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:26.443244 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:26.443244 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:26.443244 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:26.443244 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:26.443244 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:26.443244 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:26.443244 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:26.443244 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:26.444852 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:26.444852 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:26.444852 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:43:26.444852 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:43:26.444852 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:43:26.444852 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:43:26.444852 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:43:26.444852 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:43:26.444852 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 15:43:26.444852 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:26.444852 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 370/719] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Sep 7 15:43:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:43:26.449117 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b376b328-0dd3-4b84-a607-da9e49921d5d None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:26.556289 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb6537-3b4d-4dc6-bde3-83b4253722b7 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:26.556773 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b376b328-0dd3-4b84-a607-da9e49921d5d None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:26.603010 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39de92f-272f-48aa-b584-8eded14bc399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:26.603735 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39de92f-272f-48aa-b584-8eded14bc399 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:26.604022 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39de92f-272f-48aa-b584-8eded14bc399 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:26.604336 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39de92f-272f-48aa-b584-8eded14bc399 None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:26.605074 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39de92f-272f-48aa-b584-8eded14bc399 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:26.605380 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39de92f-272f-48aa-b584-8eded14bc399 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:26.607382 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39de92f-272f-48aa-b584-8eded14bc399 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:26.609328 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de842e9f-6726-4d9e-8651-e43ca41e6737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:26.610061 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de842e9f-6726-4d9e-8651-e43ca41e6737 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:26.610466 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de842e9f-6726-4d9e-8651-e43ca41e6737 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:26.610837 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de842e9f-6726-4d9e-8651-e43ca41e6737 None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:26.611668 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de842e9f-6726-4d9e-8651-e43ca41e6737 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:26.612075 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de842e9f-6726-4d9e-8651-e43ca41e6737 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:26.613602 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de842e9f-6726-4d9e-8651-e43ca41e6737 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:26.632356 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 350/720] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Sep 7 15:43:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:43:26.639351 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de842e9f-6726-4d9e-8651-e43ca41e6737 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:26.639653 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 371/721] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Sep 7 15:43:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:26.644824 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39de92f-272f-48aa-b584-8eded14bc399 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:26.686587 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:26.784823 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39de92f-272f-48aa-b584-8eded14bc399 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:26.826991 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f261804-80d8-45df-8641-098a00d4c811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:26.827998 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f261804-80d8-45df-8641-098a00d4c811 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:26.828283 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f261804-80d8-45df-8641-098a00d4c811 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:26.828555 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f261804-80d8-45df-8641-098a00d4c811 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:26.847528 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:26.888365 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de842e9f-6726-4d9e-8651-e43ca41e6737 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:26.905457 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f261804-80d8-45df-8641-098a00d4c811 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:26.907022 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f261804-80d8-45df-8641-098a00d4c811 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:26.974702 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:26.975014 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365bce0-a108-467f-b33a-d339cc85f362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:26.975867 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365bce0-a108-467f-b33a-d339cc85f362 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:26.975981 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365bce0-a108-467f-b33a-d339cc85f362 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:26.976171 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365bce0-a108-467f-b33a-d339cc85f362 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:27.020309 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 372/722] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:43:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 07 15:43:27.025775 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f261804-80d8-45df-8641-098a00d4c811 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:27.078239 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5365bce0-a108-467f-b33a-d339cc85f362 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:27.079806 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5365bce0-a108-467f-b33a-d339cc85f362 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:27.181712 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:27.192997 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 351/723] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:43:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 15:43:27.194430 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c3046-1dbc-45a3-8b02-cc68b2f6d7c0 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:27.194820 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c3046-1dbc-45a3-8b02-cc68b2f6d7c0 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:27.195275 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c3046-1dbc-45a3-8b02-cc68b2f6d7c0 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:27.196837 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 352/724] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:43:27.199067 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c3046-1dbc-45a3-8b02-cc68b2f6d7c0 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:27.209791 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f261804-80d8-45df-8641-098a00d4c811 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:27.250897 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:27.261490 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c0076-8b26-4d0a-995a-ecea2e893519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:27.262446 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c0076-8b26-4d0a-995a-ecea2e893519 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:27.263222 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c0076-8b26-4d0a-995a-ecea2e893519 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:27.263511 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c0076-8b26-4d0a-995a-ecea2e893519 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:27.279776 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c0076-8b26-4d0a-995a-ecea2e893519 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:27.281241 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c0076-8b26-4d0a-995a-ecea2e893519 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:27.302112 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-bc7c0076-8b26-4d0a-995a-ecea2e893519 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:27.302112 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:27.302112 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:27.302112 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:27.302112 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:27.302112 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:27.302112 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:27.302112 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:27.302112 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:27.302112 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:27.302112 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:27.302112 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:27.302112 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:27.302112 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:27.302112 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:27.302112 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:27.303326 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:27.303326 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:27.303326 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:27.303326 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:27.303326 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:27.303326 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:27.303326 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:27.303326 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:27.303326 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:27.303326 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:27.303326 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:27.303326 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:27.303326 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:27.303326 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:27.303326 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:27.303326 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:27.303326 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:27.304817 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:27.304817 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:27.304817 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:27.304817 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 373/725] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:27.305109 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6f706-e1b5-4f59-b816-7f9ac35c5ea6 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:27.305191 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6f706-e1b5-4f59-b816-7f9ac35c5ea6 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:27.307542 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6f706-e1b5-4f59-b816-7f9ac35c5ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:27.315327 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c3046-1dbc-45a3-8b02-cc68b2f6d7c0 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:27.326497 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-2ae6f706-e1b5-4f59-b816-7f9ac35c5ea6 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:27.327840 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-2ae6f706-e1b5-4f59-b816-7f9ac35c5ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:27.350985 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c6f8e9-de1b-447b-90c9-ed56506bd08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:27.351766 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6f8e9-de1b-447b-90c9-ed56506bd08b None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:27.352149 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6f8e9-de1b-447b-90c9-ed56506bd08b None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:27.352520 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6f8e9-de1b-447b-90c9-ed56506bd08b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:27.364544 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c6f8e9-de1b-447b-90c9-ed56506bd08b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:27.366160 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c6f8e9-de1b-447b-90c9-ed56506bd08b None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:27.382363 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-58c6f8e9-de1b-447b-90c9-ed56506bd08b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:27.382363 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:27.382363 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:27.382363 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:27.382363 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:27.382363 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:27.382363 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:27.382363 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:27.382363 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:27.382363 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:27.382363 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:27.382363 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:27.382363 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:27.382363 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:27.382363 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:27.382363 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:27.383355 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:27.383355 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:27.383355 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:27.383355 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:27.383355 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:27.383355 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:27.383355 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:27.383355 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:27.383355 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:27.383355 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:27.383355 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:27.383355 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:27.383355 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:27.383355 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:27.383355 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:27.383355 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:27.383355 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:27.385470 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:27.385470 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:27.385470 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:27.385470 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 353/726] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:27.385470 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c6f8e9-de1b-447b-90c9-ed56506bd08b None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:27.410357 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 374/727] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:43:27.416539 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6f706-e1b5-4f59-b816-7f9ac35c5ea6 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:27.441216 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:27.502515 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c6f8e9-de1b-447b-90c9-ed56506bd08b None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:27.548188 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1343eff2-f493-47e7-87e2-06ebe6f4aeab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:27.549345 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1343eff2-f493-47e7-87e2-06ebe6f4aeab None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:27.550994 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1343eff2-f493-47e7-87e2-06ebe6f4aeab None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:27.551539 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1343eff2-f493-47e7-87e2-06ebe6f4aeab None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:27.553078 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1343eff2-f493-47e7-87e2-06ebe6f4aeab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:27.554557 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1343eff2-f493-47e7-87e2-06ebe6f4aeab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:27.559525 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1343eff2-f493-47e7-87e2-06ebe6f4aeab None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:27.584084 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 354/728] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:27.587767 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1343eff2-f493-47e7-87e2-06ebe6f4aeab None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:27.618730 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6f706-e1b5-4f59-b816-7f9ac35c5ea6 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:27.645053 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:27.703941 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd330d79-c52b-4a32-bc31-3956d0739e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:27.704561 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd330d79-c52b-4a32-bc31-3956d0739e7f None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:27.704840 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd330d79-c52b-4a32-bc31-3956d0739e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:27.705116 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd330d79-c52b-4a32-bc31-3956d0739e7f None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:27.705766 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd330d79-c52b-4a32-bc31-3956d0739e7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:27.706071 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd330d79-c52b-4a32-bc31-3956d0739e7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:27.708245 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd330d79-c52b-4a32-bc31-3956d0739e7f None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:27.725520 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 375/729] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:27.727174 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1478b549-3957-4b81-810c-1b37feddd0d1 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:27.727687 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1478b549-3957-4b81-810c-1b37feddd0d1 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:27.728175 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1478b549-3957-4b81-810c-1b37feddd0d1 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:27.729596 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 376/730] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:43:27.731175 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1478b549-3957-4b81-810c-1b37feddd0d1 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:27.738935 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1343eff2-f493-47e7-87e2-06ebe6f4aeab None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:27.742053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:27.786918 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349aef1e-3d04-4ba1-b26a-dbbd5abafa19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:27.787470 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349aef1e-3d04-4ba1-b26a-dbbd5abafa19 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:27.787750 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349aef1e-3d04-4ba1-b26a-dbbd5abafa19 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:27.788030 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349aef1e-3d04-4ba1-b26a-dbbd5abafa19 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:27.795102 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349aef1e-3d04-4ba1-b26a-dbbd5abafa19 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:27.796539 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349aef1e-3d04-4ba1-b26a-dbbd5abafa19 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:27.808462 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-349aef1e-3d04-4ba1-b26a-dbbd5abafa19 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:27.808462 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:27.808462 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:27.808462 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:27.808462 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:27.808462 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:27.808462 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:27.808462 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:27.808462 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:27.808462 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:27.808462 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:27.808462 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:27.808462 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:43:27.808462 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:43:27.808462 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:43:27.809989 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:43:27.809989 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:27.809989 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:27.809989 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:27.809989 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:27.809989 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:27.809989 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:27.809989 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:27.809989 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:27.809989 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:27.809989 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:27.809989 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:27.809989 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:27.809989 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:27.809989 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:27.809989 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:27.809989 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:27.811033 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:43:27.811033 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:43:27.811033 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:43:27.811033 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:43:27.811033 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:43:27.811033 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:43:27.811033 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:27.811033 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:27.811033 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 355/731] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:43:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:43:27.812180 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459c41d-a510-420c-822c-78d37af0b416 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:27.812180 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459c41d-a510-420c-822c-78d37af0b416 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:27.812180 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459c41d-a510-420c-822c-78d37af0b416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:27.829910 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-3459c41d-a510-420c-822c-78d37af0b416 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:27.831140 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-3459c41d-a510-420c-822c-78d37af0b416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:27.853138 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1478b549-3957-4b81-810c-1b37feddd0d1 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:27.891550 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510a3d2-eb4b-490c-9868-f4f62ca1ca61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:27.892246 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510a3d2-eb4b-490c-9868-f4f62ca1ca61 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:27.892533 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510a3d2-eb4b-490c-9868-f4f62ca1ca61 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:27.892838 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510a3d2-eb4b-490c-9868-f4f62ca1ca61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:27.899859 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510a3d2-eb4b-490c-9868-f4f62ca1ca61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:27.901304 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510a3d2-eb4b-490c-9868-f4f62ca1ca61 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:27.910504 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 356/732] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:43:27.910504 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3459c41d-a510-420c-822c-78d37af0b416 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:27.925060 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-b510a3d2-eb4b-490c-9868-f4f62ca1ca61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:27.925060 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:27.925060 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:27.925060 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:27.925060 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:27.925060 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:27.925060 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:27.925060 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:27.925060 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:27.925060 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:27.925060 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:27.925060 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:27.925060 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:43:27.925060 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:43:27.925060 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:43:27.926169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:43:27.926169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:27.926169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:27.926169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:27.926169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:27.926169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:27.926169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:27.926169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:27.926169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:27.926169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:27.926169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:27.926169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:27.926169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:27.926169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:27.926169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:27.926169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:27.926169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:27.927136 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:43:27.927136 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:43:27.927136 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:43:27.927136 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:43:27.927136 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:43:27.927136 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:43:27.927136 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:27.927136 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:27.928026 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 377/733] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:43:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:27.929003 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510a3d2-eb4b-490c-9868-f4f62ca1ca61 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:27.970989 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:28.022641 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3459c41d-a510-420c-822c-78d37af0b416 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:28.035786 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:28.061189 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510a3d2-eb4b-490c-9868-f4f62ca1ca61 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:28.064416 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c5b3a-5875-48db-8589-77898f305458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:28.065053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c5b3a-5875-48db-8589-77898f305458 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:28.065331 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c5b3a-5875-48db-8589-77898f305458 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:28.065604 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c5b3a-5875-48db-8589-77898f305458 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:28.077422 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7c5b3a-5875-48db-8589-77898f305458 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:43:28.082895 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-de7c5b3a-5875-48db-8589-77898f305458 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:43:28.082895 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:28.082895 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:28.082895 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:28.082895 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:28.082895 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:28.082895 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:28.082895 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:28.082895 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:28.082895 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:28.082895 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:28.082895 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:28.082895 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:43:28.082895 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:43:28.082895 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:43:28.082895 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:43:28.084102 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:43:28.084102 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:43:28.084102 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:43:28.084102 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:43:28.084102 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:28.084102 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:28.084102 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:28.084102 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:28.084102 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:28.084102 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:28.084102 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:28.084102 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:28.084102 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:28.084102 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:28.084102 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:28.084102 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:28.084976 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:28.084976 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:28.084976 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:28.084976 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:28.084976 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:43:28.084976 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:43:28.084976 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:43:28.084976 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:43:28.084976 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:43:28.084976 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:43:28.084976 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:43:28.084976 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:28.089150 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 357/734] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 7 15:43:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:28.089875 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c5b3a-5875-48db-8589-77898f305458 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:28.102004 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85264bdb-fecd-467e-bda4-9c4649f0edf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:28.102722 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85264bdb-fecd-467e-bda4-9c4649f0edf3 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:28.103469 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85264bdb-fecd-467e-bda4-9c4649f0edf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:28.103826 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85264bdb-fecd-467e-bda4-9c4649f0edf3 None admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:28.104850 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85264bdb-fecd-467e-bda4-9c4649f0edf3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:28.105237 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85264bdb-fecd-467e-bda4-9c4649f0edf3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:28.108443 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85264bdb-fecd-467e-bda4-9c4649f0edf3 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:28.125158 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 378/735] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 7 15:43:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:28.126364 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85264bdb-fecd-467e-bda4-9c4649f0edf3 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:28.205131 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c5b3a-5875-48db-8589-77898f305458 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:28.240789 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:28.250621 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9e5a6-1d1f-489a-bb1b-0cf9967f40dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:28.251597 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9e5a6-1d1f-489a-bb1b-0cf9967f40dc None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:28.251944 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85264bdb-fecd-467e-bda4-9c4649f0edf3 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:28.252050 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9e5a6-1d1f-489a-bb1b-0cf9967f40dc None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:28.252494 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9e5a6-1d1f-489a-bb1b-0cf9967f40dc None admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:28.254027 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a9e5a6-1d1f-489a-bb1b-0cf9967f40dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:28.255793 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a9e5a6-1d1f-489a-bb1b-0cf9967f40dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:28.258359 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a9e5a6-1d1f-489a-bb1b-0cf9967f40dc None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:28.276495 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 358/736] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 7 15:43:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:28.277892 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9e5a6-1d1f-489a-bb1b-0cf9967f40dc None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:28.289190 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55cf856-f35d-43be-b311-a13566142e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:28.289640 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cf856-f35d-43be-b311-a13566142e44 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:28.289910 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cf856-f35d-43be-b311-a13566142e44 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:28.290197 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cf856-f35d-43be-b311-a13566142e44 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:28.290931 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55cf856-f35d-43be-b311-a13566142e44 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:28.291159 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55cf856-f35d-43be-b311-a13566142e44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:28.292506 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55cf856-f35d-43be-b311-a13566142e44 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:28.296100 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:28.302805 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 379/737] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:43:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:28.303769 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55cf856-f35d-43be-b311-a13566142e44 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:28.388706 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9e5a6-1d1f-489a-bb1b-0cf9967f40dc None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:28.408619 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55cf856-f35d-43be-b311-a13566142e44 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:28.421762 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541ce95-7e4e-4c84-8af7-f05c0c47887e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:28.422392 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541ce95-7e4e-4c84-8af7-f05c0c47887e None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:28.422676 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541ce95-7e4e-4c84-8af7-f05c0c47887e None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:28.422954 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541ce95-7e4e-4c84-8af7-f05c0c47887e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:28.423670 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9541ce95-7e4e-4c84-8af7-f05c0c47887e None admin] RBAC: Adding query filter params (role.id=61605ebf17e643258730e55bf6db15ad, scope.project.id=488830167943488f85743236584113d7, user.id=f9b13331a5fd48f5a2521ed1600f9f35) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:28.423981 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9541ce95-7e4e-4c84-8af7-f05c0c47887e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:28.425409 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9541ce95-7e4e-4c84-8af7-f05c0c47887e None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:28.430724 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 359/738] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 7 15:43:28 2022] GET /identity/v3/role_assignments?user.id=f9b13331a5fd48f5a2521ed1600f9f35&scope.project.id=488830167943488f85743236584113d7&role.id=61605ebf17e643258730e55bf6db15ad => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:28.431498 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541ce95-7e4e-4c84-8af7-f05c0c47887e None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:28.443722 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301bbc20-4b95-4a65-981b-2e8e8b293eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:28.444749 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bbc20-4b95-4a65-981b-2e8e8b293eee None admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:28.445032 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bbc20-4b95-4a65-981b-2e8e8b293eee None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:28.445307 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bbc20-4b95-4a65-981b-2e8e8b293eee None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:28.446410 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301bbc20-4b95-4a65-981b-2e8e8b293eee None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:28.447969 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301bbc20-4b95-4a65-981b-2e8e8b293eee None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:28.478646 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 380/739] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Sep 7 15:43:28 2022] POST /identity/v3/services => generated 251 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:43:28.479662 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301bbc20-4b95-4a65-981b-2e8e8b293eee None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:28.506954 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:28.554895 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:28.593216 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541ce95-7e4e-4c84-8af7-f05c0c47887e None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:28.651146 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5e400-a4c9-4fc2-a183-3f642b514dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:28.651627 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301bbc20-4b95-4a65-981b-2e8e8b293eee None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:28.652097 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5e400-a4c9-4fc2-a183-3f642b514dec None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:28.652097 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5e400-a4c9-4fc2-a183-3f642b514dec None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:28.652387 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5e400-a4c9-4fc2-a183-3f642b514dec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:28.653665 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada5e400-a4c9-4fc2-a183-3f642b514dec None admin] RBAC: Adding query filter params (role.id=a420b17212b94988beb75affe974355b, scope.project.id=488830167943488f85743236584113d7, user.id=3e20e40a37df4898bfe692535e5e4f25) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:28.653971 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada5e400-a4c9-4fc2-a183-3f642b514dec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:28.655954 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada5e400-a4c9-4fc2-a183-3f642b514dec None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:28.664123 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 360/740] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 7 15:43:28 2022] GET /identity/v3/role_assignments?user.id=3e20e40a37df4898bfe692535e5e4f25&scope.project.id=488830167943488f85743236584113d7&role.id=a420b17212b94988beb75affe974355b => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:28.665386 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebac33-a765-4ea0-a9f7-5e859e17ceff None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:28.665669 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebac33-a765-4ea0-a9f7-5e859e17ceff None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:28.665940 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebac33-a765-4ea0-a9f7-5e859e17ceff None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:28.667407 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 361/741] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:43:28.673087 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87f81d-735f-4bff-a0a3-76d382082a41 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:28.673674 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87f81d-735f-4bff-a0a3-76d382082a41 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:28.673955 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87f81d-735f-4bff-a0a3-76d382082a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:28.696395 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-4d87f81d-735f-4bff-a0a3-76d382082a41 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:28.697645 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-4d87f81d-735f-4bff-a0a3-76d382082a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:28.734974 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9d2ec-a510-4810-bbcb-7f08e21c070c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:28.735645 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9d2ec-a510-4810-bbcb-7f08e21c070c None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:28.736267 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9d2ec-a510-4810-bbcb-7f08e21c070c None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:28.736550 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9d2ec-a510-4810-bbcb-7f08e21c070c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:28.752934 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e9d2ec-a510-4810-bbcb-7f08e21c070c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:28.754490 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e9d2ec-a510-4810-bbcb-7f08e21c070c None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:28.778443 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-c6e9d2ec-a510-4810-bbcb-7f08e21c070c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:28.778443 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:28.778443 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:28.778443 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:28.778443 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:28.778443 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:28.778443 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:28.778443 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:28.778443 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:28.778443 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:28.778443 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:28.778443 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:28.778443 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:28.778443 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:28.778443 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:28.778443 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:28.779452 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:28.779452 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:28.779452 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:28.779452 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:28.779452 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:28.779452 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:28.779452 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:28.779452 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:28.779452 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:28.779452 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:28.779452 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:28.779452 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:28.779452 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:28.779452 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:28.779452 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:28.779452 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:28.779452 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:28.780343 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:28.780343 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:28.780343 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:28.780513 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 381/742] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:28.787059 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9d2ec-a510-4810-bbcb-7f08e21c070c None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:28.799389 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 362/743] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:28 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 15:43:28.871116 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:28.934863 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9d2ec-a510-4810-bbcb-7f08e21c070c None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:28.983137 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d7797-2ea4-4a34-a86d-fcb82e806a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:28.984003 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d7797-2ea4-4a34-a86d-fcb82e806a25 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:28.984492 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d7797-2ea4-4a34-a86d-fcb82e806a25 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:28.984942 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d7797-2ea4-4a34-a86d-fcb82e806a25 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:28.985729 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9d7797-2ea4-4a34-a86d-fcb82e806a25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:28.986199 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9d7797-2ea4-4a34-a86d-fcb82e806a25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:28.987720 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9d7797-2ea4-4a34-a86d-fcb82e806a25 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:29.006651 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 382/744] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:29.013129 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87f81d-735f-4bff-a0a3-76d382082a41 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:29.115574 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:29.156154 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87f81d-735f-4bff-a0a3-76d382082a41 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:29.192617 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc893d-6029-4ce4-a572-192ce01753f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:29.193259 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc893d-6029-4ce4-a572-192ce01753f3 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:29.193540 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc893d-6029-4ce4-a572-192ce01753f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:29.193813 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc893d-6029-4ce4-a572-192ce01753f3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:29.202020 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bc893d-6029-4ce4-a572-192ce01753f3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:29.203522 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bc893d-6029-4ce4-a572-192ce01753f3 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:29.216478 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-c5bc893d-6029-4ce4-a572-192ce01753f3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 07 15:43:29.216478 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:29.216478 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:29.216478 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:29.216478 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:29.216478 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:29.216478 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:29.216478 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:29.216478 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:29.216478 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:29.216478 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:29.216478 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:29.216478 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:43:29.216478 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:43:29.216478 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:43:29.216478 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:43:29.217458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:29.217458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:29.217458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:43:29.217458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:29.217458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:43:29.217458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:29.217458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:29.217458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:29.217458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:29.217458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:29.217458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:29.217458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:29.217458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:29.217458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:29.217458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:29.217458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:29.217458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:29.217458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:29.218462 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:29.218462 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:29.218462 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:43:29.218462 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:43:29.218462 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:43:29.218462 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:43:29.218462 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:43:29.218462 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:43:29.218462 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 07 15:43:29.218462 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:29.218462 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 363/745] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 7 15:43:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:29.223707 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d7797-2ea4-4a34-a86d-fcb82e806a25 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:29.241060 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc893d-6029-4ce4-a572-192ce01753f3 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:29.348249 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc893d-6029-4ce4-a572-192ce01753f3 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:29.380544 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:29.391495 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e68ac7-c20a-4834-b210-c18ca0938f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:29.392112 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e68ac7-c20a-4834-b210-c18ca0938f77 None admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:29.392395 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e68ac7-c20a-4834-b210-c18ca0938f77 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:29.392671 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e68ac7-c20a-4834-b210-c18ca0938f77 None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:29.393339 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e68ac7-c20a-4834-b210-c18ca0938f77 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:29.394749 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e68ac7-c20a-4834-b210-c18ca0938f77 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:29.424437 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 364/746] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Sep 7 15:43:29 2022] POST /identity/v3/services => generated 240 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 15:43:29.425657 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d7797-2ea4-4a34-a86d-fcb82e806a25 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:29.475347 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:29.508656 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c1453a-652a-402c-a63e-0f2fac3ece55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:29.509291 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1453a-652a-402c-a63e-0f2fac3ece55 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:29.509577 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1453a-652a-402c-a63e-0f2fac3ece55 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:29.509857 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1453a-652a-402c-a63e-0f2fac3ece55 None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:29.510630 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c1453a-652a-402c-a63e-0f2fac3ece55 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:29.510941 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c1453a-652a-402c-a63e-0f2fac3ece55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:29.512675 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c1453a-652a-402c-a63e-0f2fac3ece55 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:29.545297 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 383/747] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Sep 7 15:43:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:29.551273 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e68ac7-c20a-4834-b210-c18ca0938f77 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:29.678620 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e68ac7-c20a-4834-b210-c18ca0938f77 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:29.734625 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e44453-8dda-43cf-833d-b72187e2a543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:29.735255 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e44453-8dda-43cf-833d-b72187e2a543 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:29.735539 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e44453-8dda-43cf-833d-b72187e2a543 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:29.735819 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e44453-8dda-43cf-833d-b72187e2a543 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:29.811484 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:29.829437 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e44453-8dda-43cf-833d-b72187e2a543 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:29.830962 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e44453-8dda-43cf-833d-b72187e2a543 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:29.942333 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 365/748] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:43:29 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 15:43:29.948062 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c1453a-652a-402c-a63e-0f2fac3ece55 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:30.083900 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c1453a-652a-402c-a63e-0f2fac3ece55 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:30.139200 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e23aa6c-1076-4801-a4ce-49643ecdc473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:30.139839 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23aa6c-1076-4801-a4ce-49643ecdc473 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:30.140118 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23aa6c-1076-4801-a4ce-49643ecdc473 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:30.140391 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23aa6c-1076-4801-a4ce-49643ecdc473 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:30.162269 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e23aa6c-1076-4801-a4ce-49643ecdc473 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:30.163750 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e23aa6c-1076-4801-a4ce-49643ecdc473 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:30.182130 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-6e23aa6c-1076-4801-a4ce-49643ecdc473 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:30.182130 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:30.182130 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:30.182130 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:30.182130 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:30.182130 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:30.182130 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:30.182130 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:30.182130 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:30.182130 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:30.182130 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:30.182130 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:30.182130 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:30.182130 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:30.182130 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:30.182130 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:30.184139 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:30.184139 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:30.184139 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:30.184139 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:30.184139 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:30.184139 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:30.184139 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:30.184139 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:30.184139 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:30.184139 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:30.184139 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:30.184139 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:30.184139 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:30.184139 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:30.184139 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:30.184139 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:30.184139 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:30.185623 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:30.185623 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:30.185623 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:30.185623 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 384/749] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:43:30.194188 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e44453-8dda-43cf-833d-b72187e2a543 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:30.316712 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:30.335972 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e44453-8dda-43cf-833d-b72187e2a543 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:30.385770 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf7b96-61fb-41c7-8a2c-2b731288ec91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:30.386762 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf7b96-61fb-41c7-8a2c-2b731288ec91 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:30.387789 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf7b96-61fb-41c7-8a2c-2b731288ec91 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:30.388291 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf7b96-61fb-41c7-8a2c-2b731288ec91 None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:30.389137 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf7b96-61fb-41c7-8a2c-2b731288ec91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:30.389653 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf7b96-61fb-41c7-8a2c-2b731288ec91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:30.391339 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf7b96-61fb-41c7-8a2c-2b731288ec91 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:30.408400 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 366/750] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:43:30.411266 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e23aa6c-1076-4801-a4ce-49643ecdc473 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:30.468745 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:30.571046 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e23aa6c-1076-4801-a4ce-49643ecdc473 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:30.621797 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09cb53c-20f8-4766-830e-2bc46fdbbc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:30.622439 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09cb53c-20f8-4766-830e-2bc46fdbbc6d None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:30.622719 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09cb53c-20f8-4766-830e-2bc46fdbbc6d None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:30.622992 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09cb53c-20f8-4766-830e-2bc46fdbbc6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:30.629992 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09cb53c-20f8-4766-830e-2bc46fdbbc6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:30.631464 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09cb53c-20f8-4766-830e-2bc46fdbbc6d None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:30.646033 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-f09cb53c-20f8-4766-830e-2bc46fdbbc6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:30.646033 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:30.646033 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:30.646033 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:30.646033 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:30.646033 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:30.646033 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:30.646033 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:30.646033 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:30.646033 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:30.646033 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:30.646033 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:30.646033 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:43:30.646033 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:43:30.646033 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:43:30.646964 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:43:30.646964 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:30.646964 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:30.646964 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:30.646964 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:30.646964 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:30.646964 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:30.646964 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:30.646964 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:30.646964 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:30.646964 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:30.646964 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:30.646964 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:30.646964 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:30.646964 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:30.646964 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:30.646964 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:30.647866 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:43:30.647866 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:43:30.647866 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:43:30.647866 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:43:30.647866 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:43:30.647866 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:43:30.647866 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:30.647866 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:30.647866 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 385/751] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:43:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:30.655772 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf7b96-61fb-41c7-8a2c-2b731288ec91 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:30.917636 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf7b96-61fb-41c7-8a2c-2b731288ec91 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:30.920386 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81197b0-6c79-42bc-8415-adc1e6ac873d None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:30.920667 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81197b0-6c79-42bc-8415-adc1e6ac873d None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:30.920944 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81197b0-6c79-42bc-8415-adc1e6ac873d None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:30.922496 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 386/752] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:43:30.927431 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235510d-db22-4c29-ae2b-39981330c6e4 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:30.927717 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235510d-db22-4c29-ae2b-39981330c6e4 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:30.927995 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235510d-db22-4c29-ae2b-39981330c6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:30.947452 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-4235510d-db22-4c29-ae2b-39981330c6e4 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:30.948757 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-4235510d-db22-4c29-ae2b-39981330c6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:30.983813 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2139e8d-a4ab-41f8-a0bb-2d8792c24feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:30.984763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2139e8d-a4ab-41f8-a0bb-2d8792c24feb None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:30.985051 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2139e8d-a4ab-41f8-a0bb-2d8792c24feb None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:30.985463 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2139e8d-a4ab-41f8-a0bb-2d8792c24feb None admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:30.986317 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2139e8d-a4ab-41f8-a0bb-2d8792c24feb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:30.986627 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2139e8d-a4ab-41f8-a0bb-2d8792c24feb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:30.988795 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2139e8d-a4ab-41f8-a0bb-2d8792c24feb None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:31.015016 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 367/753] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 7 15:43:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:31.021192 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2139e8d-a4ab-41f8-a0bb-2d8792c24feb None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:31.050346 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:31.071093 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 387/754] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 15:43:31.205388 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2139e8d-a4ab-41f8-a0bb-2d8792c24feb None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:31.238267 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca96e9d-2fac-4cac-9f4f-c6b5d1690daf None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:31.238602 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca96e9d-2fac-4cac-9f4f-c6b5d1690daf None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:31.238840 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca96e9d-2fac-4cac-9f4f-c6b5d1690daf None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:31.240625 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 388/755] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:43:31.247698 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494567d-9b8f-4771-8548-a4c5ad374048 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:31.247991 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494567d-9b8f-4771-8548-a4c5ad374048 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:31.248274 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494567d-9b8f-4771-8548-a4c5ad374048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:31.268960 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b2dc1-6a5a-4000-bb8e-20e384472fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:31.269911 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b2dc1-6a5a-4000-bb8e-20e384472fc8 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:31.270467 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b2dc1-6a5a-4000-bb8e-20e384472fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:31.270937 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b2dc1-6a5a-4000-bb8e-20e384472fc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:31.271851 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b2dc1-6a5a-4000-bb8e-20e384472fc8 None admin] RBAC: Adding query filter params (role.id=61605ebf17e643258730e55bf6db15ad, scope.project.id=488830167943488f85743236584113d7, user.id=16c4b090a4aa4d56a90ccf090b9caba8) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:31.272370 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b2dc1-6a5a-4000-bb8e-20e384472fc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:31.274005 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b2dc1-6a5a-4000-bb8e-20e384472fc8 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:31.283524 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-5494567d-9b8f-4771-8548-a4c5ad374048 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:31.285103 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-5494567d-9b8f-4771-8548-a4c5ad374048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:31.286820 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 368/756] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 7 15:43:31 2022] GET /identity/v3/role_assignments?user.id=16c4b090a4aa4d56a90ccf090b9caba8&scope.project.id=488830167943488f85743236584113d7&role.id=61605ebf17e643258730e55bf6db15ad => generated 259 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:43:31.314574 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:31.387903 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 389/757] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 15:43:31.416319 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b2dc1-6a5a-4000-bb8e-20e384472fc8 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:31.495046 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5cb43-30a0-4be8-89de-e4800b0abe17 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:31.495346 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5cb43-30a0-4be8-89de-e4800b0abe17 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:31.495516 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5cb43-30a0-4be8-89de-e4800b0abe17 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:31.498588 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 390/758] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:43:31.502546 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36152d-7726-4c79-8032-1409f403006c None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:31.502826 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36152d-7726-4c79-8032-1409f403006c None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:31.503100 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36152d-7726-4c79-8032-1409f403006c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:31.513917 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:31.525852 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-cc36152d-7726-4c79-8032-1409f403006c None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:31.527093 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-cc36152d-7726-4c79-8032-1409f403006c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:31.572911 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b2dc1-6a5a-4000-bb8e-20e384472fc8 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:31.633720 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 391/759] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:43:31.655843 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1afedcf-367d-4238-a48e-e03c381a38f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:31.656494 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1afedcf-367d-4238-a48e-e03c381a38f4 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:31.656773 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1afedcf-367d-4238-a48e-e03c381a38f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:31.657041 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1afedcf-367d-4238-a48e-e03c381a38f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:31.679065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1afedcf-367d-4238-a48e-e03c381a38f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:43:31.684472 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-b1afedcf-367d-4238-a48e-e03c381a38f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:43:31.684472 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:31.684472 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:31.684472 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:31.684472 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:31.684472 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:31.684472 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:31.684472 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:31.684472 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:31.684472 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:31.684472 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:31.684472 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:31.684472 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:43:31.684472 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:43:31.684472 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:43:31.684472 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:43:31.685773 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:43:31.685773 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:43:31.685773 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:43:31.685773 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:43:31.685773 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:31.685773 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:31.685773 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:31.685773 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:31.685773 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:31.685773 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:31.685773 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:31.685773 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:31.685773 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:31.685773 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:31.685773 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:31.685773 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:31.686694 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:31.686694 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:31.686694 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:31.686694 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:31.686694 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:43:31.686694 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:43:31.686694 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:43:31.686694 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:43:31.686694 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:43:31.686694 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:43:31.686694 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:43:31.686694 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:31.686694 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 369/760] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 7 15:43:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:31.691672 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36152d-7726-4c79-8032-1409f403006c None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:31.748376 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1afedcf-367d-4238-a48e-e03c381a38f4 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:31.843250 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:31.884675 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36152d-7726-4c79-8032-1409f403006c None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:31.915031 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1afedcf-367d-4238-a48e-e03c381a38f4 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:31.921657 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5940e-514e-42c3-9f8b-7ccfeb074691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:31.922634 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5940e-514e-42c3-9f8b-7ccfeb074691 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:31.923118 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5940e-514e-42c3-9f8b-7ccfeb074691 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:31.923623 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5940e-514e-42c3-9f8b-7ccfeb074691 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:31.924501 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba5940e-514e-42c3-9f8b-7ccfeb074691 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:31.924999 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba5940e-514e-42c3-9f8b-7ccfeb074691 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:31.926579 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba5940e-514e-42c3-9f8b-7ccfeb074691 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:31.940074 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 392/761] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:43:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:31.941549 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5940e-514e-42c3-9f8b-7ccfeb074691 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:31.983581 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:31.991861 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3988a0a-ceeb-426c-959d-36491a924903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:31.992621 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3988a0a-ceeb-426c-959d-36491a924903 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:31.992907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3988a0a-ceeb-426c-959d-36491a924903 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:31.993179 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3988a0a-ceeb-426c-959d-36491a924903 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:31.993765 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3988a0a-ceeb-426c-959d-36491a924903 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:31.995170 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3988a0a-ceeb-426c-959d-36491a924903 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:32.005221 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-a3988a0a-ceeb-426c-959d-36491a924903 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 15:43:32.005221 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:32.005221 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 15:43:32.005221 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 15:43:32.005221 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 15:43:32.005221 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 15:43:32.005221 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 15:43:32.005221 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:43:32.005221 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 15:43:32.005221 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:32.005221 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:43:32.005221 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:32.005221 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:32.005221 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:32.005221 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:32.005221 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:32.005221 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:32.006258 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:32.006258 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:32.006258 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:32.006258 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:32.006258 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:32.006258 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:32.006258 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 15:43:32.006258 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 15:43:32.006258 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 15:43:32.006258 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 15:43:32.006258 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:32.006258 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:32.006258 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:32.006258 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:32.006258 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:32.006258 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:32.007094 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:32.007094 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:32.007094 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:32.007094 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:32.007094 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:32.007094 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:32.007094 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:32.007094 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:32.007094 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:32.007094 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:32.007094 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 15:43:32.007094 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:43:32.007094 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 15:43:32.007094 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:32.011160 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 370/762] 10.222.0.16 () {56 vars in 1129 bytes} [Wed Sep 7 15:43:31 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:43:32.012616 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3988a0a-ceeb-426c-959d-36491a924903 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:32.054543 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5940e-514e-42c3-9f8b-7ccfeb074691 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:32.090688 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41680ee9-5b2f-4097-9ec6-dc3e85623d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:32.091753 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41680ee9-5b2f-4097-9ec6-dc3e85623d06 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:32.092236 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41680ee9-5b2f-4097-9ec6-dc3e85623d06 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:32.092709 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41680ee9-5b2f-4097-9ec6-dc3e85623d06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:32.102574 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:32.106846 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41680ee9-5b2f-4097-9ec6-dc3e85623d06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:32.108852 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41680ee9-5b2f-4097-9ec6-dc3e85623d06 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:32.125154 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-41680ee9-5b2f-4097-9ec6-dc3e85623d06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:32.125154 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:32.125154 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:32.125154 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:32.125154 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:32.125154 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:32.125154 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:32.125154 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:32.125154 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:32.125154 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:32.125154 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:32.125154 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:32.125154 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:32.125154 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:32.125154 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:32.125154 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:32.126144 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:32.126144 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:32.126144 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:32.126144 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:32.126144 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:32.126144 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:32.126144 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:32.126144 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:32.126144 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:32.126144 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:32.126144 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:32.126144 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:32.126144 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:32.126144 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:32.126144 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:32.126144 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:32.126144 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:32.127366 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:32.127366 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:32.127366 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:32.133537 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 393/763] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:43:32.134373 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3988a0a-ceeb-426c-959d-36491a924903 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:32.134881 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41680ee9-5b2f-4097-9ec6-dc3e85623d06 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:32.172170 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc7df6-32eb-44fe-a001-5610760d13d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:32.172861 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc7df6-32eb-44fe-a001-5610760d13d1 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:32.173200 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc7df6-32eb-44fe-a001-5610760d13d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:32.173482 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc7df6-32eb-44fe-a001-5610760d13d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:32.185536 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cc7df6-32eb-44fe-a001-5610760d13d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:43:32.191031 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-f4cc7df6-32eb-44fe-a001-5610760d13d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:43:32.191031 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:32.191031 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:32.191031 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:32.191031 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:32.191031 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:32.191031 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:32.191031 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:32.191031 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:32.191031 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:32.191031 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:32.191031 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:32.191031 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:43:32.191031 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:43:32.191031 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:43:32.191031 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:43:32.191985 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:43:32.191985 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:43:32.191985 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:43:32.191985 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:43:32.191985 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:32.191985 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:32.191985 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:32.191985 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:32.191985 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:32.191985 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:32.191985 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:32.191985 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:32.191985 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:32.191985 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:32.191985 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:32.191985 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:32.193192 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:32.193192 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:32.193192 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:32.193192 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:32.193192 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:43:32.193192 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:43:32.193192 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:43:32.193192 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:43:32.193192 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:43:32.193192 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:43:32.193192 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:43:32.193192 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:32.193192 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 371/764] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 7 15:43:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:32.193192 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc7df6-32eb-44fe-a001-5610760d13d1 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:32.251339 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41680ee9-5b2f-4097-9ec6-dc3e85623d06 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:32.260702 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:32.288655 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a5856-3035-4bb1-a725-e2b20326f48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:32.289615 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a5856-3035-4bb1-a725-e2b20326f48b None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:32.290113 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a5856-3035-4bb1-a725-e2b20326f48b None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:32.290641 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a5856-3035-4bb1-a725-e2b20326f48b None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:32.291458 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a5856-3035-4bb1-a725-e2b20326f48b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:32.291956 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a5856-3035-4bb1-a725-e2b20326f48b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:32.293695 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a5856-3035-4bb1-a725-e2b20326f48b None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:32.299144 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 394/765] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Sep 7 15:43:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:32.300306 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a5856-3035-4bb1-a725-e2b20326f48b None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:32.317082 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc7df6-32eb-44fe-a001-5610760d13d1 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:32.356543 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd542ace-efb4-4b8d-85a1-ed464b9dd073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:32.357111 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd542ace-efb4-4b8d-85a1-ed464b9dd073 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:32.357393 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd542ace-efb4-4b8d-85a1-ed464b9dd073 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:32.357923 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd542ace-efb4-4b8d-85a1-ed464b9dd073 None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:32.358603 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd542ace-efb4-4b8d-85a1-ed464b9dd073 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:32.358917 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd542ace-efb4-4b8d-85a1-ed464b9dd073 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:32.360280 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd542ace-efb4-4b8d-85a1-ed464b9dd073 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:32.365472 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:32.379783 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 372/766] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:32.379783 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd542ace-efb4-4b8d-85a1-ed464b9dd073 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:32.420655 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a5856-3035-4bb1-a725-e2b20326f48b None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:32.456347 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89a921-a0e0-4fa4-9dbe-b3f4933cc4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:32.457290 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89a921-a0e0-4fa4-9dbe-b3f4933cc4b2 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:32.457807 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89a921-a0e0-4fa4-9dbe-b3f4933cc4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:32.458322 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89a921-a0e0-4fa4-9dbe-b3f4933cc4b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:32.459345 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b89a921-a0e0-4fa4-9dbe-b3f4933cc4b2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:32.459847 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b89a921-a0e0-4fa4-9dbe-b3f4933cc4b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:32.461451 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b89a921-a0e0-4fa4-9dbe-b3f4933cc4b2 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:32.471149 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 395/767] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 7 15:43:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:32.472343 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89a921-a0e0-4fa4-9dbe-b3f4933cc4b2 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:32.490238 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd542ace-efb4-4b8d-85a1-ed464b9dd073 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:32.508555 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:32.529757 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34bd92b-e5da-498e-98d4-89e652528f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:32.530345 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34bd92b-e5da-498e-98d4-89e652528f1d None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:32.530626 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34bd92b-e5da-498e-98d4-89e652528f1d None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:32.530902 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34bd92b-e5da-498e-98d4-89e652528f1d None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:32.531553 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34bd92b-e5da-498e-98d4-89e652528f1d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:32.531927 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34bd92b-e5da-498e-98d4-89e652528f1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:32.533410 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34bd92b-e5da-498e-98d4-89e652528f1d None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:32.545333 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 373/768] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Sep 7 15:43:32 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:32.546383 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34bd92b-e5da-498e-98d4-89e652528f1d None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:32.589766 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89a921-a0e0-4fa4-9dbe-b3f4933cc4b2 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:32.608887 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:32.628998 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a3b87d-f564-43da-9830-78e0c187e203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:32.630015 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3b87d-f564-43da-9830-78e0c187e203 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:32.630530 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3b87d-f564-43da-9830-78e0c187e203 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:32.630999 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3b87d-f564-43da-9830-78e0c187e203 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:32.639972 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a3b87d-f564-43da-9830-78e0c187e203 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:32.641706 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a3b87d-f564-43da-9830-78e0c187e203 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:32.654048 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-23a3b87d-f564-43da-9830-78e0c187e203 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 15:43:32.654048 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:32.654048 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:32.654048 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:32.654048 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:32.654048 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:32.654048 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:32.654048 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:32.654048 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:32.654048 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:32.654048 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:32.654048 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:32.654048 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:43:32.654048 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:43:32.654048 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:43:32.654048 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:43:32.655159 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:32.655159 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:32.655159 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:43:32.655159 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:32.655159 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:43:32.655159 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:32.655159 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:32.655159 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:32.655159 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:32.655159 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:32.655159 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:32.655159 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:32.655159 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:32.655159 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:32.655159 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:32.655159 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:32.655159 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:32.655159 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:32.656103 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:32.656103 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:32.656103 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:43:32.656103 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:43:32.656103 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:43:32.656103 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:43:32.656103 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:43:32.656103 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:43:32.656103 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 15:43:32.656103 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:32.662209 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34bd92b-e5da-498e-98d4-89e652528f1d None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:32.662526 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 396/769] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Sep 7 15:43:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:32.663481 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a3b87d-f564-43da-9830-78e0c187e203 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:32.696531 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a369739-424f-4f8d-b70b-db1cced4bcf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:32.697164 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a369739-424f-4f8d-b70b-db1cced4bcf2 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:32.697563 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a369739-424f-4f8d-b70b-db1cced4bcf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:32.697841 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a369739-424f-4f8d-b70b-db1cced4bcf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:32.708472 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a369739-424f-4f8d-b70b-db1cced4bcf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:32.709927 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a369739-424f-4f8d-b70b-db1cced4bcf2 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:32.726330 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-7a369739-424f-4f8d-b70b-db1cced4bcf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:32.726330 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:32.726330 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:32.726330 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:32.726330 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:32.726330 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:32.726330 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:32.726330 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:32.726330 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:32.726330 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:32.726330 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:32.726330 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:32.726330 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:32.726330 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:32.726330 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:32.726330 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:32.727322 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:32.727322 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:32.727322 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:32.727322 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:32.727322 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:32.727322 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:32.727322 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:32.727322 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:32.727322 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:32.727322 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:32.727322 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:32.727322 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:32.727322 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:32.727322 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:32.727322 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:32.727322 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:32.727322 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:32.728243 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:32.728243 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:32.728243 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:32.728243 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 374/770] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:32.729022 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d36107-e184-421f-8dde-fa5a3e9dddfe None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:32.729300 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d36107-e184-421f-8dde-fa5a3e9dddfe None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:32.729567 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d36107-e184-421f-8dde-fa5a3e9dddfe None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:32.731557 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 375/771] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:43:32.732149 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d36107-e184-421f-8dde-fa5a3e9dddfe None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:32.766780 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:32.784058 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a3b87d-f564-43da-9830-78e0c187e203 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:32.819804 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd443c5a-036a-48fe-b474-884024999e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:32.820418 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd443c5a-036a-48fe-b474-884024999e21 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:32.820716 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd443c5a-036a-48fe-b474-884024999e21 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:32.820983 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd443c5a-036a-48fe-b474-884024999e21 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:32.821683 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd443c5a-036a-48fe-b474-884024999e21 None admin] RBAC: Adding query filter params (interface=public, service_id=83a179a3fc3940318bac6c34d0727b68, region_id=RegionOne) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:32.821994 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd443c5a-036a-48fe-b474-884024999e21 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:32.823448 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd443c5a-036a-48fe-b474-884024999e21 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:32.836045 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 397/772] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Sep 7 15:43:32 2022] GET /identity/v3/endpoints?service_id=83a179a3fc3940318bac6c34d0727b68&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:32.836045 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd443c5a-036a-48fe-b474-884024999e21 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:32.848450 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d36107-e184-421f-8dde-fa5a3e9dddfe None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:32.878783 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:32.885748 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4f1b2-a146-4144-accb-1062512b9fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:32.886408 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4f1b2-a146-4144-accb-1062512b9fc2 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:32.886659 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4f1b2-a146-4144-accb-1062512b9fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:32.886976 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4f1b2-a146-4144-accb-1062512b9fc2 None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:32.887694 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea4f1b2-a146-4144-accb-1062512b9fc2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:32.887991 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea4f1b2-a146-4144-accb-1062512b9fc2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:32.889391 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea4f1b2-a146-4144-accb-1062512b9fc2 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:32.907828 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 376/773] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Sep 7 15:43:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:32.909125 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654d784-82a7-4dd3-b967-2db69d9c2a98 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:32.909413 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654d784-82a7-4dd3-b967-2db69d9c2a98 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:32.909683 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654d784-82a7-4dd3-b967-2db69d9c2a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:32.927626 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-0654d784-82a7-4dd3-b967-2db69d9c2a98 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:32.928806 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-0654d784-82a7-4dd3-b967-2db69d9c2a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:32.945132 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd443c5a-036a-48fe-b474-884024999e21 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:32.980534 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f505e6c-18b0-4e6d-af17-771727e4b270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:32.981529 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f505e6c-18b0-4e6d-af17-771727e4b270 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:32.981823 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f505e6c-18b0-4e6d-af17-771727e4b270 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:32.982109 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f505e6c-18b0-4e6d-af17-771727e4b270 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:32.983053 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f505e6c-18b0-4e6d-af17-771727e4b270 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:32.983363 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f505e6c-18b0-4e6d-af17-771727e4b270 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:32.984782 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f505e6c-18b0-4e6d-af17-771727e4b270 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:32.997419 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 398/774] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:32.998270 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f505e6c-18b0-4e6d-af17-771727e4b270 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:33.018201 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 377/775] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:43:33.018201 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654d784-82a7-4dd3-b967-2db69d9c2a98 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:33.053719 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:33.128060 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f505e6c-18b0-4e6d-af17-771727e4b270 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:33.129770 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:33.134306 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654d784-82a7-4dd3-b967-2db69d9c2a98 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:33.167224 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b70e94a-3957-4a1d-828e-9517428d3e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:33.168211 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70e94a-3957-4a1d-828e-9517428d3e18 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:33.168698 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70e94a-3957-4a1d-828e-9517428d3e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:33.169165 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70e94a-3957-4a1d-828e-9517428d3e18 None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:33.170025 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b70e94a-3957-4a1d-828e-9517428d3e18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:33.171663 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b70e94a-3957-4a1d-828e-9517428d3e18 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:33.177483 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 399/776] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Sep 7 15:43:32 2022] GET /identity/v3/services => generated 772 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:33.178540 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b70e94a-3957-4a1d-828e-9517428d3e18 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:33.192247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc7ad6-a276-4f09-b0b7-115c9526982d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:33.193315 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc7ad6-a276-4f09-b0b7-115c9526982d None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:33.193834 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc7ad6-a276-4f09-b0b7-115c9526982d None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:33.194333 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc7ad6-a276-4f09-b0b7-115c9526982d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:33.214260 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc7ad6-a276-4f09-b0b7-115c9526982d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:33.219306 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc7ad6-a276-4f09-b0b7-115c9526982d None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:33.249763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-d6cc7ad6-a276-4f09-b0b7-115c9526982d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:33.249763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:33.249763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:33.249763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:33.249763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:33.249763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:33.249763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:33.249763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:33.249763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:33.249763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:33.249763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:33.249763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:33.249763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:33.249763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:33.249763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:33.249763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:33.250798 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:33.250798 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:33.250798 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:33.250798 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:33.250798 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:33.250798 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:33.250798 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:33.250798 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:33.250798 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:33.250798 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:33.250798 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:33.250798 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:33.250798 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:33.250798 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:33.250798 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:33.250798 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:33.250798 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:33.251691 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:33.251691 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:33.251691 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:33.257351 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 378/777] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:33.268895 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc7ad6-a276-4f09-b0b7-115c9526982d None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:33.361137 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b70e94a-3957-4a1d-828e-9517428d3e18 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:33.367557 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:33.404614 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ec9c2-bb4b-4ebf-a50d-3e375ede3d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:33.405054 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc7ad6-a276-4f09-b0b7-115c9526982d None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:33.405246 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ec9c2-bb4b-4ebf-a50d-3e375ede3d46 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:33.405527 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ec9c2-bb4b-4ebf-a50d-3e375ede3d46 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:33.405801 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ec9c2-bb4b-4ebf-a50d-3e375ede3d46 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:33.414219 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6ec9c2-bb4b-4ebf-a50d-3e375ede3d46 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:33.415642 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6ec9c2-bb4b-4ebf-a50d-3e375ede3d46 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:33.429483 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-1c6ec9c2-bb4b-4ebf-a50d-3e375ede3d46 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 15:43:33.429483 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:33.429483 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:33.429483 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:33.429483 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:33.429483 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:33.429483 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:33.429483 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:33.429483 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:33.429483 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:33.429483 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:33.429483 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:33.429483 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:43:33.429483 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:43:33.429483 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:43:33.429483 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:43:33.430669 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:33.430669 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:33.430669 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:43:33.430669 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:33.430669 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:43:33.430669 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:33.430669 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:33.430669 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:33.430669 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:33.430669 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:33.430669 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:33.430669 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:33.430669 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:33.430669 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:33.430669 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:33.430669 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:33.430669 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:33.430669 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:33.431908 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:33.431908 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:33.431908 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:43:33.431908 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:43:33.431908 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:43:33.431908 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:43:33.431908 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:43:33.431908 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:43:33.431908 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 15:43:33.431908 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:33.434260 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 400/778] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Sep 7 15:43:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:33.435088 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ec9c2-bb4b-4ebf-a50d-3e375ede3d46 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:33.454461 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70260181-a073-4d37-a84d-9ad09e20814f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:33.455766 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70260181-a073-4d37-a84d-9ad09e20814f None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:33.455766 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70260181-a073-4d37-a84d-9ad09e20814f None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:33.455766 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70260181-a073-4d37-a84d-9ad09e20814f None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:33.456544 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70260181-a073-4d37-a84d-9ad09e20814f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:33.456945 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70260181-a073-4d37-a84d-9ad09e20814f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:33.458469 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70260181-a073-4d37-a84d-9ad09e20814f None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:33.467900 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:33.472584 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 379/779] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:33.473747 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70260181-a073-4d37-a84d-9ad09e20814f None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:33.553994 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ec9c2-bb4b-4ebf-a50d-3e375ede3d46 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:33.588801 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70260181-a073-4d37-a84d-9ad09e20814f None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:33.591124 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27686e7-99e4-45b4-ab8a-d21870afbc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:33.591885 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27686e7-99e4-45b4-ab8a-d21870afbc1b None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:33.592263 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27686e7-99e4-45b4-ab8a-d21870afbc1b None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:33.592634 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27686e7-99e4-45b4-ab8a-d21870afbc1b None admin] PATH_INFO: `/v3/services/network` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:33.593322 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27686e7-99e4-45b4-ab8a-d21870afbc1b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:33.594830 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27686e7-99e4-45b4-ab8a-d21870afbc1b None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:33.604491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-b27686e7-99e4-45b4-ab8a-d21870afbc1b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 15:43:33.604491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:33.604491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 15:43:33.604491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 15:43:33.604491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 15:43:33.604491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 15:43:33.604491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 15:43:33.604491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:43:33.604491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 15:43:33.604491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:33.604491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:43:33.604491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:33.604491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:33.604491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:33.604491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:33.604491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:33.604491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:33.606527 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:33.606527 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:33.606527 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:33.606527 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:33.606527 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:33.606527 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:33.606527 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 15:43:33.606527 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 15:43:33.606527 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 15:43:33.606527 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 15:43:33.606527 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:33.606527 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:33.606527 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:33.606527 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:33.606527 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:33.606527 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:33.607886 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:33.607886 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:33.607886 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:33.607886 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:33.607886 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:33.607886 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:33.607886 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:33.607886 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:33.607886 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:33.607886 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:33.607886 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 15:43:33.607886 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:43:33.607886 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 15:43:33.607886 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:33.610226 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 401/780] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:43:33 2022] GET /identity/v3/services/network => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:33.610634 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27686e7-99e4-45b4-ab8a-d21870afbc1b None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:33.623187 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:33.629633 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6bdca-50b4-4b82-83b0-b06da17c5462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:33.630499 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6bdca-50b4-4b82-83b0-b06da17c5462 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:33.630932 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6bdca-50b4-4b82-83b0-b06da17c5462 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:33.631379 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6bdca-50b4-4b82-83b0-b06da17c5462 None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:33.632259 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb6bdca-50b4-4b82-83b0-b06da17c5462 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:33.632719 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb6bdca-50b4-4b82-83b0-b06da17c5462 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:33.634343 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb6bdca-50b4-4b82-83b0-b06da17c5462 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:33.655173 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 380/781] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Sep 7 15:43:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:33.656367 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6bdca-50b4-4b82-83b0-b06da17c5462 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:33.719861 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:33.731853 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27686e7-99e4-45b4-ab8a-d21870afbc1b None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:33.763460 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6bdca-50b4-4b82-83b0-b06da17c5462 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:33.768597 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dea743-a478-4df6-9051-ea663ee81168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:33.769309 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dea743-a478-4df6-9051-ea663ee81168 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:33.769591 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dea743-a478-4df6-9051-ea663ee81168 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:33.769862 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dea743-a478-4df6-9051-ea663ee81168 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:33.780043 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dea743-a478-4df6-9051-ea663ee81168 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:33.781480 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dea743-a478-4df6-9051-ea663ee81168 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:33.792827 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-d3dea743-a478-4df6-9051-ea663ee81168 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:33.792827 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:33.792827 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:33.792827 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:33.792827 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:33.792827 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:33.792827 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:33.792827 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:33.792827 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:33.792827 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:33.792827 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:33.792827 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:33.792827 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:43:33.792827 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:43:33.792827 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:43:33.794491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:43:33.794491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:33.794491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:33.794491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:33.794491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:33.794491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:33.794491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:33.794491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:33.794491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:33.794491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:33.794491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:33.794491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:33.794491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:33.794491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:33.794491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:33.794491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:33.794491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:33.795857 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:43:33.795857 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:43:33.795857 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:43:33.795857 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:43:33.795857 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:43:33.795857 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:43:33.795857 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:33.795857 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:33.795857 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 402/782] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:43:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:33.796337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a778ac-2c6c-446d-82c9-29430a5dadab None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:33.796337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a778ac-2c6c-446d-82c9-29430a5dadab None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:33.796649 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a778ac-2c6c-446d-82c9-29430a5dadab None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:33.797853 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 403/783] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:43:33.798413 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a778ac-2c6c-446d-82c9-29430a5dadab None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:33.813491 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2cf3be-1f04-4010-9865-25281e3d52bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:33.814485 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2cf3be-1f04-4010-9865-25281e3d52bf None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:33.814861 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2cf3be-1f04-4010-9865-25281e3d52bf None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:33.815163 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2cf3be-1f04-4010-9865-25281e3d52bf None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:33.815780 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2cf3be-1f04-4010-9865-25281e3d52bf None admin] RBAC: Adding query filter params (name=network) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:33.816080 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2cf3be-1f04-4010-9865-25281e3d52bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:33.817460 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2cf3be-1f04-4010-9865-25281e3d52bf None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:33.826199 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 381/784] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Sep 7 15:43:33 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:33.826199 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2cf3be-1f04-4010-9865-25281e3d52bf None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:33.887558 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:33.918523 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a778ac-2c6c-446d-82c9-29430a5dadab None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:33.939996 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2cf3be-1f04-4010-9865-25281e3d52bf None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:33.961626 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea0c77-453e-404a-a38a-28362de45687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:33.962314 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea0c77-453e-404a-a38a-28362de45687 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:33.962599 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea0c77-453e-404a-a38a-28362de45687 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:33.962876 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea0c77-453e-404a-a38a-28362de45687 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:33.973744 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eea0c77-453e-404a-a38a-28362de45687 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:33.975244 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eea0c77-453e-404a-a38a-28362de45687 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:33.977388 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cbf477-da1a-4884-a0e7-9ad26e928579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:33.978269 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cbf477-da1a-4884-a0e7-9ad26e928579 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:33.978750 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cbf477-da1a-4884-a0e7-9ad26e928579 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:33.979233 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cbf477-da1a-4884-a0e7-9ad26e928579 None admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:33.980137 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cbf477-da1a-4884-a0e7-9ad26e928579 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:33.980970 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cbf477-da1a-4884-a0e7-9ad26e928579 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:33.983015 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cbf477-da1a-4884-a0e7-9ad26e928579 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:33.990305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-8eea0c77-453e-404a-a38a-28362de45687 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:33.990305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:33.990305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:33.990305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:33.990305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:33.990305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:33.990305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:33.990305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:33.990305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:33.990305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:33.990305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:33.990305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:33.990305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:33.990305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:33.990305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:33.990305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:33.991236 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:33.991236 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:33.991236 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:33.991236 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:33.991236 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:33.991236 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:33.991236 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:33.991236 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:33.991236 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:33.991236 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:33.991236 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:33.991236 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:33.991236 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:33.991236 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:33.991236 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:33.991236 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:33.991236 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:33.992138 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:33.992138 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:33.992138 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:33.992138 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 404/785] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:33.992647 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8812b1-7be6-4b45-853a-1df53b81815b None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:33.992817 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8812b1-7be6-4b45-853a-1df53b81815b None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:33.993106 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8812b1-7be6-4b45-853a-1df53b81815b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:34.001047 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:34.003368 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 382/786] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 7 15:43:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:34.004378 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cbf477-da1a-4884-a0e7-9ad26e928579 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:34.013630 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-bd8812b1-7be6-4b45-853a-1df53b81815b None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:34.014930 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-bd8812b1-7be6-4b45-853a-1df53b81815b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:34.093051 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 405/787] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:43:34.093892 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8812b1-7be6-4b45-853a-1df53b81815b None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:34.128623 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cbf477-da1a-4884-a0e7-9ad26e928579 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:34.144433 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:34.167693 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1104d-7f5b-4fba-bb85-d5672922f43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:34.169194 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1104d-7f5b-4fba-bb85-d5672922f43e None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:34.169703 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1104d-7f5b-4fba-bb85-d5672922f43e None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:34.170022 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1104d-7f5b-4fba-bb85-d5672922f43e None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:34.170709 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c1104d-7f5b-4fba-bb85-d5672922f43e None admin] RBAC: Adding query filter params (type=network) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:34.171024 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c1104d-7f5b-4fba-bb85-d5672922f43e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:34.172568 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c1104d-7f5b-4fba-bb85-d5672922f43e None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:34.182727 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 383/788] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Sep 7 15:43:34 2022] GET /identity/v3/services?type=network => generated 350 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:34.184359 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1104d-7f5b-4fba-bb85-d5672922f43e None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:34.224889 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8812b1-7be6-4b45-853a-1df53b81815b None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:34.265462 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:34.274851 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f9c522-7212-4bbc-b649-06a942354657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:34.275745 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9c522-7212-4bbc-b649-06a942354657 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:34.276251 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9c522-7212-4bbc-b649-06a942354657 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:34.276728 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9c522-7212-4bbc-b649-06a942354657 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:34.277691 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f9c522-7212-4bbc-b649-06a942354657 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:34.278476 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f9c522-7212-4bbc-b649-06a942354657 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:34.280264 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f9c522-7212-4bbc-b649-06a942354657 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:34.292807 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 406/789] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:34.294879 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f9c522-7212-4bbc-b649-06a942354657 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:34.314820 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1104d-7f5b-4fba-bb85-d5672922f43e None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:34.349552 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d20ff-d53d-413d-a901-95bcbf05564e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:34.350217 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d20ff-d53d-413d-a901-95bcbf05564e None admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:34.350572 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d20ff-d53d-413d-a901-95bcbf05564e None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:34.350853 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d20ff-d53d-413d-a901-95bcbf05564e None admin] PATH_INFO: `/v3/projects/488830167943488f85743236584113d7/users/f9b13331a5fd48f5a2521ed1600f9f35/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:34.353293 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d20ff-d53d-413d-a901-95bcbf05564e None admin] RBAC: Authorizing `identity:create_grant(project_id=488830167943488f85743236584113d7, user_id=f9b13331a5fd48f5a2521ed1600f9f35, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:34.355053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d20ff-d53d-413d-a901-95bcbf05564e None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:34.374257 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 384/790] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 7 15:43:34 2022] PUT /identity/v3/projects/488830167943488f85743236584113d7/users/f9b13331a5fd48f5a2521ed1600f9f35/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:43:34.375460 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d20ff-d53d-413d-a901-95bcbf05564e None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:34.429675 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f9c522-7212-4bbc-b649-06a942354657 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:34.447974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:34.474329 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d4ff0-9e46-406a-ad4d-4b6852ed7b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:34.475437 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d4ff0-9e46-406a-ad4d-4b6852ed7b37 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:34.475944 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d4ff0-9e46-406a-ad4d-4b6852ed7b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:34.476502 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d4ff0-9e46-406a-ad4d-4b6852ed7b37 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:34.477500 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d4ff0-9e46-406a-ad4d-4b6852ed7b37 None admin] RBAC: Adding query filter params (interface=public, service_id=1d218a57781847aa8e37cd59cb8d99ea, region_id=RegionOne) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:34.478034 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d4ff0-9e46-406a-ad4d-4b6852ed7b37 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:34.479808 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d4ff0-9e46-406a-ad4d-4b6852ed7b37 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:34.487044 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 407/791] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Sep 7 15:43:34 2022] GET /identity/v3/endpoints?service_id=1d218a57781847aa8e37cd59cb8d99ea&interface=public®ion_id=RegionOne => generated 194 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:34.492615 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d4ff0-9e46-406a-ad4d-4b6852ed7b37 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:34.529782 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d20ff-d53d-413d-a901-95bcbf05564e None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:34.567278 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:34.579092 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a1164-1c2e-4345-8e1b-94b82660344a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:34.579735 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a1164-1c2e-4345-8e1b-94b82660344a None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:34.580015 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a1164-1c2e-4345-8e1b-94b82660344a None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:34.580287 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a1164-1c2e-4345-8e1b-94b82660344a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:34.588441 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335a1164-1c2e-4345-8e1b-94b82660344a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:34.589918 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335a1164-1c2e-4345-8e1b-94b82660344a None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:34.602290 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-335a1164-1c2e-4345-8e1b-94b82660344a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:34.602290 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:34.602290 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:34.602290 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:34.602290 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:34.602290 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:34.602290 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:34.602290 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:34.602290 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:34.602290 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:34.602290 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:34.602290 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:34.602290 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:43:34.602290 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:43:34.602290 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:43:34.603234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:43:34.603234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:34.603234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:34.603234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:34.603234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:34.603234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:34.603234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:34.603234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:34.603234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:34.603234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:34.603234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:34.603234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:34.603234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:34.603234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:34.603234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:34.603234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:34.603234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:34.604125 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:43:34.604125 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:43:34.604125 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:43:34.604125 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:43:34.604125 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:43:34.604125 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:43:34.604125 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:34.604125 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:34.604125 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 385/792] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:43:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:34.604611 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a1164-1c2e-4345-8e1b-94b82660344a None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:34.629073 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d4ff0-9e46-406a-ad4d-4b6852ed7b37 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:34.680877 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945821a-755f-40b6-ba49-c9fa80ca8c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:34.682337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945821a-755f-40b6-ba49-c9fa80ca8c78 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:34.682625 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945821a-755f-40b6-ba49-c9fa80ca8c78 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:34.682904 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945821a-755f-40b6-ba49-c9fa80ca8c78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:34.697052 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c945821a-755f-40b6-ba49-c9fa80ca8c78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:43:34.703160 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-c945821a-755f-40b6-ba49-c9fa80ca8c78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:43:34.703160 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:34.703160 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:34.703160 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:34.703160 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:34.703160 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:34.703160 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:34.703160 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:34.703160 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:34.703160 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:34.703160 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:34.703160 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:34.703160 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:43:34.703160 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:43:34.703160 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:43:34.703160 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:43:34.704096 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:43:34.704096 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:43:34.704096 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:43:34.704096 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:43:34.704096 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:34.704096 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:34.704096 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:34.704096 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:34.704096 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:34.704096 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:34.704096 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:34.704096 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:34.704096 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:34.704096 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:34.704096 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:34.704096 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:34.704952 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:34.704952 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:34.704952 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:34.704952 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:34.704952 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:43:34.704952 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:43:34.704952 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:43:34.704952 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:43:34.704952 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:43:34.704952 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:43:34.704952 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:43:34.704952 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:34.704952 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 408/793] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 7 15:43:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:34.705641 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945821a-755f-40b6-ba49-c9fa80ca8c78 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:34.716770 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:34.721039 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a1164-1c2e-4345-8e1b-94b82660344a None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:34.758642 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802663be-ee9b-43b9-8798-9f4f8876d8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:34.759780 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802663be-ee9b-43b9-8798-9f4f8876d8ae None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:34.760246 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802663be-ee9b-43b9-8798-9f4f8876d8ae None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:34.760616 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802663be-ee9b-43b9-8798-9f4f8876d8ae None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:34.761322 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802663be-ee9b-43b9-8798-9f4f8876d8ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:34.763002 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802663be-ee9b-43b9-8798-9f4f8876d8ae None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:34.768901 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 386/794] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Sep 7 15:43:34 2022] GET /identity/v3/services => generated 772 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:34.769953 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802663be-ee9b-43b9-8798-9f4f8876d8ae None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:34.833013 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945821a-755f-40b6-ba49-c9fa80ca8c78 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:34.851533 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:34.872895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18d28d-1254-4b9f-95b7-a8519b93349c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:34.873688 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18d28d-1254-4b9f-95b7-a8519b93349c None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:34.874079 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18d28d-1254-4b9f-95b7-a8519b93349c None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:34.874561 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18d28d-1254-4b9f-95b7-a8519b93349c None admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:34.875372 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a18d28d-1254-4b9f-95b7-a8519b93349c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:34.875780 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a18d28d-1254-4b9f-95b7-a8519b93349c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:34.877360 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a18d28d-1254-4b9f-95b7-a8519b93349c None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:34.913284 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802663be-ee9b-43b9-8798-9f4f8876d8ae None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:34.955140 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c04370-c219-40e3-98f7-83ed28682b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:34.955708 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c04370-c219-40e3-98f7-83ed28682b79 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:34.955989 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c04370-c219-40e3-98f7-83ed28682b79 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:34.956268 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c04370-c219-40e3-98f7-83ed28682b79 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:34.956958 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c04370-c219-40e3-98f7-83ed28682b79 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:34.957263 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c04370-c219-40e3-98f7-83ed28682b79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:34.958743 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c04370-c219-40e3-98f7-83ed28682b79 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:34.970634 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 387/795] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:43:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:34.980787 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c04370-c219-40e3-98f7-83ed28682b79 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:35.038991 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:35.071617 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 409/796] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 7 15:43:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:35.078211 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18d28d-1254-4b9f-95b7-a8519b93349c None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:35.132732 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c04370-c219-40e3-98f7-83ed28682b79 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:35.170262 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037860d-ee21-4cd1-99b8-ab4e4cee355d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:35.170969 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037860d-ee21-4cd1-99b8-ab4e4cee355d None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:35.171254 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037860d-ee21-4cd1-99b8-ab4e4cee355d None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:35.171526 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037860d-ee21-4cd1-99b8-ab4e4cee355d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:35.184126 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1037860d-ee21-4cd1-99b8-ab4e4cee355d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:35.186168 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1037860d-ee21-4cd1-99b8-ab4e4cee355d None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:35.194130 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18d28d-1254-4b9f-95b7-a8519b93349c None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:35.203298 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-1037860d-ee21-4cd1-99b8-ab4e4cee355d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:35.203298 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:35.203298 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:35.203298 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:35.203298 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:35.203298 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:35.203298 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:35.203298 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:35.203298 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:35.203298 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:35.203298 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:35.203298 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:35.203298 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:35.203298 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:35.203298 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:35.203298 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:35.205474 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:35.205474 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:35.205474 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:35.205474 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:35.205474 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:35.205474 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:35.205474 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:35.205474 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:35.205474 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:35.205474 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:35.205474 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:35.205474 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:35.205474 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:35.205474 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:35.205474 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:35.205474 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:35.205474 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:35.207535 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:35.207535 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:35.207535 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:35.207535 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 388/797] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:43:35.213556 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037860d-ee21-4cd1-99b8-ab4e4cee355d None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:35.233209 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95ce2d-72b9-4132-946e-ff778dc31727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:35.233888 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95ce2d-72b9-4132-946e-ff778dc31727 None admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:35.234170 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95ce2d-72b9-4132-946e-ff778dc31727 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:35.234473 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95ce2d-72b9-4132-946e-ff778dc31727 None admin] PATH_INFO: `/v3/projects/488830167943488f85743236584113d7/users/3e20e40a37df4898bfe692535e5e4f25/roles/a420b17212b94988beb75affe974355b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:35.252074 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff95ce2d-72b9-4132-946e-ff778dc31727 None admin] RBAC: Authorizing `identity:create_grant(project_id=488830167943488f85743236584113d7, user_id=3e20e40a37df4898bfe692535e5e4f25, role_id=a420b17212b94988beb75affe974355b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:35.253691 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff95ce2d-72b9-4132-946e-ff778dc31727 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:35.270432 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 410/798] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 7 15:43:35 2022] PUT /identity/v3/projects/488830167943488f85743236584113d7/users/3e20e40a37df4898bfe692535e5e4f25/roles/a420b17212b94988beb75affe974355b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:43:35.302003 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:35.327908 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037860d-ee21-4cd1-99b8-ab4e4cee355d None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:35.366043 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f0ba79-3029-4b3b-bf17-4882defa2bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:35.366741 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0ba79-3029-4b3b-bf17-4882defa2bd4 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:35.367025 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0ba79-3029-4b3b-bf17-4882defa2bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:35.367300 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0ba79-3029-4b3b-bf17-4882defa2bd4 None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:35.367965 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f0ba79-3029-4b3b-bf17-4882defa2bd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:35.368353 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f0ba79-3029-4b3b-bf17-4882defa2bd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:35.369743 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f0ba79-3029-4b3b-bf17-4882defa2bd4 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:35.384728 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 389/799] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:43:35.390765 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95ce2d-72b9-4132-946e-ff778dc31727 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:35.437562 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:35.536536 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95ce2d-72b9-4132-946e-ff778dc31727 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:35.572211 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76353e5b-fedd-445b-8fb1-c765c7dde5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:35.573156 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76353e5b-fedd-445b-8fb1-c765c7dde5b5 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:35.573574 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76353e5b-fedd-445b-8fb1-c765c7dde5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:35.573990 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76353e5b-fedd-445b-8fb1-c765c7dde5b5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:35.582339 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76353e5b-fedd-445b-8fb1-c765c7dde5b5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:35.584043 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76353e5b-fedd-445b-8fb1-c765c7dde5b5 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:35.596209 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-76353e5b-fedd-445b-8fb1-c765c7dde5b5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 07 15:43:35.596209 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:35.596209 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:35.596209 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:35.596209 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:35.596209 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:35.596209 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:35.596209 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:35.596209 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:35.596209 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:35.596209 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:35.596209 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:35.596209 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:43:35.596209 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:43:35.596209 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:43:35.596209 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:43:35.597337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:35.597337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:35.597337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:43:35.597337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:35.597337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:43:35.597337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:35.597337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:35.597337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:35.597337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:35.597337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:35.597337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:35.597337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:35.597337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:35.597337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:35.597337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:35.597337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:35.597337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:35.597337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:35.598457 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:35.598457 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:35.598457 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:43:35.598457 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:43:35.598457 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:43:35.598457 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:43:35.598457 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:43:35.598457 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:43:35.598457 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 07 15:43:35.598457 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:35.602331 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 411/800] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 7 15:43:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:35.611331 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f0ba79-3029-4b3b-bf17-4882defa2bd4 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:35.749386 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e7d86-a225-4083-be86-3b69f1d94792 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:35.749670 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e7d86-a225-4083-be86-3b69f1d94792 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:35.749955 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e7d86-a225-4083-be86-3b69f1d94792 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:35.751565 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 412/801] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:43:35.756579 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b254d-b207-4aaa-91b3-36be315f3d3a None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:35.756849 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b254d-b207-4aaa-91b3-36be315f3d3a None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:35.757125 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b254d-b207-4aaa-91b3-36be315f3d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:35.771539 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f0ba79-3029-4b3b-bf17-4882defa2bd4 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:35.776357 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-874b254d-b207-4aaa-91b3-36be315f3d3a None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:35.777725 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-874b254d-b207-4aaa-91b3-36be315f3d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:35.835879 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f1f97-fd88-47d6-8b4b-8241ed52aa55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:35.836842 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f1f97-fd88-47d6-8b4b-8241ed52aa55 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:35.837319 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f1f97-fd88-47d6-8b4b-8241ed52aa55 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:35.837812 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f1f97-fd88-47d6-8b4b-8241ed52aa55 None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:35.838825 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f1f97-fd88-47d6-8b4b-8241ed52aa55 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:35.839331 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f1f97-fd88-47d6-8b4b-8241ed52aa55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:35.841634 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f1f97-fd88-47d6-8b4b-8241ed52aa55 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:35.855536 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:35.864128 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 413/802] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:43:35.876529 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 390/803] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Sep 7 15:43:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:35.882459 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b254d-b207-4aaa-91b3-36be315f3d3a None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:35.913859 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:36.055864 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b254d-b207-4aaa-91b3-36be315f3d3a None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:36.107054 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f212cf-d417-4d04-99d4-4d1916bd8f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:36.108333 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f212cf-d417-4d04-99d4-4d1916bd8f44 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:36.108867 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f212cf-d417-4d04-99d4-4d1916bd8f44 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:36.109352 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f212cf-d417-4d04-99d4-4d1916bd8f44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:36.124518 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f212cf-d417-4d04-99d4-4d1916bd8f44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:36.126373 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f212cf-d417-4d04-99d4-4d1916bd8f44 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:36.150156 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-d2f212cf-d417-4d04-99d4-4d1916bd8f44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:36.150156 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:36.150156 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:36.150156 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:36.150156 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:36.150156 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:36.150156 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:36.150156 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:36.150156 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:36.150156 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:36.150156 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:36.150156 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:36.150156 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:36.150156 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:36.150156 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:36.150156 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:36.151169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:36.151169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:36.151169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:36.151169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:36.151169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:36.151169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:36.151169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:36.151169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:36.151169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:36.151169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:36.151169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:36.151169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:36.151169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:36.151169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:36.151169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:36.151169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:36.151169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:36.152047 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:36.152047 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:36.152047 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:36.154131 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 414/804] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:36.159947 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f1f97-fd88-47d6-8b4b-8241ed52aa55 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:36.308306 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f1f97-fd88-47d6-8b4b-8241ed52aa55 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:36.309610 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f212cf-d417-4d04-99d4-4d1916bd8f44 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:36.351117 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e1b3f-a2e8-4b3f-bbbf-8c2841a8d206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:36.351737 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e1b3f-a2e8-4b3f-bbbf-8c2841a8d206 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:36.352018 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e1b3f-a2e8-4b3f-bbbf-8c2841a8d206 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:36.352292 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e1b3f-a2e8-4b3f-bbbf-8c2841a8d206 None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:36.352934 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e1b3f-a2e8-4b3f-bbbf-8c2841a8d206 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:36.353239 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e1b3f-a2e8-4b3f-bbbf-8c2841a8d206 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:36.354634 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e1b3f-a2e8-4b3f-bbbf-8c2841a8d206 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:36.388366 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 391/805] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:43:36.394038 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e1b3f-a2e8-4b3f-bbbf-8c2841a8d206 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:36.432663 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:36.487762 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:36.501082 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f212cf-d417-4d04-99d4-4d1916bd8f44 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:36.563513 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a16ce04-51d9-45b4-bf0e-32cdd1707467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:36.564520 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16ce04-51d9-45b4-bf0e-32cdd1707467 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:36.565597 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16ce04-51d9-45b4-bf0e-32cdd1707467 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:36.566245 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16ce04-51d9-45b4-bf0e-32cdd1707467 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:36.568120 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a16ce04-51d9-45b4-bf0e-32cdd1707467 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:36.570414 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a16ce04-51d9-45b4-bf0e-32cdd1707467 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:36.573620 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e1b3f-a2e8-4b3f-bbbf-8c2841a8d206 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:36.584491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-7a16ce04-51d9-45b4-bf0e-32cdd1707467 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 15:43:36.584491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:36.584491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 15:43:36.584491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 15:43:36.584491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 15:43:36.584491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 15:43:36.584491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 15:43:36.584491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:43:36.584491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 15:43:36.584491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:36.584491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:43:36.584491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:36.584491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:36.584491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:36.584491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:36.584491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:36.584491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:36.585526 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:36.585526 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:36.585526 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:36.585526 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:36.585526 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:36.585526 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:36.585526 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 15:43:36.585526 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 15:43:36.585526 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 15:43:36.585526 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 15:43:36.585526 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:36.585526 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:36.585526 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:36.585526 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:36.585526 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:36.585526 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:36.586410 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:36.586410 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:36.586410 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:36.586410 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:36.586410 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:36.586410 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:36.586410 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:36.586410 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:36.586410 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:36.586410 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:36.586410 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 15:43:36.586410 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:43:36.586410 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 15:43:36.586410 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:36.595619 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 415/806] 10.222.0.16 () {56 vars in 1129 bytes} [Wed Sep 7 15:43:36 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:36.602200 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a16ce04-51d9-45b4-bf0e-32cdd1707467 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:36.648293 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c350fc1-0232-4d2f-b78d-1acb5117c2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:36.648844 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c350fc1-0232-4d2f-b78d-1acb5117c2dd None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:36.649132 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c350fc1-0232-4d2f-b78d-1acb5117c2dd None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:36.649405 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c350fc1-0232-4d2f-b78d-1acb5117c2dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:36.660576 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c350fc1-0232-4d2f-b78d-1acb5117c2dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:36.662016 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c350fc1-0232-4d2f-b78d-1acb5117c2dd None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:36.680870 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-4c350fc1-0232-4d2f-b78d-1acb5117c2dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:36.680870 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:36.680870 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:36.680870 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:36.680870 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:36.680870 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:36.680870 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:36.680870 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:36.680870 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:36.680870 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:36.680870 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:36.680870 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:36.680870 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:43:36.680870 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:43:36.680870 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:43:36.681762 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:43:36.681762 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:36.681762 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:36.681762 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:36.681762 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:36.681762 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:36.681762 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:36.681762 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:36.681762 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:36.681762 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:36.681762 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:36.681762 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:36.681762 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:36.681762 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:36.681762 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:36.681762 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:36.681762 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:36.682785 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:43:36.682785 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:43:36.682785 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:43:36.682785 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:43:36.682785 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:43:36.682785 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:43:36.682785 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:36.682785 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:36.684953 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 392/807] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:43:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:43:36.691073 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c350fc1-0232-4d2f-b78d-1acb5117c2dd None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:36.789354 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a16ce04-51d9-45b4-bf0e-32cdd1707467 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:36.846428 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:36.854260 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6124d-36e9-4e56-9d76-bac94c880ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:36.854879 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6124d-36e9-4e56-9d76-bac94c880ba6 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:36.855156 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6124d-36e9-4e56-9d76-bac94c880ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:36.855426 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6124d-36e9-4e56-9d76-bac94c880ba6 None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:36.856408 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d6124d-36e9-4e56-9d76-bac94c880ba6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:36.856716 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d6124d-36e9-4e56-9d76-bac94c880ba6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:36.858371 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d6124d-36e9-4e56-9d76-bac94c880ba6 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:36.867317 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 416/808] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Sep 7 15:43:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:36.874639 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6124d-36e9-4e56-9d76-bac94c880ba6 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:36.890351 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c350fc1-0232-4d2f-b78d-1acb5117c2dd None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:36.914641 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:36.931173 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62660fb2-45ca-4540-91ca-d721575d6f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:36.931781 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62660fb2-45ca-4540-91ca-d721575d6f63 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:36.932185 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62660fb2-45ca-4540-91ca-d721575d6f63 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:36.932539 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62660fb2-45ca-4540-91ca-d721575d6f63 None admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:36.933345 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62660fb2-45ca-4540-91ca-d721575d6f63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:36.933807 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62660fb2-45ca-4540-91ca-d721575d6f63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:36.936283 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62660fb2-45ca-4540-91ca-d721575d6f63 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:36.952095 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 393/809] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 7 15:43:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:43:36.953402 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597fb580-8611-4618-9647-74d8a8e5756b None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:36.953941 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597fb580-8611-4618-9647-74d8a8e5756b None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:36.954235 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597fb580-8611-4618-9647-74d8a8e5756b None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:36.958439 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 394/810] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:43:36.959200 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597fb580-8611-4618-9647-74d8a8e5756b None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:36.998003 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6124d-36e9-4e56-9d76-bac94c880ba6 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:37.037881 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2560c0-0c1d-4ce0-afe9-0607b5b95ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:37.038944 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2560c0-0c1d-4ce0-afe9-0607b5b95ccf None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:37.039452 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2560c0-0c1d-4ce0-afe9-0607b5b95ccf None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:37.039927 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2560c0-0c1d-4ce0-afe9-0607b5b95ccf None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:37.040755 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2560c0-0c1d-4ce0-afe9-0607b5b95ccf None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:37.041261 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2560c0-0c1d-4ce0-afe9-0607b5b95ccf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:37.042864 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2560c0-0c1d-4ce0-afe9-0607b5b95ccf None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:37.054252 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 417/811] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Sep 7 15:43:36 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:37.055904 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d6e59-855d-4902-84b6-03f11ca48682 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:37.056395 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d6e59-855d-4902-84b6-03f11ca48682 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:37.056942 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d6e59-855d-4902-84b6-03f11ca48682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:37.081778 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-354d6e59-855d-4902-84b6-03f11ca48682 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:37.082346 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597fb580-8611-4618-9647-74d8a8e5756b None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:37.082993 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-354d6e59-855d-4902-84b6-03f11ca48682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:37.120776 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df4fe9-f3e2-4f75-850f-21278f5b5db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:37.121504 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df4fe9-f3e2-4f75-850f-21278f5b5db1 None admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:37.121791 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df4fe9-f3e2-4f75-850f-21278f5b5db1 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:37.122065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df4fe9-f3e2-4f75-850f-21278f5b5db1 None admin] PATH_INFO: `/v3/projects/488830167943488f85743236584113d7/users/16c4b090a4aa4d56a90ccf090b9caba8/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:37.124246 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df4fe9-f3e2-4f75-850f-21278f5b5db1 None admin] RBAC: Authorizing `identity:create_grant(project_id=488830167943488f85743236584113d7, user_id=16c4b090a4aa4d56a90ccf090b9caba8, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:37.126012 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df4fe9-f3e2-4f75-850f-21278f5b5db1 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:37.143008 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 395/812] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 7 15:43:36 2022] PUT /identity/v3/projects/488830167943488f85743236584113d7/users/16c4b090a4aa4d56a90ccf090b9caba8/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:43:37.143887 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df4fe9-f3e2-4f75-850f-21278f5b5db1 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:37.149481 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:37.185174 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 418/813] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:43:37.190099 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:37.280004 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df4fe9-f3e2-4f75-850f-21278f5b5db1 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:37.319890 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e116b1e-9034-499d-93e2-6d2414f2af0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:37.320558 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e116b1e-9034-499d-93e2-6d2414f2af0c None admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:37.320842 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e116b1e-9034-499d-93e2-6d2414f2af0c None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:37.321118 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e116b1e-9034-499d-93e2-6d2414f2af0c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:37.321785 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e116b1e-9034-499d-93e2-6d2414f2af0c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:37.323181 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e116b1e-9034-499d-93e2-6d2414f2af0c None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:37.348204 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 396/814] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:43:37 2022] POST /identity/v3/endpoints => generated 346 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:43:37.479053 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d6e59-855d-4902-84b6-03f11ca48682 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:37.608729 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734d80a-3a10-4916-8bed-e646e1d97a3d None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:37.609236 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734d80a-3a10-4916-8bed-e646e1d97a3d None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:37.609628 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734d80a-3a10-4916-8bed-e646e1d97a3d None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:37.611375 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d6e59-855d-4902-84b6-03f11ca48682 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:37.611555 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 397/815] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:43:37.627859 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdd909-0a2a-40a0-9359-cdd4aeecc782 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:37.628178 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdd909-0a2a-40a0-9359-cdd4aeecc782 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:37.628407 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdd909-0a2a-40a0-9359-cdd4aeecc782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:37.654748 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-3efdd909-0a2a-40a0-9359-cdd4aeecc782 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:37.655946 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-3efdd909-0a2a-40a0-9359-cdd4aeecc782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:37.659039 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3812546-7b55-423b-a32e-73ec21468075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:37.659686 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3812546-7b55-423b-a32e-73ec21468075 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:37.660071 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3812546-7b55-423b-a32e-73ec21468075 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:37.660351 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3812546-7b55-423b-a32e-73ec21468075 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:37.672465 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3812546-7b55-423b-a32e-73ec21468075 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:43:37.677771 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-e3812546-7b55-423b-a32e-73ec21468075 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:43:37.677771 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:37.677771 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:37.677771 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:37.677771 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:37.677771 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:37.677771 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:37.677771 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:37.677771 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:37.677771 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:37.677771 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:37.677771 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:37.677771 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:43:37.677771 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:43:37.677771 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:43:37.677771 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:43:37.678732 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:43:37.678732 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:43:37.678732 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:43:37.678732 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:43:37.678732 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:37.678732 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:37.678732 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:37.678732 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:37.678732 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:37.678732 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:37.678732 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:37.678732 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:37.678732 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:37.678732 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:37.678732 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:37.678732 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:37.679568 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:37.679568 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:37.679568 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:37.679568 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:37.679568 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:43:37.679568 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:43:37.679568 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:43:37.679568 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:43:37.679568 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:43:37.679568 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:43:37.679568 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:43:37.679568 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:37.679568 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 419/816] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 7 15:43:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:37.689019 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3812546-7b55-423b-a32e-73ec21468075 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:37.745301 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:37.753435 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 398/817] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:43:37.808517 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3812546-7b55-423b-a32e-73ec21468075 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:37.845215 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf37a41f-447e-43f5-a21e-8113e5ba907f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:37.846276 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf37a41f-447e-43f5-a21e-8113e5ba907f None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:37.846760 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf37a41f-447e-43f5-a21e-8113e5ba907f None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:37.847242 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf37a41f-447e-43f5-a21e-8113e5ba907f None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:37.848156 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf37a41f-447e-43f5-a21e-8113e5ba907f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:37.848652 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf37a41f-447e-43f5-a21e-8113e5ba907f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:37.850230 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf37a41f-447e-43f5-a21e-8113e5ba907f None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:37.864625 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 420/818] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:43:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:43:37.866543 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efdd909-0a2a-40a0-9359-cdd4aeecc782 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:37.890874 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:37.984194 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efdd909-0a2a-40a0-9359-cdd4aeecc782 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:38.042822 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e34083-ce0f-48dc-a566-c6accc059679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:38.044130 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e34083-ce0f-48dc-a566-c6accc059679 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:38.044408 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e34083-ce0f-48dc-a566-c6accc059679 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:38.044729 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e34083-ce0f-48dc-a566-c6accc059679 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:38.062410 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e34083-ce0f-48dc-a566-c6accc059679 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:38.063951 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e34083-ce0f-48dc-a566-c6accc059679 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:38.080393 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-25e34083-ce0f-48dc-a566-c6accc059679 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:38.080393 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:38.080393 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:38.080393 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:38.080393 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:38.080393 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:38.080393 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:38.080393 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:38.080393 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:38.080393 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:38.080393 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:38.080393 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:38.080393 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:38.080393 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:38.080393 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:38.080393 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:38.081380 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:38.081380 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:38.081380 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:38.081380 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:38.081380 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:38.081380 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:38.081380 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:38.081380 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:38.081380 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:38.081380 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:38.081380 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:38.081380 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:38.081380 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:38.081380 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:38.081380 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:38.081380 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:38.081380 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:38.082296 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:38.082296 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:38.082296 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:38.086162 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 399/819] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:38.087564 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf37a41f-447e-43f5-a21e-8113e5ba907f None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:38.103866 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e34083-ce0f-48dc-a566-c6accc059679 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:38.202493 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:38.220538 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf37a41f-447e-43f5-a21e-8113e5ba907f None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:38.234235 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:38.246719 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e34083-ce0f-48dc-a566-c6accc059679 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:38.273726 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994dd93-1eb5-42c6-83ce-b9ed6e227ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:38.274475 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994dd93-1eb5-42c6-83ce-b9ed6e227ac1 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:38.274823 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994dd93-1eb5-42c6-83ce-b9ed6e227ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:38.275162 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994dd93-1eb5-42c6-83ce-b9ed6e227ac1 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:38.275878 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6994dd93-1eb5-42c6-83ce-b9ed6e227ac1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:38.276249 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6994dd93-1eb5-42c6-83ce-b9ed6e227ac1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:38.278440 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6994dd93-1eb5-42c6-83ce-b9ed6e227ac1 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:38.291825 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bdad0d-b5c6-43af-b1a2-5f37a65c2b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:38.292385 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bdad0d-b5c6-43af-b1a2-5f37a65c2b18 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:38.292567 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 421/820] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:38.294390 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f1975-fa1f-41fd-ad5c-732f3258e1dc None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:38.294683 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f1975-fa1f-41fd-ad5c-732f3258e1dc None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:38.294965 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f1975-fa1f-41fd-ad5c-732f3258e1dc None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:38.296426 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 422/821] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:43:38.296675 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bdad0d-b5c6-43af-b1a2-5f37a65c2b18 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:38.296971 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bdad0d-b5c6-43af-b1a2-5f37a65c2b18 None admin] PATH_INFO: `/v3/services/network` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:38.297691 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bdad0d-b5c6-43af-b1a2-5f37a65c2b18 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:38.302287 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bdad0d-b5c6-43af-b1a2-5f37a65c2b18 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:38.303017 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f1975-fa1f-41fd-ad5c-732f3258e1dc None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:38.316140 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-46bdad0d-b5c6-43af-b1a2-5f37a65c2b18 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 15:43:38.316140 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:38.316140 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 15:43:38.316140 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 15:43:38.316140 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 15:43:38.316140 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 15:43:38.316140 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 15:43:38.316140 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:43:38.316140 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 15:43:38.316140 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:38.316140 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:43:38.316140 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:38.316140 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:38.316140 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:38.316140 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:38.316140 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:38.316140 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:38.317153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:38.317153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:38.317153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:38.317153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:38.317153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:38.317153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:38.317153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 15:43:38.317153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 15:43:38.317153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 15:43:38.317153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 15:43:38.317153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:38.317153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:38.317153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:38.317153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:38.317153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:38.317153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:38.317975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:38.317975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:38.317975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:38.317975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:38.317975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:38.317975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:38.317975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:38.317975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:38.317975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:38.317975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:38.317975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 15:43:38.317975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:43:38.317975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 15:43:38.317975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:38.317975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 400/822] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:43:38 2022] GET /identity/v3/services/network => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:38.319311 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0a149-b7b8-4df2-96b2-6a3ed6d57e8a None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:38.319311 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0a149-b7b8-4df2-96b2-6a3ed6d57e8a None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:38.319476 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0a149-b7b8-4df2-96b2-6a3ed6d57e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:38.340701 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-b2b0a149-b7b8-4df2-96b2-6a3ed6d57e8a None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:38.342456 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b2b0a149-b7b8-4df2-96b2-6a3ed6d57e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:38.419177 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 401/823] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:43:38.420412 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b0a149-b7b8-4df2-96b2-6a3ed6d57e8a None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:38.439576 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f1975-fa1f-41fd-ad5c-732f3258e1dc None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:38.480630 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6544b-4433-4599-ae3f-65e51161506f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:38.481378 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6544b-4433-4599-ae3f-65e51161506f None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:38.481586 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6544b-4433-4599-ae3f-65e51161506f None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:38.481857 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6544b-4433-4599-ae3f-65e51161506f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:38.490401 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d6544b-4433-4599-ae3f-65e51161506f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:38.492482 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d6544b-4433-4599-ae3f-65e51161506f None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:38.518872 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-e8d6544b-4433-4599-ae3f-65e51161506f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 15:43:38.518872 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:38.518872 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:38.518872 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:38.518872 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:38.518872 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:38.518872 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:38.518872 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:38.518872 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:38.518872 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:38.518872 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:38.518872 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:38.518872 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:43:38.518872 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:43:38.518872 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:43:38.518872 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:43:38.519848 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:38.519848 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:38.519848 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:43:38.519848 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:38.519848 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:43:38.519848 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:38.519848 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:38.519848 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:38.519848 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:38.519848 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:38.519848 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:38.519848 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:38.519848 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:38.519848 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:38.519848 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:38.519848 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:38.519848 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:38.519848 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:38.520804 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:38.520804 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:38.520804 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:43:38.520804 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:43:38.520804 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:43:38.520804 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:43:38.520804 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:43:38.520804 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:43:38.520804 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 15:43:38.520804 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:38.528730 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 423/824] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Sep 7 15:43:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:38.544501 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6544b-4433-4599-ae3f-65e51161506f None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:38.560053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:38.596211 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:38.624851 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b0a149-b7b8-4df2-96b2-6a3ed6d57e8a None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:38.671571 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba074f18-c617-443b-aa5d-7a77867de592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:38.672195 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba074f18-c617-443b-aa5d-7a77867de592 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:38.672472 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba074f18-c617-443b-aa5d-7a77867de592 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:38.672740 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba074f18-c617-443b-aa5d-7a77867de592 None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:38.673435 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba074f18-c617-443b-aa5d-7a77867de592 None admin] RBAC: Adding query filter params (name=network) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:38.673737 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba074f18-c617-443b-aa5d-7a77867de592 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:38.675316 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba074f18-c617-443b-aa5d-7a77867de592 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:38.688311 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 402/825] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Sep 7 15:43:38 2022] GET /identity/v3/services?name=network => generated 124 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:38.695125 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba074f18-c617-443b-aa5d-7a77867de592 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:38.701348 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6544b-4433-4599-ae3f-65e51161506f None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:38.741367 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79906802-b60f-4a3e-858f-86de90c80051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:38.741977 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79906802-b60f-4a3e-858f-86de90c80051 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:38.742288 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79906802-b60f-4a3e-858f-86de90c80051 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:38.742566 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79906802-b60f-4a3e-858f-86de90c80051 None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:38.743293 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79906802-b60f-4a3e-858f-86de90c80051 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:38.743601 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79906802-b60f-4a3e-858f-86de90c80051 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:38.745252 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79906802-b60f-4a3e-858f-86de90c80051 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:38.767248 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 424/826] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Sep 7 15:43:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:43:38.768111 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79906802-b60f-4a3e-858f-86de90c80051 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:38.837418 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba074f18-c617-443b-aa5d-7a77867de592 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:38.868778 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:38.874648 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:38.882126 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21445fd8-8281-49bd-9374-13906e7614b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:38.883539 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21445fd8-8281-49bd-9374-13906e7614b1 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:38.884024 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21445fd8-8281-49bd-9374-13906e7614b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:38.884499 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21445fd8-8281-49bd-9374-13906e7614b1 None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:38.885737 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21445fd8-8281-49bd-9374-13906e7614b1 None admin] RBAC: Adding query filter params (type=network) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:38.886210 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21445fd8-8281-49bd-9374-13906e7614b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:38.888207 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21445fd8-8281-49bd-9374-13906e7614b1 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:38.888638 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79906802-b60f-4a3e-858f-86de90c80051 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:38.894607 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 403/827] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Sep 7 15:43:38 2022] GET /identity/v3/services?type=network => generated 350 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:38.895613 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21445fd8-8281-49bd-9374-13906e7614b1 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:38.926551 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7fb77b-86a5-4a08-a1ec-309c48cafb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:38.927511 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7fb77b-86a5-4a08-a1ec-309c48cafb06 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:38.927806 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7fb77b-86a5-4a08-a1ec-309c48cafb06 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:38.928178 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7fb77b-86a5-4a08-a1ec-309c48cafb06 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:38.939824 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7fb77b-86a5-4a08-a1ec-309c48cafb06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:43:38.944974 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-dc7fb77b-86a5-4a08-a1ec-309c48cafb06 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:43:38.944974 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:38.944974 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:38.944974 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:38.944974 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:38.944974 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:38.944974 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:38.944974 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:38.944974 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:38.944974 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:38.944974 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:38.944974 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:38.944974 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:43:38.944974 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:43:38.944974 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:43:38.944974 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:43:38.946088 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:43:38.946088 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:43:38.946088 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:43:38.946088 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:43:38.946088 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:38.946088 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:38.946088 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:38.946088 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:38.946088 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:38.946088 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:38.946088 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:38.946088 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:38.946088 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:38.946088 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:38.946088 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:38.946088 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:38.947144 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:38.947144 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:38.947144 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:38.947144 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:38.947144 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:43:38.947144 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:43:38.947144 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:43:38.947144 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:43:38.947144 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:43:38.947144 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:43:38.947144 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:43:38.947144 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:38.953798 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 425/828] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 7 15:43:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:38.953798 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7fb77b-86a5-4a08-a1ec-309c48cafb06 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:39.031973 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21445fd8-8281-49bd-9374-13906e7614b1 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:39.071377 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08e6d1e-e6e1-4329-b83d-e5bcd3da350e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:39.072042 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e6d1e-e6e1-4329-b83d-e5bcd3da350e None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:39.072270 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e6d1e-e6e1-4329-b83d-e5bcd3da350e None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:39.072568 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e6d1e-e6e1-4329-b83d-e5bcd3da350e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:39.074657 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7fb77b-86a5-4a08-a1ec-309c48cafb06 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:39.113487 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d8644-c2bd-4408-8734-9dfeabf89def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:39.114358 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d8644-c2bd-4408-8734-9dfeabf89def None admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:39.114784 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d8644-c2bd-4408-8734-9dfeabf89def None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:39.115225 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d8644-c2bd-4408-8734-9dfeabf89def None admin] PATH_INFO: `/v3/endpoints` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:39.116109 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d8644-c2bd-4408-8734-9dfeabf89def None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:39.117714 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d8644-c2bd-4408-8734-9dfeabf89def None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:39.139726 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:39.145024 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 426/829] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:43:38 2022] POST /identity/v3/endpoints => generated 337 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:43:39.146617 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d8644-c2bd-4408-8734-9dfeabf89def None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:39.157646 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08e6d1e-e6e1-4329-b83d-e5bcd3da350e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:39.158248 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:39.160370 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08e6d1e-e6e1-4329-b83d-e5bcd3da350e None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:39.285114 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d8644-c2bd-4408-8734-9dfeabf89def None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:39.324667 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f822e644-93bd-436c-b097-516f717a2931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:39.325194 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 404/830] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:43:38 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 15:43:39.325644 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822e644-93bd-436c-b097-516f717a2931 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:39.330189 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822e644-93bd-436c-b097-516f717a2931 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:39.330189 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822e644-93bd-436c-b097-516f717a2931 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:39.330189 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f822e644-93bd-436c-b097-516f717a2931 None admin] RBAC: Adding query filter params (name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:39.330189 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f822e644-93bd-436c-b097-516f717a2931 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:39.330189 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f822e644-93bd-436c-b097-516f717a2931 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:39.332026 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08e6d1e-e6e1-4329-b83d-e5bcd3da350e None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:39.339254 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 427/831] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 7 15:43:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:39.351520 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f822e644-93bd-436c-b097-516f717a2931 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:39.442974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08e6d1e-e6e1-4329-b83d-e5bcd3da350e None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:39.446561 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:39.484125 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6767d8-7928-46ac-8005-a0f95a391c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:39.485200 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6767d8-7928-46ac-8005-a0f95a391c14 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:39.486558 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6767d8-7928-46ac-8005-a0f95a391c14 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:39.487785 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6767d8-7928-46ac-8005-a0f95a391c14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:39.501318 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6767d8-7928-46ac-8005-a0f95a391c14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:39.503207 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6767d8-7928-46ac-8005-a0f95a391c14 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:39.506134 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:39.523501 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-0f6767d8-7928-46ac-8005-a0f95a391c14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:39.523501 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:39.523501 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:39.523501 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:39.523501 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:39.523501 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:39.523501 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:39.523501 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:39.523501 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:39.523501 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:39.523501 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:39.523501 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:39.523501 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:39.523501 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:39.523501 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:39.523501 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:39.524510 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:39.524510 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:39.524510 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:39.524510 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:39.524510 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:39.524510 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:39.524510 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:39.524510 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:39.524510 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:39.524510 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:39.524510 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:39.524510 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:39.524510 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:39.524510 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:39.524510 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:39.524510 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:39.524510 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:39.525383 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:39.525383 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:39.525383 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:39.532571 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 405/832] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:39.533834 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6767d8-7928-46ac-8005-a0f95a391c14 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:39.551306 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f822e644-93bd-436c-b097-516f717a2931 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:39.591843 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f8c79a-9a6b-4032-8674-e9cc6c69c9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:39.592566 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8c79a-9a6b-4032-8674-e9cc6c69c9a0 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:39.592848 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8c79a-9a6b-4032-8674-e9cc6c69c9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:39.593121 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8c79a-9a6b-4032-8674-e9cc6c69c9a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:39.608734 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f8c79a-9a6b-4032-8674-e9cc6c69c9a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:39.612574 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f8c79a-9a6b-4032-8674-e9cc6c69c9a0 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:39.629512 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-65f8c79a-9a6b-4032-8674-e9cc6c69c9a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:39.629512 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:39.629512 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:39.629512 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:39.629512 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:39.629512 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:39.629512 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:39.629512 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:39.629512 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:39.629512 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:39.629512 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:39.629512 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:39.629512 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:39.629512 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:39.629512 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:39.629512 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:39.630533 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:39.630533 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:39.630533 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:39.630533 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:39.630533 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:39.630533 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:39.630533 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:39.630533 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:39.630533 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:39.630533 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:39.630533 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:39.630533 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:39.630533 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:39.630533 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:39.630533 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:39.630533 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:39.630533 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:39.631443 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:39.631443 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:39.631443 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:39.631443 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 428/833] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:39.643248 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f8c79a-9a6b-4032-8674-e9cc6c69c9a0 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:39.653456 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6767d8-7928-46ac-8005-a0f95a391c14 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:39.702488 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e883b4-a690-4ae6-9bab-316a1c1e4511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:39.703021 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e883b4-a690-4ae6-9bab-316a1c1e4511 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:39.703350 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e883b4-a690-4ae6-9bab-316a1c1e4511 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:39.703628 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e883b4-a690-4ae6-9bab-316a1c1e4511 None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:39.704274 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e883b4-a690-4ae6-9bab-316a1c1e4511 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:39.704696 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e883b4-a690-4ae6-9bab-316a1c1e4511 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:39.706209 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e883b4-a690-4ae6-9bab-316a1c1e4511 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:39.724929 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 406/834] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:39.724929 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0a7aa-c338-484a-8f3d-6ac64e1da732 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:39.724929 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0a7aa-c338-484a-8f3d-6ac64e1da732 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:39.724929 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0a7aa-c338-484a-8f3d-6ac64e1da732 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:39.724929 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 407/835] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:43:39.725868 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e0a7aa-c338-484a-8f3d-6ac64e1da732 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:39.735283 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:39.773329 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f8c79a-9a6b-4032-8674-e9cc6c69c9a0 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:39.788881 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:39.815059 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389dedad-ddc6-47fa-8b19-e1d7987a9aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:39.815675 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389dedad-ddc6-47fa-8b19-e1d7987a9aa5 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:39.815959 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389dedad-ddc6-47fa-8b19-e1d7987a9aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:39.816233 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389dedad-ddc6-47fa-8b19-e1d7987a9aa5 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:39.816981 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389dedad-ddc6-47fa-8b19-e1d7987a9aa5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:39.817297 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389dedad-ddc6-47fa-8b19-e1d7987a9aa5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:39.818695 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389dedad-ddc6-47fa-8b19-e1d7987a9aa5 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:39.830030 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e0a7aa-c338-484a-8f3d-6ac64e1da732 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:39.838205 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 429/836] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:39.838205 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c1e04-1836-4cca-959e-849cbdf1b58d None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:39.838205 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c1e04-1836-4cca-959e-849cbdf1b58d None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:39.838205 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c1e04-1836-4cca-959e-849cbdf1b58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:39.856077 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-b99c1e04-1836-4cca-959e-849cbdf1b58d None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:39.857530 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-b99c1e04-1836-4cca-959e-849cbdf1b58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:39.866898 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ea37a-7a98-459e-8302-e0ea0fa4cd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:39.867533 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ea37a-7a98-459e-8302-e0ea0fa4cd4a None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:39.867813 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ea37a-7a98-459e-8302-e0ea0fa4cd4a None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:39.868080 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ea37a-7a98-459e-8302-e0ea0fa4cd4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:39.876123 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3ea37a-7a98-459e-8302-e0ea0fa4cd4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:39.877562 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3ea37a-7a98-459e-8302-e0ea0fa4cd4a None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:39.888974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-ea3ea37a-7a98-459e-8302-e0ea0fa4cd4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:39.888974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:39.888974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:39.888974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:39.888974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:39.888974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:39.888974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:39.888974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:39.888974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:39.888974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:39.888974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:39.888974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:39.888974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:43:39.888974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:43:39.888974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:43:39.889849 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:43:39.889849 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:39.889849 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:39.889849 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:39.889849 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:39.889849 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:39.889849 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:39.889849 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:39.889849 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:39.889849 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:39.889849 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:39.889849 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:39.889849 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:39.889849 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:39.889849 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:39.889849 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:39.889849 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:39.890804 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:43:39.890804 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:43:39.890804 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:43:39.890804 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:43:39.890804 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:43:39.890804 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:43:39.890804 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:39.890804 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:39.890804 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 408/837] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:43:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:39.891754 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ea37a-7a98-459e-8302-e0ea0fa4cd4a None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:39.940794 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 430/838] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:39 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:43:39.942011 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c1e04-1836-4cca-959e-849cbdf1b58d None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:39.966210 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:40.004607 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ea37a-7a98-459e-8302-e0ea0fa4cd4a None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:40.041555 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c0b95c-8ead-485d-8a1e-00274d48b5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:40.042654 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0b95c-8ead-485d-8a1e-00274d48b5ed None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:40.043754 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0b95c-8ead-485d-8a1e-00274d48b5ed None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:40.044225 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0b95c-8ead-485d-8a1e-00274d48b5ed None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:40.052518 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c1e04-1836-4cca-959e-849cbdf1b58d None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:40.053578 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c0b95c-8ead-485d-8a1e-00274d48b5ed None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:40.054028 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:40.056657 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c0b95c-8ead-485d-8a1e-00274d48b5ed None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:40.070412 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-41c0b95c-8ead-485d-8a1e-00274d48b5ed None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 15:43:40.070412 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:40.070412 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:40.070412 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:40.070412 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:40.070412 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:40.070412 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:40.070412 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:40.070412 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:40.070412 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:40.070412 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:40.070412 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:40.070412 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:43:40.070412 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:43:40.070412 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:43:40.070412 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:43:40.071408 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:40.071408 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:40.071408 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:43:40.071408 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:40.071408 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:43:40.071408 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:40.071408 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:40.071408 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:40.071408 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:40.071408 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:40.071408 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:40.071408 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:40.071408 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:40.071408 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:40.071408 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:40.071408 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:40.071408 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:40.071408 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:40.072338 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:40.072338 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:40.072338 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:43:40.072338 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:43:40.072338 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:43:40.072338 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:43:40.072338 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:43:40.072338 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:43:40.072338 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 15:43:40.072338 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:40.075438 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 409/839] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Sep 7 15:43:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:40.082224 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c0b95c-8ead-485d-8a1e-00274d48b5ed None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:40.097572 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363e876-aa17-4d0d-ab8a-7b18532f0714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:40.098556 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363e876-aa17-4d0d-ab8a-7b18532f0714 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:40.098989 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363e876-aa17-4d0d-ab8a-7b18532f0714 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:40.099415 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363e876-aa17-4d0d-ab8a-7b18532f0714 None admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:40.100305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8363e876-aa17-4d0d-ab8a-7b18532f0714 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:40.100805 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8363e876-aa17-4d0d-ab8a-7b18532f0714 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:40.102522 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8363e876-aa17-4d0d-ab8a-7b18532f0714 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:40.117644 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 431/840] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 7 15:43:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:40.124438 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363e876-aa17-4d0d-ab8a-7b18532f0714 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:40.212791 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c0b95c-8ead-485d-8a1e-00274d48b5ed None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:40.238726 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:40.248593 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e280a-a5e7-42e4-a8b0-6770fedbe042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:40.249197 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e280a-a5e7-42e4-a8b0-6770fedbe042 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:40.249476 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e280a-a5e7-42e4-a8b0-6770fedbe042 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:40.249748 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e280a-a5e7-42e4-a8b0-6770fedbe042 None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:40.249990 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363e876-aa17-4d0d-ab8a-7b18532f0714 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:40.250505 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e280a-a5e7-42e4-a8b0-6770fedbe042 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:40.250807 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e280a-a5e7-42e4-a8b0-6770fedbe042 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:40.252217 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e280a-a5e7-42e4-a8b0-6770fedbe042 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:40.269278 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 410/841] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Sep 7 15:43:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:40.270482 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5ea97-4936-4512-956a-a16ab449d53d None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:40.270761 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5ea97-4936-4512-956a-a16ab449d53d None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:40.271030 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5ea97-4936-4512-956a-a16ab449d53d None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:40.272494 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 411/842] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:43:40.273184 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5ea97-4936-4512-956a-a16ab449d53d None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:40.288349 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b842b415-4841-49a0-9cec-9a4e2347735a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:40.289160 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842b415-4841-49a0-9cec-9a4e2347735a None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:40.289442 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842b415-4841-49a0-9cec-9a4e2347735a None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:40.289715 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842b415-4841-49a0-9cec-9a4e2347735a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:40.290466 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b842b415-4841-49a0-9cec-9a4e2347735a None admin] RBAC: Adding query filter params (role.id=61605ebf17e643258730e55bf6db15ad, scope.project.id=488830167943488f85743236584113d7, user.id=f9b13331a5fd48f5a2521ed1600f9f35) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:40.290778 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b842b415-4841-49a0-9cec-9a4e2347735a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:40.292202 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b842b415-4841-49a0-9cec-9a4e2347735a None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:40.298718 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 432/843] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 7 15:43:40 2022] GET /identity/v3/role_assignments?user.id=f9b13331a5fd48f5a2521ed1600f9f35&scope.project.id=488830167943488f85743236584113d7&role.id=61605ebf17e643258730e55bf6db15ad => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:40.299488 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b842b415-4841-49a0-9cec-9a4e2347735a None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:40.335061 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:40.396698 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5ea97-4936-4512-956a-a16ab449d53d None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:40.426325 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b842b415-4841-49a0-9cec-9a4e2347735a None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:40.435893 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd207aa-b079-491c-9239-3f37f0bef877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:40.436542 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd207aa-b079-491c-9239-3f37f0bef877 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:40.436825 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd207aa-b079-491c-9239-3f37f0bef877 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:40.437102 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd207aa-b079-491c-9239-3f37f0bef877 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:40.448901 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd207aa-b079-491c-9239-3f37f0bef877 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:43:40.453974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-3cd207aa-b079-491c-9239-3f37f0bef877 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:43:40.453974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:40.453974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:40.453974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:40.453974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:40.453974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:40.453974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:40.453974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:40.453974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:40.453974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:40.453974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:40.453974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:40.453974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:43:40.453974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:43:40.453974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:43:40.453974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:43:40.455247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:43:40.455247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:43:40.455247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:43:40.455247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:43:40.455247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:40.455247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:40.455247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:40.455247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:40.455247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:40.455247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:40.455247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:40.455247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:40.455247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:40.455247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:40.455247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:40.455247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:40.456094 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:40.456094 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:40.456094 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:40.456094 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:40.456094 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:43:40.456094 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:43:40.456094 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:43:40.456094 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:43:40.456094 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:43:40.456094 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:43:40.456094 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:43:40.456094 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:40.456094 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 412/844] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 7 15:43:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:40.456792 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf9efa-1cd7-4fb2-80f2-f2c1dd1b00b6 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:40.456792 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf9efa-1cd7-4fb2-80f2-f2c1dd1b00b6 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:40.456926 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf9efa-1cd7-4fb2-80f2-f2c1dd1b00b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:40.474217 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315cb18c-5bc9-4282-bedb-66969d03af0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:40.474976 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315cb18c-5bc9-4282-bedb-66969d03af0c None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:40.475369 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315cb18c-5bc9-4282-bedb-66969d03af0c None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:40.475735 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315cb18c-5bc9-4282-bedb-66969d03af0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:40.476016 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-05bf9efa-1cd7-4fb2-80f2-f2c1dd1b00b6 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:40.477225 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-05bf9efa-1cd7-4fb2-80f2-f2c1dd1b00b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:40.524519 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:40.552912 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 413/845] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:40 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:43:40.553761 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf9efa-1cd7-4fb2-80f2-f2c1dd1b00b6 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:40.568491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315cb18c-5bc9-4282-bedb-66969d03af0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:40.571646 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315cb18c-5bc9-4282-bedb-66969d03af0c None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:40.610837 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:40.662251 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf9efa-1cd7-4fb2-80f2-f2c1dd1b00b6 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:40.708203 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61310a4c-be62-41c3-8ce3-af5f5ff2d0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:40.709360 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61310a4c-be62-41c3-8ce3-af5f5ff2d0c0 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:40.709853 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61310a4c-be62-41c3-8ce3-af5f5ff2d0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:40.710340 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61310a4c-be62-41c3-8ce3-af5f5ff2d0c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:40.711188 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61310a4c-be62-41c3-8ce3-af5f5ff2d0c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:40.716488 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61310a4c-be62-41c3-8ce3-af5f5ff2d0c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:40.716618 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 433/846] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:43:40 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 15:43:40.716718 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61310a4c-be62-41c3-8ce3-af5f5ff2d0c0 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:40.718976 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315cb18c-5bc9-4282-bedb-66969d03af0c None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:40.731302 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 414/847] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:43:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:40.739577 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61310a4c-be62-41c3-8ce3-af5f5ff2d0c0 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:40.785454 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:40.851146 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315cb18c-5bc9-4282-bedb-66969d03af0c None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:40.865329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61310a4c-be62-41c3-8ce3-af5f5ff2d0c0 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:40.879983 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:40.890235 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f38d8-cdee-470c-a8af-ed1fde50bdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:40.890864 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f38d8-cdee-470c-a8af-ed1fde50bdf2 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:40.891158 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f38d8-cdee-470c-a8af-ed1fde50bdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:40.891408 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f38d8-cdee-470c-a8af-ed1fde50bdf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:40.902157 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825f38d8-cdee-470c-a8af-ed1fde50bdf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:40.903513 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22b4c0-b985-4386-ace5-8ea2be04045b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:40.903776 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825f38d8-cdee-470c-a8af-ed1fde50bdf2 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:40.904153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22b4c0-b985-4386-ace5-8ea2be04045b None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:40.904435 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22b4c0-b985-4386-ace5-8ea2be04045b None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:40.904705 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22b4c0-b985-4386-ace5-8ea2be04045b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:40.915707 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e22b4c0-b985-4386-ace5-8ea2be04045b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:40.917149 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e22b4c0-b985-4386-ace5-8ea2be04045b None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:40.920455 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-825f38d8-cdee-470c-a8af-ed1fde50bdf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:40.920455 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:40.920455 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:40.920455 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:40.920455 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:40.920455 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:40.920455 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:40.920455 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:40.920455 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:40.920455 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:40.920455 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:40.920455 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:40.920455 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:40.920455 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:40.920455 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:40.920455 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:40.921486 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:40.921486 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:40.921486 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:40.921486 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:40.921486 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:40.921486 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:40.921486 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:40.921486 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:40.921486 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:40.921486 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:40.921486 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:40.921486 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:40.921486 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:40.921486 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:40.921486 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:40.921486 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:40.921486 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:40.922605 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:40.922605 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:40.922605 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:40.923949 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 434/848] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:40.924849 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f38d8-cdee-470c-a8af-ed1fde50bdf2 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:40.937500 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-8e22b4c0-b985-4386-ace5-8ea2be04045b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:40.937500 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:40.937500 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:40.937500 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:40.937500 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:40.937500 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:40.937500 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:40.937500 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:40.937500 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:40.937500 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:40.937500 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:40.937500 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:40.937500 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:40.937500 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:40.937500 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:40.937500 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:40.938487 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:40.938487 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:40.938487 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:40.938487 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:40.938487 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:40.938487 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:40.938487 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:40.938487 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:40.938487 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:40.938487 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:40.938487 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:40.938487 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:40.938487 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:40.938487 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:40.938487 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:40.938487 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:40.938487 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:40.939385 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:40.939385 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:40.939385 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:40.939385 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 415/849] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:43:40.939385 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22b4c0-b985-4386-ace5-8ea2be04045b None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:41.038117 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f38d8-cdee-470c-a8af-ed1fde50bdf2 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:41.045067 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:41.058096 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22b4c0-b985-4386-ace5-8ea2be04045b None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:41.077237 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0752f90f-1b43-43e1-adf9-0c14a043a605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:41.077895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752f90f-1b43-43e1-adf9-0c14a043a605 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:41.078206 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752f90f-1b43-43e1-adf9-0c14a043a605 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:41.078477 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752f90f-1b43-43e1-adf9-0c14a043a605 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:41.079056 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0752f90f-1b43-43e1-adf9-0c14a043a605 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:41.080419 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0752f90f-1b43-43e1-adf9-0c14a043a605 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:41.089945 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-0752f90f-1b43-43e1-adf9-0c14a043a605 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 15:43:41.089945 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:41.089945 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 15:43:41.089945 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 15:43:41.089945 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 15:43:41.089945 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 15:43:41.089945 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 15:43:41.089945 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:43:41.089945 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 15:43:41.089945 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:41.089945 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:43:41.089945 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:41.089945 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:41.089945 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:41.089945 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:41.089945 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:41.089945 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:41.091378 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:41.091378 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:41.091378 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:41.091378 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:41.091378 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:41.091378 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:41.091378 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 15:43:41.091378 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 15:43:41.091378 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 15:43:41.091378 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 15:43:41.091378 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:41.091378 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:41.091378 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:41.091378 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:41.091378 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:41.091378 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:41.092322 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:41.092322 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:41.092322 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:41.092322 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:41.092322 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:41.092322 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:41.092322 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:41.092322 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:41.092322 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:41.092322 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:41.092322 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 15:43:41.092322 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:43:41.092322 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 15:43:41.092322 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:41.092322 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 435/850] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 7 15:43:40 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:41.093873 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0752f90f-1b43-43e1-adf9-0c14a043a605 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:41.106860 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c11c8-e7e2-4545-abc1-8d4ef951ed60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:41.107553 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c11c8-e7e2-4545-abc1-8d4ef951ed60 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:41.108098 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c11c8-e7e2-4545-abc1-8d4ef951ed60 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:41.108371 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c11c8-e7e2-4545-abc1-8d4ef951ed60 None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:41.109031 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0c11c8-e7e2-4545-abc1-8d4ef951ed60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:41.109332 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0c11c8-e7e2-4545-abc1-8d4ef951ed60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:41.110731 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0c11c8-e7e2-4545-abc1-8d4ef951ed60 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:41.124801 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 416/851] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:41.129799 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c11c8-e7e2-4545-abc1-8d4ef951ed60 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:41.139506 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:41.202622 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0752f90f-1b43-43e1-adf9-0c14a043a605 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:41.240674 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c11c8-e7e2-4545-abc1-8d4ef951ed60 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:41.243757 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb14ef-185a-407a-a8dd-b0208f590552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:41.244376 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb14ef-185a-407a-a8dd-b0208f590552 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:41.244656 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb14ef-185a-407a-a8dd-b0208f590552 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:41.244934 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb14ef-185a-407a-a8dd-b0208f590552 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:41.245578 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccb14ef-185a-407a-a8dd-b0208f590552 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:41.245881 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccb14ef-185a-407a-a8dd-b0208f590552 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:41.248295 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccb14ef-185a-407a-a8dd-b0208f590552 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:41.261024 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 436/852] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:41.262788 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb14ef-185a-407a-a8dd-b0208f590552 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:41.289018 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ff9e9-5bfd-4628-b99a-02fe180aa997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:41.289827 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ff9e9-5bfd-4628-b99a-02fe180aa997 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:41.290117 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ff9e9-5bfd-4628-b99a-02fe180aa997 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:41.290571 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ff9e9-5bfd-4628-b99a-02fe180aa997 None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:41.291521 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ff9e9-5bfd-4628-b99a-02fe180aa997 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:41.291843 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ff9e9-5bfd-4628-b99a-02fe180aa997 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:41.293517 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ff9e9-5bfd-4628-b99a-02fe180aa997 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:41.302555 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 417/853] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 7 15:43:41 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:41.303397 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ff9e9-5bfd-4628-b99a-02fe180aa997 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:41.321231 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:41.374337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb14ef-185a-407a-a8dd-b0208f590552 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:41.376125 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:41.413337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d182a7b-7081-434f-af3d-bd75615260be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:41.413964 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d182a7b-7081-434f-af3d-bd75615260be None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:41.414277 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d182a7b-7081-434f-af3d-bd75615260be None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:41.414557 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d182a7b-7081-434f-af3d-bd75615260be None admin] PATH_INFO: `/v3/projects/service` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:41.415082 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ff9e9-5bfd-4628-b99a-02fe180aa997 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:41.422031 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d182a7b-7081-434f-af3d-bd75615260be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:41.423508 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d182a7b-7081-434f-af3d-bd75615260be None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:41.435774 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-2d182a7b-7081-434f-af3d-bd75615260be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:41.435774 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:41.435774 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:41.435774 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:41.435774 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:41.435774 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:41.435774 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:41.435774 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:41.435774 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:41.435774 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:41.435774 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:41.435774 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:41.435774 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:43:41.435774 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:43:41.435774 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:43:41.436694 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:43:41.436694 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:41.436694 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:41.436694 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:41.436694 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:41.436694 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:41.436694 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:41.436694 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:41.436694 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:41.436694 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:41.436694 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:41.436694 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:41.436694 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:41.436694 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:41.436694 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:41.436694 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:41.436694 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:41.437579 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:43:41.437579 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:43:41.437579 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:43:41.437579 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:43:41.437579 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:43:41.437579 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:43:41.437579 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:41.437579 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:41.437579 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 437/854] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:43:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:41.438092 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d182a7b-7081-434f-af3d-bd75615260be None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:41.456514 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aabe4bd-acfe-48eb-ae10-1ac6e598d7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:41.457370 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aabe4bd-acfe-48eb-ae10-1ac6e598d7bf None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:41.457730 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aabe4bd-acfe-48eb-ae10-1ac6e598d7bf None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:41.458080 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aabe4bd-acfe-48eb-ae10-1ac6e598d7bf None admin] PATH_INFO: `/v3/users/swift` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:41.466359 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aabe4bd-acfe-48eb-ae10-1ac6e598d7bf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:41.467877 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aabe4bd-acfe-48eb-ae10-1ac6e598d7bf None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:41.479153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-3aabe4bd-acfe-48eb-ae10-1ac6e598d7bf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 07 15:43:41.479153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:41.479153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:41.479153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:41.479153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:41.479153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:41.479153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:41.479153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:41.479153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:41.479153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:41.479153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:41.479153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:41.479153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:43:41.479153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:43:41.479153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:43:41.479153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:43:41.480294 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:41.480294 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:41.480294 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:43:41.480294 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:41.480294 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:43:41.480294 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:41.480294 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:41.480294 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:41.480294 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:41.480294 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:41.480294 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:41.480294 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:41.480294 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:41.480294 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:41.480294 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:41.480294 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:41.480294 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:41.480294 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:41.481575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:41.481575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:41.481575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:43:41.481575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:43:41.481575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:43:41.481575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:43:41.481575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:43:41.481575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:43:41.481575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 07 15:43:41.481575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:41.487240 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 418/855] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 7 15:43:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:41.487880 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aabe4bd-acfe-48eb-ae10-1ac6e598d7bf None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:41.552504 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d182a7b-7081-434f-af3d-bd75615260be None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:41.561609 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:41.589915 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff71433a-3d8b-48ac-af39-5c47c2917df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:41.590725 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71433a-3d8b-48ac-af39-5c47c2917df3 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:41.591098 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71433a-3d8b-48ac-af39-5c47c2917df3 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:41.591461 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71433a-3d8b-48ac-af39-5c47c2917df3 None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:41.592194 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff71433a-3d8b-48ac-af39-5c47c2917df3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:41.592585 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff71433a-3d8b-48ac-af39-5c47c2917df3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:41.594025 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff71433a-3d8b-48ac-af39-5c47c2917df3 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:41.594614 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aabe4bd-acfe-48eb-ae10-1ac6e598d7bf None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:41.606523 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 438/856] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 7 15:43:41 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:41.606523 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff71433a-3d8b-48ac-af39-5c47c2917df3 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:41.640981 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:41.657458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9aa04d-c419-4897-bcff-485d64676882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:41.658102 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9aa04d-c419-4897-bcff-485d64676882 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:41.658412 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9aa04d-c419-4897-bcff-485d64676882 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:41.658692 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9aa04d-c419-4897-bcff-485d64676882 None admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:41.659414 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9aa04d-c419-4897-bcff-485d64676882 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:41.660369 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9aa04d-c419-4897-bcff-485d64676882 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:41.662394 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9aa04d-c419-4897-bcff-485d64676882 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:41.682042 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 419/857] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 7 15:43:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:41.690111 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9aa04d-c419-4897-bcff-485d64676882 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:41.751634 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff71433a-3d8b-48ac-af39-5c47c2917df3 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:41.794715 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0aa0b-3378-4359-af51-637d644f1a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:41.795339 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0aa0b-3378-4359-af51-637d644f1a09 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:41.795904 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0aa0b-3378-4359-af51-637d644f1a09 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:41.796189 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0aa0b-3378-4359-af51-637d644f1a09 None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:41.796927 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0aa0b-3378-4359-af51-637d644f1a09 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:41.797392 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0aa0b-3378-4359-af51-637d644f1a09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:41.799399 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0aa0b-3378-4359-af51-637d644f1a09 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:41.822968 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 439/858] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Sep 7 15:43:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:41.823147 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9aa04d-c419-4897-bcff-485d64676882 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:41.825172 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0aa0b-3378-4359-af51-637d644f1a09 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:41.856797 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:41.861150 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fbd8c0-33e6-4f0e-bab4-61494e4084ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:41.861762 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbd8c0-33e6-4f0e-bab4-61494e4084ee None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:41.862044 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbd8c0-33e6-4f0e-bab4-61494e4084ee None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:41.862457 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbd8c0-33e6-4f0e-bab4-61494e4084ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:41.863602 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fbd8c0-33e6-4f0e-bab4-61494e4084ee None admin] RBAC: Adding query filter params (role.id=a420b17212b94988beb75affe974355b, scope.project.id=488830167943488f85743236584113d7, user.id=3e20e40a37df4898bfe692535e5e4f25) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:41.864096 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fbd8c0-33e6-4f0e-bab4-61494e4084ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:41.865640 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fbd8c0-33e6-4f0e-bab4-61494e4084ee None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:41.872590 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 420/859] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 7 15:43:41 2022] GET /identity/v3/role_assignments?user.id=3e20e40a37df4898bfe692535e5e4f25&scope.project.id=488830167943488f85743236584113d7&role.id=a420b17212b94988beb75affe974355b => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:43:41.926539 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:41.947314 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0aa0b-3378-4359-af51-637d644f1a09 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:41.989662 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d5930-8ff3-4353-a688-dc33907e625a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:41.990313 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d5930-8ff3-4353-a688-dc33907e625a None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:41.990598 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d5930-8ff3-4353-a688-dc33907e625a None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:41.990875 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d5930-8ff3-4353-a688-dc33907e625a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:42.071847 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d5930-8ff3-4353-a688-dc33907e625a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:42.073355 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d5930-8ff3-4353-a688-dc33907e625a None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:42.169811 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:42.192815 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 440/860] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:43:41 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 15:43:42.198541 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fbd8c0-33e6-4f0e-bab4-61494e4084ee None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:42.304487 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fbd8c0-33e6-4f0e-bab4-61494e4084ee None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:42.341731 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbe7366-b201-4752-8377-730e67c6611b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:42.342321 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe7366-b201-4752-8377-730e67c6611b None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:42.342611 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe7366-b201-4752-8377-730e67c6611b None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:42.342873 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe7366-b201-4752-8377-730e67c6611b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:42.354237 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbe7366-b201-4752-8377-730e67c6611b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:42.356238 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbe7366-b201-4752-8377-730e67c6611b None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:42.371543 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-ebbe7366-b201-4752-8377-730e67c6611b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:42.371543 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:42.371543 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:42.371543 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:42.371543 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:42.371543 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:42.371543 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:42.371543 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:42.371543 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:42.371543 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:42.371543 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:42.371543 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:42.371543 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:42.371543 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:42.371543 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:42.371543 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:42.372894 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:42.372894 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:42.372894 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:42.372894 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:42.372894 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:42.372894 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:42.372894 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:42.372894 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:42.372894 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:42.372894 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:42.372894 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:42.372894 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:42.372894 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:42.372894 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:42.372894 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:42.372894 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:42.372894 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:42.374425 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:42.374425 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:42.374425 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:42.374425 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 421/861] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:42.378843 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d5930-8ff3-4353-a688-dc33907e625a None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:42.493861 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d5930-8ff3-4353-a688-dc33907e625a None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:42.531977 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff1e52d-f94f-411d-b320-213bc58710fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:42.532945 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1e52d-f94f-411d-b320-213bc58710fc None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:42.533441 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1e52d-f94f-411d-b320-213bc58710fc None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:42.533908 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1e52d-f94f-411d-b320-213bc58710fc None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:42.534783 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff1e52d-f94f-411d-b320-213bc58710fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:42.535320 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff1e52d-f94f-411d-b320-213bc58710fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:42.536879 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff1e52d-f94f-411d-b320-213bc58710fc None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:42.551323 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 441/862] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:42.558330 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbe7366-b201-4752-8377-730e67c6611b None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:42.572244 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7abef63-1073-4271-b86b-8c8a1b66d35a None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:42.572557 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7abef63-1073-4271-b86b-8c8a1b66d35a None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:42.572809 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7abef63-1073-4271-b86b-8c8a1b66d35a None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:42.574866 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 442/863] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:43:42.580031 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f632fd-b82b-4448-9b3b-d15474b488a4 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:42.580316 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f632fd-b82b-4448-9b3b-d15474b488a4 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:42.580591 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f632fd-b82b-4448-9b3b-d15474b488a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:42.602027 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-15f632fd-b82b-4448-9b3b-d15474b488a4 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:42.603207 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-15f632fd-b82b-4448-9b3b-d15474b488a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:42.621127 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:42.663177 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:42.682878 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbe7366-b201-4752-8377-730e67c6611b None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:42.702275 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 443/864] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:42 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:43:42.725945 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc402a4-6b8a-4307-b6ff-cb6a8ac75df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:42.726927 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc402a4-6b8a-4307-b6ff-cb6a8ac75df0 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:42.727398 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc402a4-6b8a-4307-b6ff-cb6a8ac75df0 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:42.727854 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc402a4-6b8a-4307-b6ff-cb6a8ac75df0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:42.735703 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc402a4-6b8a-4307-b6ff-cb6a8ac75df0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:42.737440 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc402a4-6b8a-4307-b6ff-cb6a8ac75df0 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:42.750412 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-cdc402a4-6b8a-4307-b6ff-cb6a8ac75df0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:42.750412 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:42.750412 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:42.750412 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:42.750412 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:42.750412 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:42.750412 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:42.750412 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:42.750412 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:42.750412 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:42.750412 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:42.750412 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:42.750412 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:43:42.750412 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:43:42.750412 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:43:42.751302 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:43:42.751302 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:42.751302 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:42.751302 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:42.751302 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:42.751302 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:42.751302 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:42.751302 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:42.751302 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:42.751302 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:42.751302 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:42.751302 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:42.751302 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:42.751302 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:42.751302 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:42.751302 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:42.751302 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:42.752183 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:43:42.752183 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:43:42.752183 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:43:42.752183 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:43:42.752183 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:43:42.752183 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:43:42.752183 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:42.752183 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:42.754207 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 422/865] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:43:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:42.760251 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f632fd-b82b-4448-9b3b-d15474b488a4 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:42.870120 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f632fd-b82b-4448-9b3b-d15474b488a4 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:42.908819 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a37503-e616-45ff-85b9-fab2ae55fdd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:42.909692 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a37503-e616-45ff-85b9-fab2ae55fdd0 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:42.910197 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a37503-e616-45ff-85b9-fab2ae55fdd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:42.910578 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a37503-e616-45ff-85b9-fab2ae55fdd0 None admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:42.911305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a37503-e616-45ff-85b9-fab2ae55fdd0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:42.911614 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a37503-e616-45ff-85b9-fab2ae55fdd0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:42.913045 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a37503-e616-45ff-85b9-fab2ae55fdd0 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:42.930513 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 444/866] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 7 15:43:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:43:42.937853 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc402a4-6b8a-4307-b6ff-cb6a8ac75df0 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:42.985150 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a37503-e616-45ff-85b9-fab2ae55fdd0 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:43.021988 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:43.051845 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc402a4-6b8a-4307-b6ff-cb6a8ac75df0 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:43.061880 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:43.089855 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d5369-e5c6-46e1-a217-9ce9bdb55ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:43.090875 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d5369-e5c6-46e1-a217-9ce9bdb55ddc None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:43.091264 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d5369-e5c6-46e1-a217-9ce9bdb55ddc None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:43.091701 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d5369-e5c6-46e1-a217-9ce9bdb55ddc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:43.092527 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0d5369-e5c6-46e1-a217-9ce9bdb55ddc None admin] RBAC: Adding query filter params (role.id=61605ebf17e643258730e55bf6db15ad, scope.project.id=488830167943488f85743236584113d7, user.id=16c4b090a4aa4d56a90ccf090b9caba8) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:43.092937 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0d5369-e5c6-46e1-a217-9ce9bdb55ddc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:43.094495 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0d5369-e5c6-46e1-a217-9ce9bdb55ddc None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:43.100901 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 423/867] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 7 15:43:42 2022] GET /identity/v3/role_assignments?user.id=16c4b090a4aa4d56a90ccf090b9caba8&scope.project.id=488830167943488f85743236584113d7&role.id=61605ebf17e643258730e55bf6db15ad => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:43.112356 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a37503-e616-45ff-85b9-fab2ae55fdd0 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:43.153087 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271a714-6b82-4c60-8301-9d9ac485bd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:43.153983 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271a714-6b82-4c60-8301-9d9ac485bd5f None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:43.154450 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271a714-6b82-4c60-8301-9d9ac485bd5f None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:43.154866 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271a714-6b82-4c60-8301-9d9ac485bd5f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:43.155648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5271a714-6b82-4c60-8301-9d9ac485bd5f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:43.157282 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5271a714-6b82-4c60-8301-9d9ac485bd5f None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:43.168472 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-5271a714-6b82-4c60-8301-9d9ac485bd5f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 15:43:43.168472 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:43.168472 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 15:43:43.168472 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 15:43:43.168472 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 15:43:43.168472 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 15:43:43.168472 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 15:43:43.168472 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:43:43.168472 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 15:43:43.168472 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:43.168472 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:43:43.168472 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:43.168472 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:43.168472 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:43.168472 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:43.168472 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:43.169587 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:43.169587 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:43.169587 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:43.169587 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:43.169587 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:43.169587 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:43.169587 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:43.169587 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 15:43:43.169587 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 15:43:43.169587 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 15:43:43.169587 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 15:43:43.169587 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:43.169587 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:43.169587 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:43.169587 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:43.169587 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:43.169587 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:43.170658 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:43.170658 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:43.170658 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:43.170658 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:43.170658 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:43.170658 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:43.170658 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:43.170658 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:43.170658 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:43.170658 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:43.170658 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 15:43:43.170658 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:43:43.170658 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 15:43:43.170658 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:43.177962 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 445/868] 10.222.0.16 () {56 vars in 1132 bytes} [Wed Sep 7 15:43:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:43.179592 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d5369-e5c6-46e1-a217-9ce9bdb55ddc None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:43.299862 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d5369-e5c6-46e1-a217-9ce9bdb55ddc None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:43.336504 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce23fc2-cda1-4cea-ba78-51c2f07d83c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:43.337119 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce23fc2-cda1-4cea-ba78-51c2f07d83c7 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:43.337403 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce23fc2-cda1-4cea-ba78-51c2f07d83c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:43.337678 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce23fc2-cda1-4cea-ba78-51c2f07d83c7 None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:43.338350 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce23fc2-cda1-4cea-ba78-51c2f07d83c7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:43.338656 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce23fc2-cda1-4cea-ba78-51c2f07d83c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:43.340179 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce23fc2-cda1-4cea-ba78-51c2f07d83c7 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:43.345560 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 424/869] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Sep 7 15:43:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:43.351308 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271a714-6b82-4c60-8301-9d9ac485bd5f None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:43.458403 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:43.462540 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271a714-6b82-4c60-8301-9d9ac485bd5f None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:43.501152 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898cc3eb-7dcd-4fbc-b760-105b7c8f83c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:43.501776 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898cc3eb-7dcd-4fbc-b760-105b7c8f83c7 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:43.502058 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898cc3eb-7dcd-4fbc-b760-105b7c8f83c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:43.502366 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898cc3eb-7dcd-4fbc-b760-105b7c8f83c7 None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:43.503000 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898cc3eb-7dcd-4fbc-b760-105b7c8f83c7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:43.503305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898cc3eb-7dcd-4fbc-b760-105b7c8f83c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:43.504666 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898cc3eb-7dcd-4fbc-b760-105b7c8f83c7 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:43.509586 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 446/870] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Sep 7 15:43:43 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:43.864176 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10044693-7d55-47c6-8298-1b76548ba775 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:43.864684 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10044693-7d55-47c6-8298-1b76548ba775 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:43.864684 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10044693-7d55-47c6-8298-1b76548ba775 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:43.866215 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 425/871] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:43:43.871895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090813c-6d75-4295-adde-c9c949e64c5d None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:43.872328 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090813c-6d75-4295-adde-c9c949e64c5d None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:43.872504 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090813c-6d75-4295-adde-c9c949e64c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:43.891664 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-4090813c-6d75-4295-adde-c9c949e64c5d None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:43.892874 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-4090813c-6d75-4295-adde-c9c949e64c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:43.962760 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 447/872] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:43 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:43:44.233465 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10044693-7d55-47c6-8298-1b76548ba775 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:44.260017 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ad72b-8317-42bb-9386-9c177ebe088b None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:44.260735 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ad72b-8317-42bb-9386-9c177ebe088b None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:44.261559 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ad72b-8317-42bb-9386-9c177ebe088b None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:44.264040 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 448/873] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:43:44.270731 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db7191-1a81-4c0d-8940-143ccb9688e7 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:44.271039 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db7191-1a81-4c0d-8940-143ccb9688e7 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:44.271278 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db7191-1a81-4c0d-8940-143ccb9688e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:44.273911 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:44.290914 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-97db7191-1a81-4c0d-8940-143ccb9688e7 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:44.292281 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-97db7191-1a81-4c0d-8940-143ccb9688e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:44.364840 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10044693-7d55-47c6-8298-1b76548ba775 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:44.384985 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 449/874] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:44 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:43:44.409594 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd38cc63-304f-4460-acba-b3e140913a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:44.410593 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd38cc63-304f-4460-acba-b3e140913a61 None admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:44.411082 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd38cc63-304f-4460-acba-b3e140913a61 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:44.411597 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd38cc63-304f-4460-acba-b3e140913a61 None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:44.412458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd38cc63-304f-4460-acba-b3e140913a61 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:44.414020 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd38cc63-304f-4460-acba-b3e140913a61 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:44.431422 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 426/875] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Sep 7 15:43:44 2022] POST /identity/v3/services => generated 251 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:43:44.658104 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db7191-1a81-4c0d-8940-143ccb9688e7 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:44.684318 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:44.765739 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db7191-1a81-4c0d-8940-143ccb9688e7 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:44.807846 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44798ac3-c49b-4620-b047-6a3325ea1c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:44.808542 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44798ac3-c49b-4620-b047-6a3325ea1c74 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:44.808825 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44798ac3-c49b-4620-b047-6a3325ea1c74 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:44.809099 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44798ac3-c49b-4620-b047-6a3325ea1c74 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:44.820125 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44798ac3-c49b-4620-b047-6a3325ea1c74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:43:44.825696 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-44798ac3-c49b-4620-b047-6a3325ea1c74 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 15:43:44.825696 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:44.825696 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:44.825696 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:44.825696 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:44.825696 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:44.825696 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:44.825696 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:44.825696 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:44.825696 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:44.825696 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:44.825696 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:44.825696 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:43:44.825696 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:43:44.825696 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:43:44.825696 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:43:44.826648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:43:44.826648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:43:44.826648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:43:44.826648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:43:44.826648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:44.826648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:44.826648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:44.826648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:44.826648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:44.826648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:44.826648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:44.826648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:44.826648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:44.826648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:44.826648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:44.826648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:44.827518 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:44.827518 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:44.827518 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:44.827518 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:44.827518 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:43:44.827518 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:43:44.827518 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:43:44.827518 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:43:44.827518 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:43:44.827518 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:43:44.827518 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 15:43:44.827518 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:44.827518 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 450/876] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Sep 7 15:43:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:44.833175 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd38cc63-304f-4460-acba-b3e140913a61 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:44.933255 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:44.940540 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd38cc63-304f-4460-acba-b3e140913a61 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:44.978547 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ad1c1-0dc0-4d97-b35c-b9c8b5566051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:44.979162 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ad1c1-0dc0-4d97-b35c-b9c8b5566051 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:44.979447 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ad1c1-0dc0-4d97-b35c-b9c8b5566051 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:44.979725 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ad1c1-0dc0-4d97-b35c-b9c8b5566051 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:44.980507 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878ad1c1-0dc0-4d97-b35c-b9c8b5566051 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:44.981003 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878ad1c1-0dc0-4d97-b35c-b9c8b5566051 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:44.982405 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878ad1c1-0dc0-4d97-b35c-b9c8b5566051 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:44.991697 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 427/877] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Sep 7 15:43:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:44.998070 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44798ac3-c49b-4620-b047-6a3325ea1c74 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:45.092530 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:45.117122 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44798ac3-c49b-4620-b047-6a3325ea1c74 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:45.156467 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb099e6-8aa3-4bec-bd0a-6cae7b0f588a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:45.157115 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb099e6-8aa3-4bec-bd0a-6cae7b0f588a None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:45.157395 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb099e6-8aa3-4bec-bd0a-6cae7b0f588a None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:45.157669 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb099e6-8aa3-4bec-bd0a-6cae7b0f588a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:45.168485 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb099e6-8aa3-4bec-bd0a-6cae7b0f588a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:45.169942 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb099e6-8aa3-4bec-bd0a-6cae7b0f588a None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:45.185895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-1fb099e6-8aa3-4bec-bd0a-6cae7b0f588a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:45.185895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:45.185895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:45.185895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:45.185895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:45.185895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:45.185895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:45.185895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:45.185895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:45.185895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:45.185895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:45.185895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:45.185895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:45.185895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:45.185895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:45.185895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:45.186988 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:45.186988 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:45.186988 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:45.186988 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:45.186988 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:45.186988 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:45.186988 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:45.186988 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:45.186988 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:45.186988 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:45.186988 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:45.186988 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:45.186988 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:45.186988 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:45.186988 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:45.186988 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:45.186988 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:45.188333 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:45.188333 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:45.188333 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:45.188333 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 451/878] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:45.194483 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ad1c1-0dc0-4d97-b35c-b9c8b5566051 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:45.309312 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ad1c1-0dc0-4d97-b35c-b9c8b5566051 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:45.348246 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a2cbe-dd06-4455-981d-65394ca345af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:45.348876 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a2cbe-dd06-4455-981d-65394ca345af None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:45.349159 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a2cbe-dd06-4455-981d-65394ca345af None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:45.349434 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a2cbe-dd06-4455-981d-65394ca345af None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:45.350094 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a2cbe-dd06-4455-981d-65394ca345af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:45.350428 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a2cbe-dd06-4455-981d-65394ca345af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:45.351825 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a2cbe-dd06-4455-981d-65394ca345af None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:45.373226 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 428/879] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:45.378952 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb099e6-8aa3-4bec-bd0a-6cae7b0f588a None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:45.466244 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc237a-2a9b-47c5-93f1-b7de19021057 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:45.466440 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc237a-2a9b-47c5-93f1-b7de19021057 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:45.466720 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc237a-2a9b-47c5-93f1-b7de19021057 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:45.468265 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 429/880] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:43:45.473501 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efb860-9a00-430c-8791-ca68581ee2ac None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:45.473840 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efb860-9a00-430c-8791-ca68581ee2ac None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:45.474119 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efb860-9a00-430c-8791-ca68581ee2ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:45.489267 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb099e6-8aa3-4bec-bd0a-6cae7b0f588a None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:45.493938 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-80efb860-9a00-430c-8791-ca68581ee2ac None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:45.495183 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-80efb860-9a00-430c-8791-ca68581ee2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:45.509217 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:45.521155 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:45.530929 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d389cc5a-d752-4534-9f1a-f8a99742adf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:45.531618 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389cc5a-d752-4534-9f1a-f8a99742adf7 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:45.531954 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389cc5a-d752-4534-9f1a-f8a99742adf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:45.532290 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389cc5a-d752-4534-9f1a-f8a99742adf7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:45.541829 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d389cc5a-d752-4534-9f1a-f8a99742adf7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:45.544441 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d389cc5a-d752-4534-9f1a-f8a99742adf7 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:45.560329 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-d389cc5a-d752-4534-9f1a-f8a99742adf7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 15:43:45.560329 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:45.560329 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:45.560329 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:45.560329 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:45.560329 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:45.560329 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:45.560329 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:45.560329 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:45.560329 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:45.560329 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:45.560329 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:45.560329 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:43:45.560329 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:43:45.560329 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:43:45.560329 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:43:45.561350 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:45.561350 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:45.561350 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:43:45.561350 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:45.561350 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:43:45.561350 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:45.561350 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:45.561350 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:45.561350 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:45.561350 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:45.561350 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:45.561350 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:45.561350 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:45.561350 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:45.561350 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:45.561350 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:45.561350 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:45.561350 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:45.562336 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:45.562336 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:45.562336 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:43:45.562336 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:43:45.562336 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:43:45.562336 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:43:45.562336 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:43:45.562336 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:43:45.562336 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 15:43:45.562336 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:45.562336 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 452/881] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Sep 7 15:43:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:45.567655 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d389cc5a-d752-4534-9f1a-f8a99742adf7 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:45.585157 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 430/882] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:45 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 15:43:45.680230 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d389cc5a-d752-4534-9f1a-f8a99742adf7 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:45.716024 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4834958-8fb7-4e6c-b99a-56ac937973f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:45.716804 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4834958-8fb7-4e6c-b99a-56ac937973f7 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:45.717033 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4834958-8fb7-4e6c-b99a-56ac937973f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:45.717309 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4834958-8fb7-4e6c-b99a-56ac937973f7 None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:45.718057 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4834958-8fb7-4e6c-b99a-56ac937973f7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:45.718399 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4834958-8fb7-4e6c-b99a-56ac937973f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:45.719838 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4834958-8fb7-4e6c-b99a-56ac937973f7 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:45.739496 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 453/883] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Sep 7 15:43:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:43:45.745302 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80efb860-9a00-430c-8791-ca68581ee2ac None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:45.750928 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb34d7d-9a0c-43a9-aac3-bc5b876a4392 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:45.751223 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb34d7d-9a0c-43a9-aac3-bc5b876a4392 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:45.751499 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb34d7d-9a0c-43a9-aac3-bc5b876a4392 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:45.752967 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 454/884] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:43:45.759698 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf51c2-adb9-4d41-8399-fca22e833c48 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:45.759985 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf51c2-adb9-4d41-8399-fca22e833c48 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:45.760264 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf51c2-adb9-4d41-8399-fca22e833c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:45.785438 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-15bf51c2-adb9-4d41-8399-fca22e833c48 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:45.786673 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-15bf51c2-adb9-4d41-8399-fca22e833c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:45.848227 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:45.852808 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80efb860-9a00-430c-8791-ca68581ee2ac None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:45.877918 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 455/885] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:45 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 15:43:45.878617 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf51c2-adb9-4d41-8399-fca22e833c48 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:45.903402 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ba49c-b5c8-4153-a4ef-f6891e919147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:45.904852 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ba49c-b5c8-4153-a4ef-f6891e919147 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:45.905552 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ba49c-b5c8-4153-a4ef-f6891e919147 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:45.906008 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ba49c-b5c8-4153-a4ef-f6891e919147 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:45.929021 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:45.987231 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8ba49c-b5c8-4153-a4ef-f6891e919147 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:45.988822 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8ba49c-b5c8-4153-a4ef-f6891e919147 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:45.993267 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf51c2-adb9-4d41-8399-fca22e833c48 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:46.034744 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3af4e1-2930-48f6-97e9-8b97512c39a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:46.035383 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3af4e1-2930-48f6-97e9-8b97512c39a6 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:46.037428 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3af4e1-2930-48f6-97e9-8b97512c39a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:46.037428 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3af4e1-2930-48f6-97e9-8b97512c39a6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:46.037428 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3af4e1-2930-48f6-97e9-8b97512c39a6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:46.040303 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3af4e1-2930-48f6-97e9-8b97512c39a6 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:46.050640 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-5f3af4e1-2930-48f6-97e9-8b97512c39a6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 15:43:46.050640 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:46.050640 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 15:43:46.050640 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 15:43:46.050640 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 15:43:46.050640 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 15:43:46.050640 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 15:43:46.050640 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:43:46.050640 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 15:43:46.050640 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:46.050640 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:43:46.050640 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:46.050640 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:46.050640 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:46.050640 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:46.050640 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:46.050640 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:46.051719 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:46.051719 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:46.051719 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:46.051719 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:46.051719 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:46.051719 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:46.051719 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 15:43:46.051719 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 15:43:46.051719 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 15:43:46.051719 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 15:43:46.051719 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:46.051719 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:46.051719 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:46.051719 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:46.051719 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:46.051719 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:46.054933 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:46.054933 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:46.054933 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:46.054933 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:46.054933 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:46.054933 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:46.054933 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:46.054933 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:46.054933 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:46.054933 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:46.054933 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 15:43:46.054933 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:43:46.054933 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 15:43:46.054933 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:46.054933 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 456/886] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Sep 7 15:43:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:46.058386 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3af4e1-2930-48f6-97e9-8b97512c39a6 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:46.108606 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:46.142333 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 431/887] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:43:45 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 15:43:46.145395 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ba49c-b5c8-4153-a4ef-f6891e919147 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:46.179342 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3af4e1-2930-48f6-97e9-8b97512c39a6 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:46.196656 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:46.217181 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c0ccc9-b657-44ad-a525-6f2959c91160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:46.217794 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0ccc9-b657-44ad-a525-6f2959c91160 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:46.218080 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0ccc9-b657-44ad-a525-6f2959c91160 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:46.218388 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0ccc9-b657-44ad-a525-6f2959c91160 None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:46.219023 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c0ccc9-b657-44ad-a525-6f2959c91160 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:46.219335 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c0ccc9-b657-44ad-a525-6f2959c91160 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:46.220795 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c0ccc9-b657-44ad-a525-6f2959c91160 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:46.230044 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 457/888] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Sep 7 15:43:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:43:46.230044 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c0ccc9-b657-44ad-a525-6f2959c91160 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:46.258199 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ba49c-b5c8-4153-a4ef-f6891e919147 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:46.295043 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3313f2c-4457-4989-bf4a-7ed8c43aad32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:46.295680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3313f2c-4457-4989-bf4a-7ed8c43aad32 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:46.295959 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3313f2c-4457-4989-bf4a-7ed8c43aad32 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:46.296233 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3313f2c-4457-4989-bf4a-7ed8c43aad32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:46.307711 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3313f2c-4457-4989-bf4a-7ed8c43aad32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:46.309318 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3313f2c-4457-4989-bf4a-7ed8c43aad32 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:46.326228 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-b3313f2c-4457-4989-bf4a-7ed8c43aad32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:46.326228 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:46.326228 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:46.326228 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:46.326228 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:46.326228 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:46.326228 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:46.326228 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:46.326228 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:46.326228 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:46.326228 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:46.326228 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:46.326228 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:46.326228 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:46.326228 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:46.326228 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:46.327236 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:46.327236 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:46.327236 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:46.327236 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:46.327236 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:46.327236 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:46.327236 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:46.327236 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:46.327236 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:46.327236 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:46.327236 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:46.327236 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:46.327236 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:46.327236 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:46.327236 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:46.327236 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:46.327236 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:46.328155 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:46.328155 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:46.328155 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:46.328155 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 432/889] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:46.328155 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3313f2c-4457-4989-bf4a-7ed8c43aad32 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:46.344010 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c0ccc9-b657-44ad-a525-6f2959c91160 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:46.353695 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:46.385624 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f6b06-6644-4212-af98-bb84b8fa4cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:46.386756 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f6b06-6644-4212-af98-bb84b8fa4cc7 None admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:46.387238 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f6b06-6644-4212-af98-bb84b8fa4cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:46.387721 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f6b06-6644-4212-af98-bb84b8fa4cc7 None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:46.388886 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f6b06-6644-4212-af98-bb84b8fa4cc7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:46.391150 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f6b06-6644-4212-af98-bb84b8fa4cc7 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:46.408163 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 458/890] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Sep 7 15:43:46 2022] POST /identity/v3/services => generated 269 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:43:46.409405 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f6b06-6644-4212-af98-bb84b8fa4cc7 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:46.446220 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:46.449729 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3313f2c-4457-4989-bf4a-7ed8c43aad32 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:46.501783 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41837ae5-6757-402d-b38d-9236701c2acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:46.502529 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41837ae5-6757-402d-b38d-9236701c2acb None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:46.502814 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41837ae5-6757-402d-b38d-9236701c2acb None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:46.503091 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41837ae5-6757-402d-b38d-9236701c2acb None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:46.503756 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41837ae5-6757-402d-b38d-9236701c2acb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:46.504104 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41837ae5-6757-402d-b38d-9236701c2acb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:46.505632 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41837ae5-6757-402d-b38d-9236701c2acb None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:46.514336 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 433/891] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Sep 7 15:43:46 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:46.566615 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f6b06-6644-4212-af98-bb84b8fa4cc7 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:46.609531 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba2739-7e95-44a6-9b09-e35530da9660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:46.610505 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba2739-7e95-44a6-9b09-e35530da9660 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:46.610938 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba2739-7e95-44a6-9b09-e35530da9660 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:46.611380 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba2739-7e95-44a6-9b09-e35530da9660 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:46.612223 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ba2739-7e95-44a6-9b09-e35530da9660 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:46.612707 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ba2739-7e95-44a6-9b09-e35530da9660 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:46.614548 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ba2739-7e95-44a6-9b09-e35530da9660 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:46.631148 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 459/892] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:46.637300 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41837ae5-6757-402d-b38d-9236701c2acb None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:46.756023 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41837ae5-6757-402d-b38d-9236701c2acb None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:46.792416 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab3c83-f058-47b3-9240-74f34a8cbc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:46.793884 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab3c83-f058-47b3-9240-74f34a8cbc22 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:46.794427 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab3c83-f058-47b3-9240-74f34a8cbc22 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:46.794869 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab3c83-f058-47b3-9240-74f34a8cbc22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:46.799995 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc8125-904a-484b-a3b3-ed6f6d44dcf3 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:46.800282 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc8125-904a-484b-a3b3-ed6f6d44dcf3 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:46.800559 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc8125-904a-484b-a3b3-ed6f6d44dcf3 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:46.802127 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 460/893] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:43:46.802967 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ab3c83-f058-47b3-9240-74f34a8cbc22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:46.804576 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ab3c83-f058-47b3-9240-74f34a8cbc22 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:46.807177 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b891c7b-6adf-4404-b4b5-8a88e18652bf None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:46.807632 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b891c7b-6adf-4404-b4b5-8a88e18652bf None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:46.807765 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b891c7b-6adf-4404-b4b5-8a88e18652bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:46.818064 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-87ab3c83-f058-47b3-9240-74f34a8cbc22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:46.818064 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:46.818064 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:46.818064 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:46.818064 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:46.818064 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:46.818064 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:46.818064 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:46.818064 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:46.818064 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:46.818064 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:46.818064 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:46.818064 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:43:46.818064 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:43:46.818064 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:43:46.819228 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:43:46.819228 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:46.819228 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:46.819228 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:46.819228 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:46.819228 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:46.819228 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:46.819228 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:46.819228 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:46.819228 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:46.819228 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:46.819228 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:46.819228 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:46.819228 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:46.819228 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:46.819228 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:46.819228 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:46.820328 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:43:46.820328 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:43:46.820328 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:43:46.820328 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:43:46.820328 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:43:46.820328 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:43:46.820328 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:46.820328 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:46.822467 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 434/894] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:43:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:46.827887 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-1b891c7b-6adf-4404-b4b5-8a88e18652bf None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:46.828762 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab3c83-f058-47b3-9240-74f34a8cbc22 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:46.829769 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-1b891c7b-6adf-4404-b4b5-8a88e18652bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:46.858236 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:46.861524 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:46.930213 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 461/895] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:46 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 15:43:46.951666 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab3c83-f058-47b3-9240-74f34a8cbc22 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:46.989130 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63c2b4-0db7-4394-8961-f41e07ff10a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:46.989778 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63c2b4-0db7-4394-8961-f41e07ff10a3 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:46.990038 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63c2b4-0db7-4394-8961-f41e07ff10a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:46.990322 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63c2b4-0db7-4394-8961-f41e07ff10a3 None admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:46.991019 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc63c2b4-0db7-4394-8961-f41e07ff10a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:46.991326 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc63c2b4-0db7-4394-8961-f41e07ff10a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:46.992811 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc63c2b4-0db7-4394-8961-f41e07ff10a3 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:47.005913 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 435/896] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 7 15:43:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:43:47.011996 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b891c7b-6adf-4404-b4b5-8a88e18652bf None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:47.116044 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b891c7b-6adf-4404-b4b5-8a88e18652bf None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:47.151717 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e94ed3-1b09-4230-b4e1-f2f100943022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:47.153328 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e94ed3-1b09-4230-b4e1-f2f100943022 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:47.153875 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e94ed3-1b09-4230-b4e1-f2f100943022 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:47.154388 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e94ed3-1b09-4230-b4e1-f2f100943022 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:47.155311 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e94ed3-1b09-4230-b4e1-f2f100943022 None admin] RBAC: Adding query filter params (role.id=aff163e4c39f4c2f980bc6a6a6ca3d43, scope.project.id=488830167943488f85743236584113d7, user.id=3e20e40a37df4898bfe692535e5e4f25) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:47.155844 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e94ed3-1b09-4230-b4e1-f2f100943022 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:47.157476 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e94ed3-1b09-4230-b4e1-f2f100943022 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:47.163662 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 462/897] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 7 15:43:47 2022] GET /identity/v3/role_assignments?user.id=3e20e40a37df4898bfe692535e5e4f25&scope.project.id=488830167943488f85743236584113d7&role.id=aff163e4c39f4c2f980bc6a6a6ca3d43 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:47.210744 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63c2b4-0db7-4394-8961-f41e07ff10a3 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:47.313835 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:47.335488 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63c2b4-0db7-4394-8961-f41e07ff10a3 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:47.372251 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664d20c-1998-46ec-a556-76535d09a7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:47.372852 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664d20c-1998-46ec-a556-76535d09a7a6 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:47.373127 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664d20c-1998-46ec-a556-76535d09a7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:47.373398 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664d20c-1998-46ec-a556-76535d09a7a6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:47.373984 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5664d20c-1998-46ec-a556-76535d09a7a6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:47.375375 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5664d20c-1998-46ec-a556-76535d09a7a6 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:47.384527 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-5664d20c-1998-46ec-a556-76535d09a7a6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 15:43:47.384527 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:47.384527 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 15:43:47.384527 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 15:43:47.384527 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 15:43:47.384527 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 15:43:47.384527 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 15:43:47.384527 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:43:47.384527 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 15:43:47.384527 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:47.384527 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:43:47.384527 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:47.384527 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:47.384527 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:47.384527 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:47.384527 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:47.384527 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:47.385537 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:47.385537 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:47.385537 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:47.385537 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:47.385537 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:47.385537 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:47.385537 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 15:43:47.385537 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 15:43:47.385537 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 15:43:47.385537 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 15:43:47.385537 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:47.385537 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:47.385537 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:47.385537 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:47.385537 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:47.385537 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:47.386385 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:47.386385 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:47.386385 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:47.386385 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:47.386385 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:47.386385 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:47.386385 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:47.386385 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:47.386385 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:47.386385 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:47.386385 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 15:43:47.386385 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:43:47.386385 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 15:43:47.386385 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:47.386385 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 436/898] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 7 15:43:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:47.392259 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e94ed3-1b09-4230-b4e1-f2f100943022 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:47.418218 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:47.506345 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e94ed3-1b09-4230-b4e1-f2f100943022 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:47.541286 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2badf9-8142-4d1b-89f6-aa2bb3b4eed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:47.541893 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2badf9-8142-4d1b-89f6-aa2bb3b4eed6 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:47.542194 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2badf9-8142-4d1b-89f6-aa2bb3b4eed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:47.542474 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2badf9-8142-4d1b-89f6-aa2bb3b4eed6 None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:47.543778 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2badf9-8142-4d1b-89f6-aa2bb3b4eed6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:47.544124 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2badf9-8142-4d1b-89f6-aa2bb3b4eed6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:47.545496 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2badf9-8142-4d1b-89f6-aa2bb3b4eed6 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:47.550633 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 463/899] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 7 15:43:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:47.556477 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664d20c-1998-46ec-a556-76535d09a7a6 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:47.659387 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664d20c-1998-46ec-a556-76535d09a7a6 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:47.700586 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08888c8-ce79-4ce0-93d1-fc8320c4e4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:47.701613 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08888c8-ce79-4ce0-93d1-fc8320c4e4a8 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:47.702111 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08888c8-ce79-4ce0-93d1-fc8320c4e4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:47.702613 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08888c8-ce79-4ce0-93d1-fc8320c4e4a8 None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:47.703457 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08888c8-ce79-4ce0-93d1-fc8320c4e4a8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:47.703969 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08888c8-ce79-4ce0-93d1-fc8320c4e4a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:47.705539 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08888c8-ce79-4ce0-93d1-fc8320c4e4a8 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:47.711324 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 437/900] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 7 15:43:47 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:47.719969 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2badf9-8142-4d1b-89f6-aa2bb3b4eed6 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:47.810562 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:47.830314 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2badf9-8142-4d1b-89f6-aa2bb3b4eed6 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:47.866938 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13285e87-0c06-4144-a4de-1dd634086ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:47.867955 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13285e87-0c06-4144-a4de-1dd634086ac2 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:47.868439 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13285e87-0c06-4144-a4de-1dd634086ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:47.868919 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13285e87-0c06-4144-a4de-1dd634086ac2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:47.869828 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13285e87-0c06-4144-a4de-1dd634086ac2 None admin] RBAC: Adding query filter params (interface=public, service_id=d26070742f7844ab90613982ae818863, region_id=RegionOne) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:47.870399 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13285e87-0c06-4144-a4de-1dd634086ac2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:47.872052 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13285e87-0c06-4144-a4de-1dd634086ac2 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:47.878085 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 464/901] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Sep 7 15:43:47 2022] GET /identity/v3/endpoints?service_id=d26070742f7844ab90613982ae818863&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:47.884052 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08888c8-ce79-4ce0-93d1-fc8320c4e4a8 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:47.903166 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:47.991442 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08888c8-ce79-4ce0-93d1-fc8320c4e4a8 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:48.026315 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e68370-0377-4506-99a0-01084d31f3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:48.026923 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e68370-0377-4506-99a0-01084d31f3c3 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:48.027742 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e68370-0377-4506-99a0-01084d31f3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:48.028116 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e68370-0377-4506-99a0-01084d31f3c3 None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:48.028718 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e68370-0377-4506-99a0-01084d31f3c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:48.030076 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e68370-0377-4506-99a0-01084d31f3c3 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:48.036476 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 438/902] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Sep 7 15:43:47 2022] GET /identity/v3/services => generated 1268 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:43:48.761369 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a938c-0779-4430-a37c-841638343195 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:48.762567 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a938c-0779-4430-a37c-841638343195 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:48.762567 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a938c-0779-4430-a37c-841638343195 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:48.764123 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 465/903] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:43:48.769208 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac44cc6-2cbc-4d3b-9633-843774332429 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:48.769492 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac44cc6-2cbc-4d3b-9633-843774332429 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:48.769681 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5998c0c-044a-4be0-b71e-26600a3c8dca None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:48.769791 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac44cc6-2cbc-4d3b-9633-843774332429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:48.770089 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5998c0c-044a-4be0-b71e-26600a3c8dca None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:48.770546 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5998c0c-044a-4be0-b71e-26600a3c8dca None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:48.773068 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 439/904] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:43:48.779145 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48963be9-534b-489b-b4c8-cc2560b6f61e None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:48.779739 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48963be9-534b-489b-b4c8-cc2560b6f61e None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:48.780278 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48963be9-534b-489b-b4c8-cc2560b6f61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:48.789895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-eac44cc6-2cbc-4d3b-9633-843774332429 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:48.791360 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-eac44cc6-2cbc-4d3b-9633-843774332429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:48.803563 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-48963be9-534b-489b-b4c8-cc2560b6f61e None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:48.804847 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-48963be9-534b-489b-b4c8-cc2560b6f61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:48.890205 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 440/906] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:48 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 15:43:48.890402 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 466/906] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:48 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 15:43:49.155760 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48963be9-534b-489b-b4c8-cc2560b6f61e None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:49.158843 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:49.161101 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac44cc6-2cbc-4d3b-9633-843774332429 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:49.265791 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:49.281227 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48963be9-534b-489b-b4c8-cc2560b6f61e None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:49.295487 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac44cc6-2cbc-4d3b-9633-843774332429 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:49.330374 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8d936-260b-4c42-ab41-b69f4b5e4bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:49.331410 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8d936-260b-4c42-ab41-b69f4b5e4bb9 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:49.331951 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8d936-260b-4c42-ab41-b69f4b5e4bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:49.332427 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8d936-260b-4c42-ab41-b69f4b5e4bb9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:49.333247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c8d936-260b-4c42-ab41-b69f4b5e4bb9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:49.334936 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c8d936-260b-4c42-ab41-b69f4b5e4bb9 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:49.346907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-a0c8d936-260b-4c42-ab41-b69f4b5e4bb9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 15:43:49.346907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:49.346907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 15:43:49.346907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 15:43:49.346907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 15:43:49.346907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 15:43:49.346907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 15:43:49.346907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:43:49.346907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 15:43:49.346907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:49.346907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:43:49.346907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:49.346907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:49.346907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:49.346907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:49.346907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:49.347961 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:49.347961 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:49.347961 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:49.347961 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:49.347961 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:49.347961 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:49.347961 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:49.347961 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 15:43:49.347961 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 15:43:49.347961 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 15:43:49.347961 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 15:43:49.347961 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:49.347961 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:49.347961 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:49.347961 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:49.347961 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:49.347961 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:49.348872 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:49.348872 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:49.348872 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:49.348872 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:49.348872 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:49.348872 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:49.348872 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:49.348872 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:49.348872 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:49.348872 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:49.348872 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 15:43:49.348872 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:43:49.348872 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 15:43:49.348872 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:49.350356 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741eeaa-6631-4393-b62b-8675768048e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:49.351037 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741eeaa-6631-4393-b62b-8675768048e5 None admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:49.351317 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741eeaa-6631-4393-b62b-8675768048e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:49.351589 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741eeaa-6631-4393-b62b-8675768048e5 None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:49.352252 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 441/907] 10.222.0.16 () {56 vars in 1132 bytes} [Wed Sep 7 15:43:49 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:49.352355 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6741eeaa-6631-4393-b62b-8675768048e5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:49.353769 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6741eeaa-6631-4393-b62b-8675768048e5 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:49.358539 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8d936-260b-4c42-ab41-b69f4b5e4bb9 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:49.378416 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 467/908] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Sep 7 15:43:49 2022] POST /identity/v3/services => generated 241 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:43:49.433581 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6e88f-ff4b-4dbe-90e0-9c2fb0185d24 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:49.434533 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6e88f-ff4b-4dbe-90e0-9c2fb0185d24 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:49.435002 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6e88f-ff4b-4dbe-90e0-9c2fb0185d24 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:49.436911 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 468/909] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:43:49.442833 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f9a1e-2e62-4774-8b10-86538d7ae34a None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:49.443419 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f9a1e-2e62-4774-8b10-86538d7ae34a None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:49.443872 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f9a1e-2e62-4774-8b10-86538d7ae34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:49.448491 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:49.464197 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-af0f9a1e-2e62-4774-8b10-86538d7ae34a None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:49.466647 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-af0f9a1e-2e62-4774-8b10-86538d7ae34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:49.498998 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8d936-260b-4c42-ab41-b69f4b5e4bb9 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:49.544187 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35055cd8-5729-444a-9b78-cbeee07e4837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:49.545173 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35055cd8-5729-444a-9b78-cbeee07e4837 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:49.545754 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35055cd8-5729-444a-9b78-cbeee07e4837 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:49.546295 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35055cd8-5729-444a-9b78-cbeee07e4837 None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:49.547133 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35055cd8-5729-444a-9b78-cbeee07e4837 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:49.547650 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35055cd8-5729-444a-9b78-cbeee07e4837 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:49.549246 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35055cd8-5729-444a-9b78-cbeee07e4837 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:49.555684 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 442/910] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Sep 7 15:43:49 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:43:49.557611 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 469/911] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 15:43:49.566381 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35055cd8-5729-444a-9b78-cbeee07e4837 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:49.678745 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35055cd8-5729-444a-9b78-cbeee07e4837 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:49.706297 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:49.716061 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149c5d4-5f01-4e7b-89d6-2676f7ad655b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:49.716672 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149c5d4-5f01-4e7b-89d6-2676f7ad655b None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:49.716950 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149c5d4-5f01-4e7b-89d6-2676f7ad655b None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:49.717219 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149c5d4-5f01-4e7b-89d6-2676f7ad655b None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:49.717847 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a149c5d4-5f01-4e7b-89d6-2676f7ad655b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:49.718146 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a149c5d4-5f01-4e7b-89d6-2676f7ad655b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:49.719545 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a149c5d4-5f01-4e7b-89d6-2676f7ad655b None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:49.724962 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 443/912] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Sep 7 15:43:49 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:49.730566 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f9a1e-2e62-4774-8b10-86538d7ae34a None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:49.802509 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:49.839344 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f9a1e-2e62-4774-8b10-86538d7ae34a None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:49.859786 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149c5d4-5f01-4e7b-89d6-2676f7ad655b None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:49.877936 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f06a32e-ece8-44b8-bdc4-53aaa75d6e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:49.878496 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f06a32e-ece8-44b8-bdc4-53aaa75d6e91 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:49.878772 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f06a32e-ece8-44b8-bdc4-53aaa75d6e91 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:49.879041 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f06a32e-ece8-44b8-bdc4-53aaa75d6e91 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:49.879737 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f06a32e-ece8-44b8-bdc4-53aaa75d6e91 None admin] RBAC: Adding query filter params (interface=public, service_id=4ec11c9f9e9540ee939df3c3f53bb630, region_id=RegionOne) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:49.880042 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f06a32e-ece8-44b8-bdc4-53aaa75d6e91 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:49.881425 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f06a32e-ece8-44b8-bdc4-53aaa75d6e91 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:49.890216 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 470/913] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Sep 7 15:43:49 2022] GET /identity/v3/endpoints?service_id=4ec11c9f9e9540ee939df3c3f53bb630&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:49.893271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f06a32e-ece8-44b8-bdc4-53aaa75d6e91 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:49.990456 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149c5d4-5f01-4e7b-89d6-2676f7ad655b None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:50.025573 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3538ac73-0523-487b-8de4-493f4a890dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:50.026225 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538ac73-0523-487b-8de4-493f4a890dc3 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:50.026509 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538ac73-0523-487b-8de4-493f4a890dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:50.026778 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538ac73-0523-487b-8de4-493f4a890dc3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:50.031873 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f06a32e-ece8-44b8-bdc4-53aaa75d6e91 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:50.046374 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3538ac73-0523-487b-8de4-493f4a890dc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:43:50.051844 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-3538ac73-0523-487b-8de4-493f4a890dc3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 15:43:50.051844 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:50.051844 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:50.051844 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:50.051844 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:50.051844 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:50.051844 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:50.051844 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:50.051844 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:50.051844 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:50.051844 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:50.051844 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:50.051844 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:43:50.051844 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:43:50.051844 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:43:50.051844 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:43:50.052905 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:43:50.052905 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:43:50.052905 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:43:50.052905 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:43:50.052905 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:50.052905 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:50.052905 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:50.052905 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:50.052905 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:50.052905 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:50.052905 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:50.052905 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:50.052905 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:50.052905 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:50.052905 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:50.052905 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:50.053758 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:50.053758 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:50.053758 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:50.053758 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:50.053758 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:43:50.053758 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:43:50.053758 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:43:50.053758 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:43:50.053758 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:43:50.053758 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:43:50.053758 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 15:43:50.053758 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:50.056450 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 444/914] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Sep 7 15:43:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:50.062134 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3538ac73-0523-487b-8de4-493f4a890dc3 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:50.073528 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:50.080451 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df12333b-0357-4662-aa3b-da5c3e9a2634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:50.081222 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12333b-0357-4662-aa3b-da5c3e9a2634 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:50.081403 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12333b-0357-4662-aa3b-da5c3e9a2634 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:50.081659 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12333b-0357-4662-aa3b-da5c3e9a2634 None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:50.082332 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df12333b-0357-4662-aa3b-da5c3e9a2634 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:50.083694 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df12333b-0357-4662-aa3b-da5c3e9a2634 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:50.098150 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 471/915] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Sep 7 15:43:49 2022] GET /identity/v3/services => generated 1497 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 15:43:50.127316 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:50.186794 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3538ac73-0523-487b-8de4-493f4a890dc3 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:50.230224 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f914115-b460-4347-90f7-bce1957edaa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:50.231310 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f914115-b460-4347-90f7-bce1957edaa0 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:50.231833 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f914115-b460-4347-90f7-bce1957edaa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:50.232344 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f914115-b460-4347-90f7-bce1957edaa0 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:50.233526 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f914115-b460-4347-90f7-bce1957edaa0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:50.234074 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f914115-b460-4347-90f7-bce1957edaa0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:50.235844 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f914115-b460-4347-90f7-bce1957edaa0 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:50.245806 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 445/916] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Sep 7 15:43:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:43:50.252504 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df12333b-0357-4662-aa3b-da5c3e9a2634 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:50.331102 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaebddd4-f062-4aec-8ad2-92418ea0e6b6 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:50.331292 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaebddd4-f062-4aec-8ad2-92418ea0e6b6 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:50.331580 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaebddd4-f062-4aec-8ad2-92418ea0e6b6 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:50.333167 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 446/917] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:43:50.338149 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065522e-e1df-47d8-9410-622dc0016fd9 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:50.338486 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065522e-e1df-47d8-9410-622dc0016fd9 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:50.338767 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065522e-e1df-47d8-9410-622dc0016fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:50.358461 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-2065522e-e1df-47d8-9410-622dc0016fd9 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:50.359742 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-2065522e-e1df-47d8-9410-622dc0016fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:50.366886 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df12333b-0357-4662-aa3b-da5c3e9a2634 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:50.414140 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b60edf5-d4c7-4f41-aba3-23f8de2f7f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:50.415782 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60edf5-d4c7-4f41-aba3-23f8de2f7f47 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:50.416537 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60edf5-d4c7-4f41-aba3-23f8de2f7f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:50.417048 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60edf5-d4c7-4f41-aba3-23f8de2f7f47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:50.430731 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b60edf5-d4c7-4f41-aba3-23f8de2f7f47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:50.432953 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b60edf5-d4c7-4f41-aba3-23f8de2f7f47 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:50.436753 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 447/918] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 15:43:50.449685 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-4b60edf5-d4c7-4f41-aba3-23f8de2f7f47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:50.449685 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:50.449685 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:50.449685 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:50.449685 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:50.449685 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:50.449685 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:50.449685 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:50.449685 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:50.449685 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:50.449685 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:50.449685 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:50.449685 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:50.449685 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:50.449685 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:50.449685 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:50.450662 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:50.450662 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:50.450662 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:50.450662 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:50.450662 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:50.450662 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:50.450662 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:50.450662 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:50.450662 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:50.450662 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:50.450662 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:50.450662 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:50.450662 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:50.450662 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:50.450662 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:50.450662 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:50.450662 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:50.451570 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:50.451570 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:50.451570 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:50.453605 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 472/919] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:50.459503 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065522e-e1df-47d8-9410-622dc0016fd9 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:50.510571 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:50.562325 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065522e-e1df-47d8-9410-622dc0016fd9 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:50.599066 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5aae6-daf4-46e1-b061-b51bfe5f04f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:50.600012 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5aae6-daf4-46e1-b061-b51bfe5f04f5 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:50.600498 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5aae6-daf4-46e1-b061-b51bfe5f04f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:50.600993 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5aae6-daf4-46e1-b061-b51bfe5f04f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:50.601837 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa5aae6-daf4-46e1-b061-b51bfe5f04f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:50.602398 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa5aae6-daf4-46e1-b061-b51bfe5f04f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:50.603959 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa5aae6-daf4-46e1-b061-b51bfe5f04f5 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:50.616606 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 448/920] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:50.622473 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b60edf5-d4c7-4f41-aba3-23f8de2f7f47 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:50.674211 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:50.721478 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5aae6-daf4-46e1-b061-b51bfe5f04f5 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:50.727805 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b60edf5-d4c7-4f41-aba3-23f8de2f7f47 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:50.771454 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f8e40-0fcb-4f85-b052-696fb8f219a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:50.772252 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f8e40-0fcb-4f85-b052-696fb8f219a7 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:50.772536 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f8e40-0fcb-4f85-b052-696fb8f219a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:50.773187 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f8e40-0fcb-4f85-b052-696fb8f219a7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:50.782643 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143f8e40-0fcb-4f85-b052-696fb8f219a7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:50.784769 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143f8e40-0fcb-4f85-b052-696fb8f219a7 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:50.800521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-143f8e40-0fcb-4f85-b052-696fb8f219a7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 15:43:50.800521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:50.800521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:50.800521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:50.800521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:50.800521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:50.800521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:50.800521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:50.800521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:50.800521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:50.800521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:50.800521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:50.800521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:43:50.800521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:43:50.800521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:43:50.800521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:43:50.801524 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:50.801524 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:50.801524 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:43:50.801524 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:50.801524 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:43:50.801524 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:50.801524 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:50.801524 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:50.801524 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:50.801524 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:50.801524 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:50.801524 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:50.801524 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:50.801524 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:50.801524 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:50.801524 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:50.801524 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:50.801524 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:50.803550 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:50.803550 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:50.803550 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:43:50.803550 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:43:50.803550 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:43:50.803550 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:43:50.803550 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:43:50.803550 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:43:50.803550 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 15:43:50.803550 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:50.803550 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 473/921] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Sep 7 15:43:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:50.809744 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f8e40-0fcb-4f85-b052-696fb8f219a7 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:50.836812 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5aae6-daf4-46e1-b061-b51bfe5f04f5 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:50.858619 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:50.881863 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0932efa-9057-4274-856f-0d81b69fd066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:50.883667 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0932efa-9057-4274-856f-0d81b69fd066 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:50.884271 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0932efa-9057-4274-856f-0d81b69fd066 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:50.884831 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0932efa-9057-4274-856f-0d81b69fd066 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:50.885855 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0932efa-9057-4274-856f-0d81b69fd066 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:50.888987 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0932efa-9057-4274-856f-0d81b69fd066 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:50.907320 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-d0932efa-9057-4274-856f-0d81b69fd066 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 15:43:50.907320 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:50.907320 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 15:43:50.907320 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 15:43:50.907320 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 15:43:50.907320 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 15:43:50.907320 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 15:43:50.907320 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:43:50.907320 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 15:43:50.907320 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:50.907320 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:43:50.907320 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:50.907320 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:50.907320 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:50.907320 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:50.907320 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:50.907320 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:50.908376 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:50.908376 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:50.908376 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:50.908376 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:50.908376 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:50.908376 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:50.908376 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 15:43:50.908376 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 15:43:50.908376 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 15:43:50.908376 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 15:43:50.908376 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:50.908376 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:50.908376 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:50.908376 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:50.908376 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:50.908376 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:50.909234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:50.909234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:50.909234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:50.909234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:50.909234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:50.909234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:50.909234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:50.909234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:50.909234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:50.909234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:50.909234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 15:43:50.909234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:43:50.909234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 15:43:50.909234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:50.909234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 449/922] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 7 15:43:50 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:43:50.918352 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0932efa-9057-4274-856f-0d81b69fd066 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:50.953467 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f8e40-0fcb-4f85-b052-696fb8f219a7 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:50.966637 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:51.003032 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95de59-4d27-4dda-a3ae-dcaf722968b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:51.003883 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95de59-4d27-4dda-a3ae-dcaf722968b9 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:51.004499 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95de59-4d27-4dda-a3ae-dcaf722968b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:51.004925 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95de59-4d27-4dda-a3ae-dcaf722968b9 None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:51.006347 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c95de59-4d27-4dda-a3ae-dcaf722968b9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:51.006914 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c95de59-4d27-4dda-a3ae-dcaf722968b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:51.008995 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c95de59-4d27-4dda-a3ae-dcaf722968b9 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:51.030119 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0932efa-9057-4274-856f-0d81b69fd066 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:51.035890 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 474/923] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Sep 7 15:43:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:51.036928 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95de59-4d27-4dda-a3ae-dcaf722968b9 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:51.080499 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c59aa-6e0a-4a7c-ad2a-6376bc98610b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:51.081412 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c59aa-6e0a-4a7c-ad2a-6376bc98610b None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:51.081851 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c59aa-6e0a-4a7c-ad2a-6376bc98610b None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:51.082832 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c59aa-6e0a-4a7c-ad2a-6376bc98610b None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:51.083777 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9c59aa-6e0a-4a7c-ad2a-6376bc98610b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:51.084286 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9c59aa-6e0a-4a7c-ad2a-6376bc98610b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:51.086623 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9c59aa-6e0a-4a7c-ad2a-6376bc98610b None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:51.097582 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 450/924] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 7 15:43:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:51.098628 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c59aa-6e0a-4a7c-ad2a-6376bc98610b None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:51.157908 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95de59-4d27-4dda-a3ae-dcaf722968b9 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:51.178524 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:51.194648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5178b3f0-4a5a-45a7-bb51-e2ef60668fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:51.195363 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5178b3f0-4a5a-45a7-bb51-e2ef60668fbe None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:51.195657 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5178b3f0-4a5a-45a7-bb51-e2ef60668fbe None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:51.196024 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5178b3f0-4a5a-45a7-bb51-e2ef60668fbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:51.208615 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5178b3f0-4a5a-45a7-bb51-e2ef60668fbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:51.210056 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5178b3f0-4a5a-45a7-bb51-e2ef60668fbe None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:51.226639 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-5178b3f0-4a5a-45a7-bb51-e2ef60668fbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:51.226639 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:51.226639 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:51.226639 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:51.226639 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:51.226639 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:51.226639 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:51.226639 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:51.226639 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:51.226639 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:51.226639 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:51.226639 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:51.226639 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:51.226639 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:51.226639 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:51.226639 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:51.227608 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:51.227608 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:51.227608 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:51.227608 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:51.227608 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:51.227608 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:51.227608 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:51.227608 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:51.227608 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:51.227608 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:51.227608 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:51.227608 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:51.227608 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:51.227608 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:51.227608 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:51.227608 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:51.227608 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:51.228502 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:51.228502 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:51.228502 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:51.232549 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 475/925] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:43:51.233778 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5178b3f0-4a5a-45a7-bb51-e2ef60668fbe None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:51.240664 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c59aa-6e0a-4a7c-ad2a-6376bc98610b None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:51.262770 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:51.280826 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3524278-6442-40b3-8a21-fef7d0ec7a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:51.281448 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3524278-6442-40b3-8a21-fef7d0ec7a8c None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:51.282022 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3524278-6442-40b3-8a21-fef7d0ec7a8c None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:51.282159 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3524278-6442-40b3-8a21-fef7d0ec7a8c None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:51.282901 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3524278-6442-40b3-8a21-fef7d0ec7a8c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:51.283245 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3524278-6442-40b3-8a21-fef7d0ec7a8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:51.284759 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3524278-6442-40b3-8a21-fef7d0ec7a8c None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:51.295887 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 451/926] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Sep 7 15:43:51 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:51.298846 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3524278-6442-40b3-8a21-fef7d0ec7a8c None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:51.364126 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5178b3f0-4a5a-45a7-bb51-e2ef60668fbe None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:51.402790 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a365e57-b61a-4ea7-ba8d-63cf491fa974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:51.403575 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a365e57-b61a-4ea7-ba8d-63cf491fa974 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:51.404002 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a365e57-b61a-4ea7-ba8d-63cf491fa974 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:51.404381 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a365e57-b61a-4ea7-ba8d-63cf491fa974 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:51.405135 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a365e57-b61a-4ea7-ba8d-63cf491fa974 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:51.405564 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a365e57-b61a-4ea7-ba8d-63cf491fa974 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:51.407346 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a365e57-b61a-4ea7-ba8d-63cf491fa974 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:51.420697 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:51.427286 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 476/927] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:51.428322 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a365e57-b61a-4ea7-ba8d-63cf491fa974 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:51.428924 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3524278-6442-40b3-8a21-fef7d0ec7a8c None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:51.470284 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f90d9-670e-4582-89c7-f85d502acc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:51.471216 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f90d9-670e-4582-89c7-f85d502acc78 None admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:51.471602 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f90d9-670e-4582-89c7-f85d502acc78 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:51.472794 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f90d9-670e-4582-89c7-f85d502acc78 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:51.473581 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f90d9-670e-4582-89c7-f85d502acc78 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:51.475090 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f90d9-670e-4582-89c7-f85d502acc78 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:51.510201 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 452/928] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:43:51 2022] POST /identity/v3/endpoints => generated 346 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:43:51.530689 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:51.558956 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a365e57-b61a-4ea7-ba8d-63cf491fa974 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:51.612191 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac795362-793d-4ebd-802a-9d23f958bc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:51.612838 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac795362-793d-4ebd-802a-9d23f958bc36 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:51.613120 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac795362-793d-4ebd-802a-9d23f958bc36 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:51.613395 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac795362-793d-4ebd-802a-9d23f958bc36 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:51.621690 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac795362-793d-4ebd-802a-9d23f958bc36 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:51.623684 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac795362-793d-4ebd-802a-9d23f958bc36 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:51.636784 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-ac795362-793d-4ebd-802a-9d23f958bc36 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:51.636784 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:51.636784 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:51.636784 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:51.636784 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:51.636784 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:51.636784 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:51.636784 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:51.636784 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:51.636784 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:51.636784 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:51.636784 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:51.636784 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:43:51.636784 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:43:51.636784 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:43:51.638201 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:43:51.638201 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:51.638201 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:51.638201 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:51.638201 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:51.638201 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:51.638201 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:51.638201 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:51.638201 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:51.638201 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:51.638201 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:51.638201 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:51.638201 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:51.638201 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:51.638201 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:51.638201 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:51.638201 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:51.639110 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:43:51.639110 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:43:51.639110 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:43:51.639110 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:43:51.639110 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:43:51.639110 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:43:51.639110 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:51.639110 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:51.639110 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 477/929] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:43:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:51.645873 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f90d9-670e-4582-89c7-f85d502acc78 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:51.692780 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8116e8d-a673-42ee-bea0-ad04897549c7 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:51.693137 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8116e8d-a673-42ee-bea0-ad04897549c7 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:51.693298 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8116e8d-a673-42ee-bea0-ad04897549c7 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:51.694909 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 478/930] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:43:51.700725 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b0c6d-a61d-418c-a560-281c5644e14a None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:51.701178 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b0c6d-a61d-418c-a560-281c5644e14a None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:51.701450 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b0c6d-a61d-418c-a560-281c5644e14a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:51.723812 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-ee1b0c6d-a61d-418c-a560-281c5644e14a None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:51.724996 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-ee1b0c6d-a61d-418c-a560-281c5644e14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:51.778231 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f90d9-670e-4582-89c7-f85d502acc78 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:51.816745 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 479/931] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:43:51.820279 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383af10e-8eec-4fec-a6c0-e7bcaccbb5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:51.820898 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383af10e-8eec-4fec-a6c0-e7bcaccbb5e8 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:51.821183 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383af10e-8eec-4fec-a6c0-e7bcaccbb5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:51.821459 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383af10e-8eec-4fec-a6c0-e7bcaccbb5e8 None admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:51.822158 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383af10e-8eec-4fec-a6c0-e7bcaccbb5e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:51.822485 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383af10e-8eec-4fec-a6c0-e7bcaccbb5e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:51.823925 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383af10e-8eec-4fec-a6c0-e7bcaccbb5e8 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:51.837333 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 453/932] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 7 15:43:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:51.843553 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b0c6d-a61d-418c-a560-281c5644e14a None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:51.908901 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:51.954897 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b0c6d-a61d-418c-a560-281c5644e14a None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:51.991481 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b67197-2fcb-4df6-bb4d-a3748bf2ad58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:51.992146 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b67197-2fcb-4df6-bb4d-a3748bf2ad58 None admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:51.992424 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b67197-2fcb-4df6-bb4d-a3748bf2ad58 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:51.992695 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b67197-2fcb-4df6-bb4d-a3748bf2ad58 None admin] PATH_INFO: `/v3/projects/488830167943488f85743236584113d7/users/3e20e40a37df4898bfe692535e5e4f25/roles/aff163e4c39f4c2f980bc6a6a6ca3d43` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:51.995029 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b67197-2fcb-4df6-bb4d-a3748bf2ad58 None admin] RBAC: Authorizing `identity:create_grant(project_id=488830167943488f85743236584113d7, user_id=3e20e40a37df4898bfe692535e5e4f25, role_id=aff163e4c39f4c2f980bc6a6a6ca3d43)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:51.997137 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b67197-2fcb-4df6-bb4d-a3748bf2ad58 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:52.013627 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 480/933] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 7 15:43:51 2022] PUT /identity/v3/projects/488830167943488f85743236584113d7/users/3e20e40a37df4898bfe692535e5e4f25/roles/aff163e4c39f4c2f980bc6a6a6ca3d43 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:43:52.125692 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383af10e-8eec-4fec-a6c0-e7bcaccbb5e8 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:52.139792 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:52.248761 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383af10e-8eec-4fec-a6c0-e7bcaccbb5e8 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:52.287769 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc2840-5d8e-42ce-a79e-48bf86b3608e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:52.288593 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc2840-5d8e-42ce-a79e-48bf86b3608e None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:52.288879 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc2840-5d8e-42ce-a79e-48bf86b3608e None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:52.289152 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc2840-5d8e-42ce-a79e-48bf86b3608e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:52.289747 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc2840-5d8e-42ce-a79e-48bf86b3608e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:52.291277 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc2840-5d8e-42ce-a79e-48bf86b3608e None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:52.302130 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-2bbc2840-5d8e-42ce-a79e-48bf86b3608e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 15:43:52.302130 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:52.302130 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 15:43:52.302130 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 15:43:52.302130 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 15:43:52.302130 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 15:43:52.302130 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 15:43:52.302130 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:43:52.302130 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 15:43:52.302130 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:52.302130 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:43:52.302130 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:52.302130 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:52.302130 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:52.302130 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:52.302130 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:52.302130 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:52.304582 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:52.304582 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:52.304582 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:52.304582 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:52.304582 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:52.304582 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:52.304582 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 15:43:52.304582 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 15:43:52.304582 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 15:43:52.304582 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 15:43:52.304582 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:52.304582 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:52.304582 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:52.304582 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:52.304582 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:52.304582 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:52.306546 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:52.306546 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:52.306546 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:52.306546 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:52.306546 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:52.306546 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:52.306546 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:52.306546 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:52.306546 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:52.306546 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:52.306546 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 15:43:52.306546 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:43:52.306546 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 15:43:52.306546 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:52.306546 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 454/934] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Sep 7 15:43:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:52.310208 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b67197-2fcb-4df6-bb4d-a3748bf2ad58 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:52.397531 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150b72d-afe5-4755-92f2-d282cfc03457 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:52.397880 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150b72d-afe5-4755-92f2-d282cfc03457 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:52.398063 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150b72d-afe5-4755-92f2-d282cfc03457 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:52.400744 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 455/935] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:43:52.405416 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884004b-cce5-45a5-a49e-52d7176f7259 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:52.405710 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884004b-cce5-45a5-a49e-52d7176f7259 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:52.405989 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884004b-cce5-45a5-a49e-52d7176f7259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:52.418483 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b67197-2fcb-4df6-bb4d-a3748bf2ad58 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:52.425361 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-0884004b-cce5-45a5-a49e-52d7176f7259 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:52.426716 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-0884004b-cce5-45a5-a49e-52d7176f7259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:52.444413 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:52.456374 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3fa9a8-c943-4102-94a4-cc7c39664c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:52.457088 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3fa9a8-c943-4102-94a4-cc7c39664c91 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:52.457369 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3fa9a8-c943-4102-94a4-cc7c39664c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:52.457639 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3fa9a8-c943-4102-94a4-cc7c39664c91 None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:52.458295 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3fa9a8-c943-4102-94a4-cc7c39664c91 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:52.458598 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3fa9a8-c943-4102-94a4-cc7c39664c91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:52.460242 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3fa9a8-c943-4102-94a4-cc7c39664c91 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:52.466363 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 481/936] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Sep 7 15:43:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:52.473967 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3fa9a8-c943-4102-94a4-cc7c39664c91 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:52.518874 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 456/937] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:43:52.588446 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3fa9a8-c943-4102-94a4-cc7c39664c91 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:52.624865 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c17f99-5d73-4323-82d6-74384de1da15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:52.625470 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c17f99-5d73-4323-82d6-74384de1da15 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:52.625745 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c17f99-5d73-4323-82d6-74384de1da15 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:52.626014 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c17f99-5d73-4323-82d6-74384de1da15 None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:52.626722 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c17f99-5d73-4323-82d6-74384de1da15 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:52.627019 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c17f99-5d73-4323-82d6-74384de1da15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:52.628369 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c17f99-5d73-4323-82d6-74384de1da15 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:52.633670 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 482/938] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Sep 7 15:43:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:52.639246 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884004b-cce5-45a5-a49e-52d7176f7259 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:52.642802 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:52.750375 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884004b-cce5-45a5-a49e-52d7176f7259 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:52.786592 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a64b91-3722-4501-9026-6d7fbbb94b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:52.787556 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a64b91-3722-4501-9026-6d7fbbb94b7b None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:52.788041 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a64b91-3722-4501-9026-6d7fbbb94b7b None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:52.788514 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a64b91-3722-4501-9026-6d7fbbb94b7b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:52.789435 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a64b91-3722-4501-9026-6d7fbbb94b7b None admin] RBAC: Adding query filter params (interface=public, service_id=bd2ac96ebdcc42ae8654696ff760d5dc, region_id=RegionOne) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:52.789961 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a64b91-3722-4501-9026-6d7fbbb94b7b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:52.791569 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a64b91-3722-4501-9026-6d7fbbb94b7b None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:52.800842 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 457/939] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Sep 7 15:43:52 2022] GET /identity/v3/endpoints?service_id=bd2ac96ebdcc42ae8654696ff760d5dc&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:52.806444 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c17f99-5d73-4323-82d6-74384de1da15 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:52.810412 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a64b91-3722-4501-9026-6d7fbbb94b7b None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:52.869649 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:52.882021 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:52.919293 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a64b91-3722-4501-9026-6d7fbbb94b7b None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:52.923377 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c17f99-5d73-4323-82d6-74384de1da15 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:52.958016 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a6452-999d-43e7-be1d-d7646f33e042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:52.959062 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a6452-999d-43e7-be1d-d7646f33e042 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:52.959784 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a6452-999d-43e7-be1d-d7646f33e042 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:52.960383 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a6452-999d-43e7-be1d-d7646f33e042 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:52.961189 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a6452-999d-43e7-be1d-d7646f33e042 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:52.963054 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a6452-999d-43e7-be1d-d7646f33e042 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:52.965478 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86954e-20ab-4e79-9c59-705fa4860a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:52.966213 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86954e-20ab-4e79-9c59-705fa4860a8f None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:52.966508 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86954e-20ab-4e79-9c59-705fa4860a8f None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:52.966793 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86954e-20ab-4e79-9c59-705fa4860a8f None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:52.967672 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae86954e-20ab-4e79-9c59-705fa4860a8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:52.969342 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae86954e-20ab-4e79-9c59-705fa4860a8f None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:52.974049 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-355a6452-999d-43e7-be1d-d7646f33e042 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 15:43:52.974049 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:52.974049 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 15:43:52.974049 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 15:43:52.974049 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 15:43:52.974049 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 15:43:52.974049 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 15:43:52.974049 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:43:52.974049 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 15:43:52.974049 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:52.974049 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:43:52.974049 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:52.974049 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:52.974049 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:52.974049 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:52.974049 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:52.974996 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:52.974996 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:52.974996 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:52.974996 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:52.974996 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:52.974996 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:52.974996 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:52.974996 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 15:43:52.974996 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 15:43:52.974996 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 15:43:52.974996 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 15:43:52.974996 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:52.974996 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:52.974996 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:52.974996 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:52.974996 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:52.974996 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:52.975879 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:52.975879 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:52.975879 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:52.975879 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:52.975879 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:52.975879 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:52.975879 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:52.975879 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:52.975879 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:52.975879 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:52.975879 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 15:43:52.975879 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:43:52.975879 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 15:43:52.975879 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:52.976606 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 483/940] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Sep 7 15:43:52 2022] GET /identity/v3/services => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:43:52.985648 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 458/941] 10.222.0.16 () {56 vars in 1132 bytes} [Wed Sep 7 15:43:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:43:52.987272 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86954e-20ab-4e79-9c59-705fa4860a8f None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:53.119951 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86954e-20ab-4e79-9c59-705fa4860a8f None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:53.142560 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:53.157573 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d606f1-c310-4a44-b377-e5d17a88d037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:53.158195 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d606f1-c310-4a44-b377-e5d17a88d037 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:53.158481 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d606f1-c310-4a44-b377-e5d17a88d037 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:53.158752 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d606f1-c310-4a44-b377-e5d17a88d037 None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:53.159378 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d606f1-c310-4a44-b377-e5d17a88d037 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:53.159679 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d606f1-c310-4a44-b377-e5d17a88d037 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:53.161035 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d606f1-c310-4a44-b377-e5d17a88d037 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:53.166209 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 484/942] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Sep 7 15:43:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:53.172071 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a6452-999d-43e7-be1d-d7646f33e042 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:53.284164 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a6452-999d-43e7-be1d-d7646f33e042 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:53.317318 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:53.323411 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f672cbb-28e0-4432-80e2-ff27abea3fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:53.324384 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f672cbb-28e0-4432-80e2-ff27abea3fbb None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:53.324893 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f672cbb-28e0-4432-80e2-ff27abea3fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:53.325377 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f672cbb-28e0-4432-80e2-ff27abea3fbb None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:53.326244 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f672cbb-28e0-4432-80e2-ff27abea3fbb None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:53.326767 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f672cbb-28e0-4432-80e2-ff27abea3fbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:53.328140 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f672cbb-28e0-4432-80e2-ff27abea3fbb None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:53.333708 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 459/943] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Sep 7 15:43:53 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:53.339481 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d606f1-c310-4a44-b377-e5d17a88d037 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:53.450145 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d606f1-c310-4a44-b377-e5d17a88d037 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:53.487867 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3849aaa-35d1-4133-8d13-f62af80902a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:53.488725 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3849aaa-35d1-4133-8d13-f62af80902a7 None admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:53.489207 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3849aaa-35d1-4133-8d13-f62af80902a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:53.489621 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3849aaa-35d1-4133-8d13-f62af80902a7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:53.490491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3849aaa-35d1-4133-8d13-f62af80902a7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:53.492065 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3849aaa-35d1-4133-8d13-f62af80902a7 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:53.519805 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 485/944] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:43:53 2022] POST /identity/v3/endpoints => generated 347 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:43:53.877277 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb8e64-eac9-4789-b8e7-c5a2f3c34d20 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:53.879481 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb8e64-eac9-4789-b8e7-c5a2f3c34d20 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:53.879481 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb8e64-eac9-4789-b8e7-c5a2f3c34d20 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:53.879481 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 460/945] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:43:53.886208 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef411f9-d142-4323-85e4-fd66adb70124 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:53.886208 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef411f9-d142-4323-85e4-fd66adb70124 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:53.886208 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef411f9-d142-4323-85e4-fd66adb70124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:53.905088 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-7ef411f9-d142-4323-85e4-fd66adb70124 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:53.906337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-7ef411f9-d142-4323-85e4-fd66adb70124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:53.938639 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:53.990424 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 486/946] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:43:54.267273 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb8e64-eac9-4789-b8e7-c5a2f3c34d20 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:54.340884 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a56caf-6513-42ad-abe9-6147e5b21a0d None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:54.341522 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a56caf-6513-42ad-abe9-6147e5b21a0d None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:54.341999 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a56caf-6513-42ad-abe9-6147e5b21a0d None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:54.345059 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 487/947] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:43:54.349430 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c584e0b-51b0-4068-8b53-b7873eca4ed8 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:54.349952 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c584e0b-51b0-4068-8b53-b7873eca4ed8 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:54.350482 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c584e0b-51b0-4068-8b53-b7873eca4ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:54.370826 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-4c584e0b-51b0-4068-8b53-b7873eca4ed8 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:54.373070 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-4c584e0b-51b0-4068-8b53-b7873eca4ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:54.383521 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb8e64-eac9-4789-b8e7-c5a2f3c34d20 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:54.428521 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac71ce-d813-4f45-b646-1b65ec6b7a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:54.429129 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac71ce-d813-4f45-b646-1b65ec6b7a62 None admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:54.429580 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac71ce-d813-4f45-b646-1b65ec6b7a62 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:54.430012 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac71ce-d813-4f45-b646-1b65ec6b7a62 None admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:54.430875 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac71ce-d813-4f45-b646-1b65ec6b7a62 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:54.433155 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac71ce-d813-4f45-b646-1b65ec6b7a62 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:54.436770 dv-cinder-853315-8-smb devstack@keystone.service[81502]: WARNING keystone.server.flask.common [None req-3dac71ce-d813-4f45-b646-1b65ec6b7a62 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 07 15:43:54.454262 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 488/948] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 15:43:54.458767 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.sql.core [None req-3dac71ce-d813-4f45-b646-1b65ec6b7a62 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 07 15:43:54.458767 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 07 15:43:54.458767 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [parameters: {'id': 'd58bbde4074243598434707df7a0567b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 07 15:43:54.458767 dv-cinder-853315-8-smb devstack@keystone.service[81502]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81502) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 07 15:43:54.479405 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-3dac71ce-d813-4f45-b646-1b65ec6b7a62 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d58bbde4074243598434707df7a0567b.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d58bbde4074243598434707df7a0567b. Sep 07 15:43:54.479405 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:54.479405 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 07 15:43:54.479405 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 07 15:43:54.479405 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 07 15:43:54.479405 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 07 15:43:54.479405 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 07 15:43:54.479405 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application result = self._query(query) Sep 07 15:43:54.479405 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 07 15:43:54.479405 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application conn.query(q) Sep 07 15:43:54.479405 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 07 15:43:54.479405 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 07 15:43:54.479405 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 07 15:43:54.481300 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application result.read() Sep 07 15:43:54.481300 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 07 15:43:54.481300 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 07 15:43:54.481300 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 07 15:43:54.481300 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 07 15:43:54.481300 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 07 15:43:54.481300 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 07 15:43:54.481300 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 07 15:43:54.481300 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 07 15:43:54.481300 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 07 15:43:54.481300 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:54.481300 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 07 15:43:54.481300 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:54.481300 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:54.481300 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 07 15:43:54.481300 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 07 15:43:54.481300 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 07 15:43:54.481300 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 07 15:43:54.482581 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 07 15:43:54.482581 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application next(self.gen) Sep 07 15:43:54.482581 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 07 15:43:54.482581 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application yield resource Sep 07 15:43:54.482581 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 07 15:43:54.482581 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application next(self.gen) Sep 07 15:43:54.482581 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 07 15:43:54.482581 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self.session.rollback() Sep 07 15:43:54.482581 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 15:43:54.482581 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self.force_reraise() Sep 07 15:43:54.482581 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 15:43:54.482581 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise self.value Sep 07 15:43:54.482581 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 07 15:43:54.482581 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 07 15:43:54.482581 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 07 15:43:54.482581 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application session.commit() Sep 07 15:43:54.482581 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 07 15:43:54.483883 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 07 15:43:54.483883 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 07 15:43:54.483883 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._prepare_impl() Sep 07 15:43:54.483883 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 07 15:43:54.483883 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self.session.flush() Sep 07 15:43:54.483883 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 07 15:43:54.483883 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._flush(objects) Sep 07 15:43:54.483883 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 07 15:43:54.483883 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 07 15:43:54.483883 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 07 15:43:54.483883 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application compat.raise_( Sep 07 15:43:54.483883 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 07 15:43:54.483883 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception Sep 07 15:43:54.483883 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 07 15:43:54.483883 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application flush_context.execute() Sep 07 15:43:54.483883 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 07 15:43:54.483883 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rec.execute(self) Sep 07 15:43:54.484792 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 07 15:43:54.484792 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 07 15:43:54.484792 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 07 15:43:54.484792 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 07 15:43:54.484792 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 07 15:43:54.484792 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 07 15:43:54.484792 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 07 15:43:54.484792 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 07 15:43:54.484792 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 07 15:43:54.484792 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 07 15:43:54.484792 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 07 15:43:54.484792 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 07 15:43:54.484792 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 07 15:43:54.484792 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 07 15:43:54.484792 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 07 15:43:54.485567 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 07 15:43:54.485567 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 07 15:43:54.485567 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception Sep 07 15:43:54.485567 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 07 15:43:54.485567 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 07 15:43:54.485567 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 07 15:43:54.485567 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 07 15:43:54.485567 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 07 15:43:54.485567 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application result = self._query(query) Sep 07 15:43:54.485567 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 07 15:43:54.485567 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application conn.query(q) Sep 07 15:43:54.485567 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 07 15:43:54.485567 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 07 15:43:54.485567 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 07 15:43:54.485567 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application result.read() Sep 07 15:43:54.485567 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 07 15:43:54.485567 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 07 15:43:54.486572 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 07 15:43:54.486572 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 07 15:43:54.486572 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 07 15:43:54.486572 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 07 15:43:54.486572 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 07 15:43:54.486572 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 07 15:43:54.486572 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 07 15:43:54.486572 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 07 15:43:54.486572 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [parameters: {'id': 'd58bbde4074243598434707df7a0567b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 07 15:43:54.486572 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 07 15:43:54.486572 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:54.486572 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:43:54.486572 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:54.486572 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:54.486572 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 07 15:43:54.487532 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 07 15:43:54.487532 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 07 15:43:54.487532 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 07 15:43:54.487532 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 07 15:43:54.487532 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:54.487532 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:43:54.487532 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:54.487532 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:54.487532 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:54.487532 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:54.487532 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:54.487532 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:54.487532 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:54.487532 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:54.487532 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:54.487532 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:54.487532 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:54.488720 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:54.488720 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 07 15:43:54.488720 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 07 15:43:54.488720 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:54.488720 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:54.488720 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 07 15:43:54.488720 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 07 15:43:54.488720 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d58bbde4074243598434707df7a0567b. Sep 07 15:43:54.488720 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:54.491224 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 461/949] 10.222.0.16 () {60 vars in 1140 bytes} [Wed Sep 7 15:43:54 2022] POST /identity/v3/projects => generated 262 bytes in 224 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:54.497448 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c584e0b-51b0-4068-8b53-b7873eca4ed8 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:54.597259 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:54.607664 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c584e0b-51b0-4068-8b53-b7873eca4ed8 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:54.644652 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33e7d7-55c0-4cde-82c4-d3a6c7c3b51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:54.645291 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33e7d7-55c0-4cde-82c4-d3a6c7c3b51a None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:54.645623 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33e7d7-55c0-4cde-82c4-d3a6c7c3b51a None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:54.645906 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33e7d7-55c0-4cde-82c4-d3a6c7c3b51a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:54.653891 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef33e7d7-55c0-4cde-82c4-d3a6c7c3b51a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:54.655378 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef33e7d7-55c0-4cde-82c4-d3a6c7c3b51a None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:54.667329 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-ef33e7d7-55c0-4cde-82c4-d3a6c7c3b51a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:54.667329 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:54.667329 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:54.667329 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:54.667329 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:54.667329 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:54.667329 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:54.667329 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:54.667329 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:54.667329 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:54.667329 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:54.667329 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:54.667329 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:43:54.667329 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:43:54.667329 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:43:54.668272 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:43:54.668272 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:54.668272 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:54.668272 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:54.668272 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:54.668272 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:54.668272 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:54.668272 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:54.668272 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:54.668272 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:54.668272 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:54.668272 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:54.668272 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:54.668272 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:54.668272 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:54.668272 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:54.668272 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:54.669655 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:43:54.669655 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:43:54.669655 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:43:54.669655 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:43:54.669655 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:43:54.669655 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:43:54.669655 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:54.669655 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:54.669655 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 489/950] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:43:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:54.675554 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac71ce-d813-4f45-b646-1b65ec6b7a62 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:54.738620 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33e7d7-55c0-4cde-82c4-d3a6c7c3b51a None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:54.741334 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:54.804828 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac71ce-d813-4f45-b646-1b65ec6b7a62 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:54.843487 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf73d35-86de-4712-b6a6-29d342506d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:54.844106 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf73d35-86de-4712-b6a6-29d342506d86 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:54.844388 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf73d35-86de-4712-b6a6-29d342506d86 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:54.844670 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf73d35-86de-4712-b6a6-29d342506d86 None admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:54.845330 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf73d35-86de-4712-b6a6-29d342506d86 None admin] RBAC: Adding query filter params (name=service) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:54.845636 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf73d35-86de-4712-b6a6-29d342506d86 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:54.847366 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf73d35-86de-4712-b6a6-29d342506d86 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:54.874023 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33e7d7-55c0-4cde-82c4-d3a6c7c3b51a None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:54.874281 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 462/951] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Sep 7 15:43:54 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:54.915322 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d810af-9edc-46eb-bb26-2fcb7b88f21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:54.916720 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d810af-9edc-46eb-bb26-2fcb7b88f21c None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:54.917224 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d810af-9edc-46eb-bb26-2fcb7b88f21c None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:54.917803 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d810af-9edc-46eb-bb26-2fcb7b88f21c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:54.931397 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d810af-9edc-46eb-bb26-2fcb7b88f21c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:43:54.937929 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-45d810af-9edc-46eb-bb26-2fcb7b88f21c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 15:43:54.937929 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:54.937929 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:54.937929 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:54.937929 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:54.937929 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:54.937929 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:54.937929 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:54.937929 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:54.937929 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:54.937929 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:54.937929 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:54.937929 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:43:54.937929 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:43:54.937929 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:43:54.937929 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:43:54.938949 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:43:54.938949 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:43:54.938949 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:43:54.938949 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:43:54.938949 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:54.938949 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:54.938949 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:54.938949 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:54.938949 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:54.938949 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:54.938949 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:54.938949 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:54.938949 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:54.938949 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:54.938949 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:54.938949 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:54.939954 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:54.939954 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:54.939954 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:54.939954 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:54.939954 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:43:54.939954 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:43:54.939954 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:43:54.939954 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:43:54.939954 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:43:54.939954 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:43:54.939954 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 15:43:54.939954 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:54.946290 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 490/952] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Sep 7 15:43:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:43:54.949774 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf73d35-86de-4712-b6a6-29d342506d86 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:55.067923 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf73d35-86de-4712-b6a6-29d342506d86 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:55.082541 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:55.107602 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f98eb-6fa1-4b8e-b4cb-10f934d65be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:55.108407 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f98eb-6fa1-4b8e-b4cb-10f934d65be2 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:55.108689 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f98eb-6fa1-4b8e-b4cb-10f934d65be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:55.108963 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f98eb-6fa1-4b8e-b4cb-10f934d65be2 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:55.109633 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f98eb-6fa1-4b8e-b4cb-10f934d65be2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:55.109936 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f98eb-6fa1-4b8e-b4cb-10f934d65be2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:55.111355 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f98eb-6fa1-4b8e-b4cb-10f934d65be2 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:55.120454 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 463/953] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Sep 7 15:43:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:55.126345 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d810af-9edc-46eb-bb26-2fcb7b88f21c None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:55.143669 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:55.245573 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d810af-9edc-46eb-bb26-2fcb7b88f21c None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:55.285073 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2c954-d9fe-417f-8c5c-5ad2827196e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:55.285999 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2c954-d9fe-417f-8c5c-5ad2827196e7 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:55.286472 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2c954-d9fe-417f-8c5c-5ad2827196e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:55.286888 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2c954-d9fe-417f-8c5c-5ad2827196e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:55.298951 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2c954-d9fe-417f-8c5c-5ad2827196e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:55.300692 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2c954-d9fe-417f-8c5c-5ad2827196e7 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:55.303228 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b91aa1-68e5-455a-9ea2-27ac899f550a None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:55.303832 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b91aa1-68e5-455a-9ea2-27ac899f550a None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:55.304701 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b91aa1-68e5-455a-9ea2-27ac899f550a None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:55.306553 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 464/954] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:43:55.312208 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a595192-5dc8-4f1e-977f-5479a9724dd9 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:55.312739 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a595192-5dc8-4f1e-977f-5479a9724dd9 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:55.313239 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a595192-5dc8-4f1e-977f-5479a9724dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:55.317612 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-d1a2c954-d9fe-417f-8c5c-5ad2827196e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:55.317612 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:55.317612 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:55.317612 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:55.317612 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:55.317612 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:55.317612 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:55.317612 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:55.317612 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:55.317612 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:55.317612 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:55.317612 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:55.317612 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:55.317612 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:55.317612 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:55.317612 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:55.318724 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:55.318724 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:55.318724 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:55.318724 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:55.318724 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:55.318724 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:55.318724 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:55.318724 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:55.318724 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:55.318724 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:55.318724 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:55.318724 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:55.318724 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:55.318724 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:55.318724 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:55.318724 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:55.318724 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:55.320655 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:55.320655 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:55.320655 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:55.320655 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 491/955] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:43:55.325622 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2c954-d9fe-417f-8c5c-5ad2827196e7 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:55.338785 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-2a595192-5dc8-4f1e-977f-5479a9724dd9 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:55.341561 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-2a595192-5dc8-4f1e-977f-5479a9724dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:55.396174 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:55.429431 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 465/956] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:43:55.440385 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2c954-d9fe-417f-8c5c-5ad2827196e7 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:55.476936 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb899c8-a610-49c3-97d1-6c40cbdc1609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:55.477907 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb899c8-a610-49c3-97d1-6c40cbdc1609 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:55.478414 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb899c8-a610-49c3-97d1-6c40cbdc1609 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:55.478904 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb899c8-a610-49c3-97d1-6c40cbdc1609 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:55.479761 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb899c8-a610-49c3-97d1-6c40cbdc1609 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:55.480985 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb899c8-a610-49c3-97d1-6c40cbdc1609 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:55.482698 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb899c8-a610-49c3-97d1-6c40cbdc1609 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:55.495785 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 492/957] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:55.503462 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a595192-5dc8-4f1e-977f-5479a9724dd9 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:55.610706 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a595192-5dc8-4f1e-977f-5479a9724dd9 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:55.613039 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:55.647673 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf61cb3-0011-4fd5-8888-cd3289eb562b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:55.648223 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf61cb3-0011-4fd5-8888-cd3289eb562b None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:55.648503 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf61cb3-0011-4fd5-8888-cd3289eb562b None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:55.648778 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf61cb3-0011-4fd5-8888-cd3289eb562b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:55.656665 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf61cb3-0011-4fd5-8888-cd3289eb562b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:55.658104 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf61cb3-0011-4fd5-8888-cd3289eb562b None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:55.670457 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-8bf61cb3-0011-4fd5-8888-cd3289eb562b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 15:43:55.670457 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:55.670457 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:55.670457 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:55.670457 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:55.670457 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:55.670457 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:55.670457 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:55.670457 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:55.670457 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:55.670457 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:55.670457 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:55.670457 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:43:55.670457 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:43:55.670457 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:43:55.670457 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:43:55.671491 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:55.671491 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:55.671491 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:43:55.671491 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:55.671491 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:43:55.671491 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:55.671491 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:55.671491 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:55.671491 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:55.671491 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:55.671491 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:55.671491 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:55.671491 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:55.671491 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:55.671491 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:55.671491 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:55.671491 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:55.671491 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:55.672425 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:55.672425 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:55.672425 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:43:55.672425 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:43:55.672425 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:43:55.672425 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:43:55.672425 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:43:55.672425 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:43:55.672425 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 15:43:55.672425 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:55.676366 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 466/958] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Sep 7 15:43:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:55.679344 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb899c8-a610-49c3-97d1-6c40cbdc1609 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:55.717866 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf61cb3-0011-4fd5-8888-cd3289eb562b None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:55.807695 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb899c8-a610-49c3-97d1-6c40cbdc1609 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:55.834494 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf61cb3-0011-4fd5-8888-cd3289eb562b None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:55.834721 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:55.847517 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64707887-42f5-4da5-86c7-6a810464797f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:55.848132 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64707887-42f5-4da5-86c7-6a810464797f None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:55.848416 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64707887-42f5-4da5-86c7-6a810464797f None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:55.848690 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64707887-42f5-4da5-86c7-6a810464797f None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:55.849416 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64707887-42f5-4da5-86c7-6a810464797f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:55.849722 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64707887-42f5-4da5-86c7-6a810464797f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:55.851198 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64707887-42f5-4da5-86c7-6a810464797f None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:55.868672 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 493/959] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Sep 7 15:43:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:55.869894 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0656e-9e13-4e02-9915-0cfd48e08255 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:55.870202 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0656e-9e13-4e02-9915-0cfd48e08255 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:55.870481 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0656e-9e13-4e02-9915-0cfd48e08255 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:55.871855 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 494/960] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:43:55.875302 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0656e-9e13-4e02-9915-0cfd48e08255 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:55.879436 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ddcb3-f2bb-4648-9be6-18db849fef03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:55.880078 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ddcb3-f2bb-4648-9be6-18db849fef03 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:55.880355 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ddcb3-f2bb-4648-9be6-18db849fef03 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:55.880626 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ddcb3-f2bb-4648-9be6-18db849fef03 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:55.881212 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ddcb3-f2bb-4648-9be6-18db849fef03 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:55.882613 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ddcb3-f2bb-4648-9be6-18db849fef03 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:55.892176 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-bb1ddcb3-f2bb-4648-9be6-18db849fef03 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 15:43:55.892176 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:55.892176 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 15:43:55.892176 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 15:43:55.892176 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 15:43:55.892176 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 15:43:55.892176 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 15:43:55.892176 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:43:55.892176 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 15:43:55.892176 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:55.892176 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:43:55.892176 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:55.892176 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:55.892176 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:55.892176 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:55.892176 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:55.892176 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:55.893263 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:55.893263 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:55.893263 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:55.893263 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:55.893263 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:55.893263 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:55.893263 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 15:43:55.893263 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 15:43:55.893263 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 15:43:55.893263 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 15:43:55.893263 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:55.893263 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:55.893263 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:55.893263 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:55.893263 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:55.893263 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:55.894123 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:55.894123 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:55.894123 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:55.894123 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:55.894123 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:55.894123 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:55.894123 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:55.894123 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:55.894123 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:55.894123 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:55.894123 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 15:43:55.894123 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:43:55.894123 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 15:43:55.894123 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:55.894123 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 467/961] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Sep 7 15:43:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:55.894968 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da51033-568f-4d6b-b4b2-10a9d5dc7923 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:55.894968 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da51033-568f-4d6b-b4b2-10a9d5dc7923 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:55.894968 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da51033-568f-4d6b-b4b2-10a9d5dc7923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:55.914281 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-0da51033-568f-4d6b-b4b2-10a9d5dc7923 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:55.915397 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-0da51033-568f-4d6b-b4b2-10a9d5dc7923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:55.939951 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:55.993252 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 468/962] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:43:55.993991 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da51033-568f-4d6b-b4b2-10a9d5dc7923 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:56.009243 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0656e-9e13-4e02-9915-0cfd48e08255 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:56.056983 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc0a5f-745b-4b61-b961-aec65e232334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:56.057725 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc0a5f-745b-4b61-b961-aec65e232334 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:56.058114 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc0a5f-745b-4b61-b961-aec65e232334 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:56.059177 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc0a5f-745b-4b61-b961-aec65e232334 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:56.111978 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da51033-568f-4d6b-b4b2-10a9d5dc7923 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:56.127343 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:56.149642 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52239404-0ac0-4042-925b-f6c01b80cccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:56.150543 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52239404-0ac0-4042-925b-f6c01b80cccc None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:56.150973 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52239404-0ac0-4042-925b-f6c01b80cccc None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:56.151410 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52239404-0ac0-4042-925b-f6c01b80cccc None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:56.152831 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52239404-0ac0-4042-925b-f6c01b80cccc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:56.153333 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52239404-0ac0-4042-925b-f6c01b80cccc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:56.154933 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52239404-0ac0-4042-925b-f6c01b80cccc None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:56.155067 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc0a5f-745b-4b61-b961-aec65e232334 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:56.156931 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befc0a5f-745b-4b61-b961-aec65e232334 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:56.165504 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 469/963] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Sep 7 15:43:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:56.166989 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52239404-0ac0-4042-925b-f6c01b80cccc None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:56.194097 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:56.283178 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52239404-0ac0-4042-925b-f6c01b80cccc None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:56.284625 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 495/964] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:43:55 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 07 15:43:56.287089 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc0a5f-745b-4b61-b961-aec65e232334 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:56.319480 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1cb25a-2b81-4cdc-9686-eb50cf61843d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:56.320088 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1cb25a-2b81-4cdc-9686-eb50cf61843d None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:56.320365 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1cb25a-2b81-4cdc-9686-eb50cf61843d None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:56.320637 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1cb25a-2b81-4cdc-9686-eb50cf61843d None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:56.321262 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1cb25a-2b81-4cdc-9686-eb50cf61843d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:56.321564 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1cb25a-2b81-4cdc-9686-eb50cf61843d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:56.322943 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1cb25a-2b81-4cdc-9686-eb50cf61843d None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:56.328626 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 470/965] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Sep 7 15:43:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:56.329405 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1cb25a-2b81-4cdc-9686-eb50cf61843d None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:56.388196 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:56.407972 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc0a5f-745b-4b61-b961-aec65e232334 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:56.422525 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:56.440670 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1cb25a-2b81-4cdc-9686-eb50cf61843d None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:56.448217 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a777e773-d15f-451c-a451-28f184f1e62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:56.448884 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777e773-d15f-451c-a451-28f184f1e62c None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:56.449779 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777e773-d15f-451c-a451-28f184f1e62c None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:56.450440 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777e773-d15f-451c-a451-28f184f1e62c None admin] PATH_INFO: `/v3/services/compute` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:56.451033 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a777e773-d15f-451c-a451-28f184f1e62c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:56.452729 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a777e773-d15f-451c-a451-28f184f1e62c None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:56.461793 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-a777e773-d15f-451c-a451-28f184f1e62c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 15:43:56.461793 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:56.461793 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 15:43:56.461793 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 15:43:56.461793 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 15:43:56.461793 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 15:43:56.461793 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 15:43:56.461793 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:43:56.461793 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 15:43:56.461793 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:56.461793 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:43:56.461793 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:56.461793 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:56.461793 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:56.461793 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:56.461793 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:56.461793 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:56.462811 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:56.462811 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:56.462811 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:56.462811 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:56.462811 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:56.462811 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:56.462811 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 15:43:56.462811 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 15:43:56.462811 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 15:43:56.462811 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 15:43:56.462811 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:56.462811 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:56.462811 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:56.462811 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:56.462811 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:56.462811 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:56.463652 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:56.463652 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:56.463652 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:56.463652 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:56.463652 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:56.463652 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:56.463652 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:56.463652 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:56.463652 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:56.463652 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:56.463652 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 15:43:56.463652 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:43:56.463652 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 15:43:56.463652 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:56.463652 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 496/966] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:43:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:56.464460 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a777e773-d15f-451c-a451-28f184f1e62c None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:56.482246 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69061fb-115b-472f-96a9-b31af14d5626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:56.482883 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69061fb-115b-472f-96a9-b31af14d5626 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:56.483420 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69061fb-115b-472f-96a9-b31af14d5626 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:56.483719 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69061fb-115b-472f-96a9-b31af14d5626 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:56.494730 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69061fb-115b-472f-96a9-b31af14d5626 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:56.496673 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69061fb-115b-472f-96a9-b31af14d5626 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:56.511243 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-e69061fb-115b-472f-96a9-b31af14d5626 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:56.511243 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:56.511243 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:56.511243 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:56.511243 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:56.511243 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:56.511243 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:56.511243 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:56.511243 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:56.511243 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:56.511243 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:56.511243 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:56.511243 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:43:56.511243 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:43:56.511243 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:43:56.511243 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:43:56.512329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:56.512329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:56.512329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:56.512329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:56.512329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:56.512329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:56.512329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:56.512329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:56.512329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:56.512329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:56.512329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:56.512329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:56.512329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:56.512329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:56.512329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:56.512329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:56.512329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:43:56.513300 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:43:56.513300 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:43:56.513300 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:56.517213 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 471/967] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:43:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:56.518057 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69061fb-115b-472f-96a9-b31af14d5626 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:56.571576 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a777e773-d15f-451c-a451-28f184f1e62c None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:56.605021 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee052cf-48a6-4796-8254-05220d5806d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:56.606630 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee052cf-48a6-4796-8254-05220d5806d0 None admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:56.607205 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee052cf-48a6-4796-8254-05220d5806d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:56.607634 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee052cf-48a6-4796-8254-05220d5806d0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:56.608698 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee052cf-48a6-4796-8254-05220d5806d0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:56.610260 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee052cf-48a6-4796-8254-05220d5806d0 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:56.625893 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69061fb-115b-472f-96a9-b31af14d5626 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:56.642207 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 497/968] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:43:56 2022] POST /identity/v3/endpoints => generated 349 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:43:56.642207 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee052cf-48a6-4796-8254-05220d5806d0 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:56.646475 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:56.676405 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11543b60-3690-4ddf-b285-cea7803b70a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:56.677212 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11543b60-3690-4ddf-b285-cea7803b70a2 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:56.677494 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11543b60-3690-4ddf-b285-cea7803b70a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:56.677764 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11543b60-3690-4ddf-b285-cea7803b70a2 None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:56.678433 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11543b60-3690-4ddf-b285-cea7803b70a2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:56.678902 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11543b60-3690-4ddf-b285-cea7803b70a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:56.680996 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11543b60-3690-4ddf-b285-cea7803b70a2 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:56.682940 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:56.690643 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 472/969] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Sep 7 15:43:56 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:56.696123 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11543b60-3690-4ddf-b285-cea7803b70a2 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:56.773207 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee052cf-48a6-4796-8254-05220d5806d0 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:56.812310 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d946ea-9e23-48e8-a892-cf403f7b0270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:56.813030 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d946ea-9e23-48e8-a892-cf403f7b0270 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:56.813462 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d946ea-9e23-48e8-a892-cf403f7b0270 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:56.813742 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d946ea-9e23-48e8-a892-cf403f7b0270 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:56.814538 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d946ea-9e23-48e8-a892-cf403f7b0270 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:56.814852 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d946ea-9e23-48e8-a892-cf403f7b0270 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:56.816231 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d946ea-9e23-48e8-a892-cf403f7b0270 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:56.834335 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 498/970] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:43:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:56.836638 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11543b60-3690-4ddf-b285-cea7803b70a2 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:56.836950 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d946ea-9e23-48e8-a892-cf403f7b0270 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:56.892641 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e79480-8789-4387-ad7c-14f43ab211da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:56.893083 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e79480-8789-4387-ad7c-14f43ab211da None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:56.893362 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e79480-8789-4387-ad7c-14f43ab211da None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:56.893633 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e79480-8789-4387-ad7c-14f43ab211da None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:56.894309 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e79480-8789-4387-ad7c-14f43ab211da None admin] RBAC: Adding query filter params (type=compute) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:56.894612 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e79480-8789-4387-ad7c-14f43ab211da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:56.895983 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e79480-8789-4387-ad7c-14f43ab211da None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:56.901260 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 473/971] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Sep 7 15:43:56 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:43:56.928933 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:56.975789 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d946ea-9e23-48e8-a892-cf403f7b0270 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:57.016158 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5469d764-f1d5-4938-b714-2a47c45bd880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:57.016944 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469d764-f1d5-4938-b714-2a47c45bd880 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:57.017138 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469d764-f1d5-4938-b714-2a47c45bd880 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:57.017761 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469d764-f1d5-4938-b714-2a47c45bd880 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:57.025885 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5469d764-f1d5-4938-b714-2a47c45bd880 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:57.028160 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5469d764-f1d5-4938-b714-2a47c45bd880 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:57.052915 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-5469d764-f1d5-4938-b714-2a47c45bd880 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:57.052915 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:57.052915 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:57.052915 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:57.052915 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:57.052915 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:57.052915 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:57.052915 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:57.052915 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:57.052915 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:57.052915 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:57.052915 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:57.052915 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:43:57.052915 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:43:57.052915 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:43:57.053876 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:43:57.053876 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:57.053876 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:57.053876 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:57.053876 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:57.053876 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:57.053876 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:57.053876 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:57.053876 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:57.053876 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:57.053876 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:57.053876 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:57.053876 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:57.053876 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:57.053876 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:57.053876 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:57.053876 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:57.054819 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:43:57.054819 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:43:57.054819 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:43:57.054819 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:43:57.054819 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:43:57.054819 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:43:57.054819 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:43:57.054819 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:57.058821 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 499/972] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:43:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:43:57.062453 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e79480-8789-4387-ad7c-14f43ab211da None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:57.133336 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:57.178661 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e79480-8789-4387-ad7c-14f43ab211da None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:57.215531 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d79def-6251-4ec3-99af-cefa026bdda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:57.216361 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d79def-6251-4ec3-99af-cefa026bdda5 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:57.216641 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d79def-6251-4ec3-99af-cefa026bdda5 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:57.216914 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d79def-6251-4ec3-99af-cefa026bdda5 None admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:57.217620 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d79def-6251-4ec3-99af-cefa026bdda5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:57.217988 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d79def-6251-4ec3-99af-cefa026bdda5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:57.219581 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d79def-6251-4ec3-99af-cefa026bdda5 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:57.234748 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 474/973] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 7 15:43:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:57.240642 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5469d764-f1d5-4938-b714-2a47c45bd880 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:57.245838 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889bf092-f919-49ab-9665-9a76fbdedded None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:57.246126 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889bf092-f919-49ab-9665-9a76fbdedded None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:57.246423 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889bf092-f919-49ab-9665-9a76fbdedded None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:57.247870 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 475/974] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:43:57.252941 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595f162-15cb-42c4-907e-38fdf599005d None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:57.253221 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595f162-15cb-42c4-907e-38fdf599005d None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:57.253495 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595f162-15cb-42c4-907e-38fdf599005d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:57.272285 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-3595f162-15cb-42c4-907e-38fdf599005d None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:57.273479 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-3595f162-15cb-42c4-907e-38fdf599005d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:57.343239 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 476/975] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 15:43:57.355034 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5469d764-f1d5-4938-b714-2a47c45bd880 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:57.381673 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:57.394209 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940a889-3e8b-416f-a9f2-3f99010f318f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:57.394835 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940a889-3e8b-416f-a9f2-3f99010f318f None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:57.395116 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940a889-3e8b-416f-a9f2-3f99010f318f None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:57.395390 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940a889-3e8b-416f-a9f2-3f99010f318f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:57.396172 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a940a889-3e8b-416f-a9f2-3f99010f318f None admin] RBAC: Adding query filter params (role.id=aff163e4c39f4c2f980bc6a6a6ca3d43, scope.project.id=488830167943488f85743236584113d7, user.id=3e20e40a37df4898bfe692535e5e4f25) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:57.396485 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a940a889-3e8b-416f-a9f2-3f99010f318f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:57.397913 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a940a889-3e8b-416f-a9f2-3f99010f318f None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:57.410339 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 500/976] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 7 15:43:57 2022] GET /identity/v3/role_assignments?user.id=3e20e40a37df4898bfe692535e5e4f25&scope.project.id=488830167943488f85743236584113d7&role.id=aff163e4c39f4c2f980bc6a6a6ca3d43 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:57.622454 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595f162-15cb-42c4-907e-38fdf599005d None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:57.681427 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:57.730656 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595f162-15cb-42c4-907e-38fdf599005d None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:57.766933 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6800798-4264-4727-bb85-6dc09131eb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:57.767545 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6800798-4264-4727-bb85-6dc09131eb19 None admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:57.767827 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6800798-4264-4727-bb85-6dc09131eb19 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:57.768155 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6800798-4264-4727-bb85-6dc09131eb19 None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:57.768795 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6800798-4264-4727-bb85-6dc09131eb19 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:57.770233 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6800798-4264-4727-bb85-6dc09131eb19 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:57.785644 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.sql.core [None req-f6800798-4264-4727-bb85-6dc09131eb19 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 07 15:43:57.785644 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 07 15:43:57.785644 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [parameters: {'user_id': '59c0d896faba4fbebd08cb5b4a840485', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 07 15:43:57.785644 dv-cinder-853315-8-smb devstack@keystone.service[81502]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81502) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 07 15:43:57.793275 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-f6800798-4264-4727-bb85-6dc09131eb19 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 07 15:43:57.793275 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:57.793275 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 07 15:43:57.793275 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 07 15:43:57.793275 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 07 15:43:57.793275 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 07 15:43:57.793275 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 07 15:43:57.793275 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application result = self._query(query) Sep 07 15:43:57.793275 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 07 15:43:57.793275 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application conn.query(q) Sep 07 15:43:57.793275 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 07 15:43:57.793275 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 07 15:43:57.793275 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 07 15:43:57.793275 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application result.read() Sep 07 15:43:57.793275 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 07 15:43:57.794333 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 07 15:43:57.794333 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 07 15:43:57.794333 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 07 15:43:57.794333 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 07 15:43:57.794333 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 07 15:43:57.794333 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 07 15:43:57.794333 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 07 15:43:57.794333 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 07 15:43:57.794333 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:57.794333 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 07 15:43:57.794333 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:57.794333 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:57.794333 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 07 15:43:57.794333 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 07 15:43:57.794333 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 07 15:43:57.794333 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 07 15:43:57.794333 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 07 15:43:57.794333 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application next(self.gen) Sep 07 15:43:57.795298 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 07 15:43:57.795298 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application yield resource Sep 07 15:43:57.795298 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 07 15:43:57.795298 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application next(self.gen) Sep 07 15:43:57.795298 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 07 15:43:57.795298 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self.session.rollback() Sep 07 15:43:57.795298 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 15:43:57.795298 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self.force_reraise() Sep 07 15:43:57.795298 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 15:43:57.795298 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise self.value Sep 07 15:43:57.795298 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 07 15:43:57.795298 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 07 15:43:57.795298 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 07 15:43:57.795298 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application session.commit() Sep 07 15:43:57.795298 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 07 15:43:57.795298 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 07 15:43:57.795298 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 07 15:43:57.796213 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._prepare_impl() Sep 07 15:43:57.796213 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 07 15:43:57.796213 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self.session.flush() Sep 07 15:43:57.796213 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 07 15:43:57.796213 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._flush(objects) Sep 07 15:43:57.796213 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 07 15:43:57.796213 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 07 15:43:57.796213 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 07 15:43:57.796213 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application compat.raise_( Sep 07 15:43:57.796213 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 07 15:43:57.796213 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception Sep 07 15:43:57.796213 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 07 15:43:57.796213 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application flush_context.execute() Sep 07 15:43:57.796213 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 07 15:43:57.796213 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rec.execute(self) Sep 07 15:43:57.796213 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 07 15:43:57.796213 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 07 15:43:57.797118 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 07 15:43:57.797118 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 07 15:43:57.797118 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 07 15:43:57.797118 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 07 15:43:57.797118 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 07 15:43:57.797118 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 07 15:43:57.797118 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 07 15:43:57.797118 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 07 15:43:57.797118 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 07 15:43:57.797118 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 07 15:43:57.797118 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 07 15:43:57.797118 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 07 15:43:57.797118 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 07 15:43:57.797118 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 07 15:43:57.797118 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 07 15:43:57.797118 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception Sep 07 15:43:57.798155 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 07 15:43:57.798155 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 07 15:43:57.798155 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 07 15:43:57.798155 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 07 15:43:57.798155 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 07 15:43:57.798155 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application result = self._query(query) Sep 07 15:43:57.798155 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 07 15:43:57.798155 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application conn.query(q) Sep 07 15:43:57.798155 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 07 15:43:57.798155 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 07 15:43:57.798155 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 07 15:43:57.798155 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application result.read() Sep 07 15:43:57.798155 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 07 15:43:57.798155 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 07 15:43:57.798155 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 07 15:43:57.798155 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 07 15:43:57.799047 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 07 15:43:57.799047 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 07 15:43:57.799047 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 07 15:43:57.799047 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 07 15:43:57.799047 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 07 15:43:57.799047 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 07 15:43:57.799047 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [parameters: {'user_id': '59c0d896faba4fbebd08cb5b4a840485', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 07 15:43:57.799047 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 07 15:43:57.799047 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:57.799047 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:43:57.799047 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:57.799047 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:57.799047 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:57.799047 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:57.799047 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:57.799863 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:57.799863 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:57.799863 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:57.799863 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:57.799863 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:57.799863 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:57.799863 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:57.799863 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 07 15:43:57.799863 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 07 15:43:57.799863 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:57.799863 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:57.799863 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:43:57.799863 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:57.799863 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:43:57.799863 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:57.799863 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 07 15:43:57.799863 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 07 15:43:57.800795 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 07 15:43:57.800795 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 07 15:43:57.800795 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 07 15:43:57.800795 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 07 15:43:57.800795 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 07 15:43:57.800795 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:43:57.800795 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 477/977] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Sep 7 15:43:57 2022] POST /identity/v3/users => generated 160 bytes in 173 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:57.808846 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940a889-3e8b-416f-a9f2-3f99010f318f None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:57.922039 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940a889-3e8b-416f-a9f2-3f99010f318f None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:57.956761 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c748602c-e154-41bd-9f65-389bf24f41cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:57.957465 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748602c-e154-41bd-9f65-389bf24f41cc None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:57.957750 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748602c-e154-41bd-9f65-389bf24f41cc None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:57.958029 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748602c-e154-41bd-9f65-389bf24f41cc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:57.966971 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c748602c-e154-41bd-9f65-389bf24f41cc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:57.968590 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c748602c-e154-41bd-9f65-389bf24f41cc None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:57.980838 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-c748602c-e154-41bd-9f65-389bf24f41cc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 15:43:57.980838 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:57.980838 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:57.980838 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:57.980838 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:57.980838 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:57.980838 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:57.980838 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:57.980838 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:57.980838 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:57.980838 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:57.980838 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:57.980838 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:43:57.980838 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:43:57.980838 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:43:57.980838 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:43:57.981904 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:57.981904 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:57.981904 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:43:57.981904 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:57.981904 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:43:57.981904 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:43:57.981904 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:57.981904 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:57.981904 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:57.981904 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:57.981904 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:57.981904 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:57.981904 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:57.981904 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:57.981904 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:57.981904 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:57.981904 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:57.981904 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:57.982886 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:57.982886 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:57.982886 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:43:57.982886 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:43:57.982886 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:43:57.982886 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:43:57.982886 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:43:57.982886 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:43:57.982886 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 15:43:57.982886 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:57.982886 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 501/978] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:43:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:57.990092 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6800798-4264-4727-bb85-6dc09131eb19 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:58.105891 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6800798-4264-4727-bb85-6dc09131eb19 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:58.122265 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:58.143369 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5debfb-0545-4342-bf8f-66fcd7a701f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:58.143976 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5debfb-0545-4342-bf8f-66fcd7a701f5 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:58.144260 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5debfb-0545-4342-bf8f-66fcd7a701f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:58.144536 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5debfb-0545-4342-bf8f-66fcd7a701f5 None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:58.145235 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5debfb-0545-4342-bf8f-66fcd7a701f5 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:58.145541 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5debfb-0545-4342-bf8f-66fcd7a701f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:58.147248 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5debfb-0545-4342-bf8f-66fcd7a701f5 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:58.188169 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 478/979] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Sep 7 15:43:57 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:58.936033 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3c3ba-c4fe-492a-8655-e029d7aef95f None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:58.936552 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3c3ba-c4fe-492a-8655-e029d7aef95f None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:58.936661 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3c3ba-c4fe-492a-8655-e029d7aef95f None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:58.937928 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 502/980] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:43:58.943216 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ef4c1-5440-4104-a323-d69568feb39b None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:58.943589 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ef4c1-5440-4104-a323-d69568feb39b None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:58.943785 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ef4c1-5440-4104-a323-d69568feb39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:58.962713 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-190ef4c1-5440-4104-a323-d69568feb39b None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:58.964239 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-190ef4c1-5440-4104-a323-d69568feb39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:59.046198 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 479/981] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:43:59.143641 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2db11-f9a8-4c45-8393-1448bc130fc7 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:59.143956 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2db11-f9a8-4c45-8393-1448bc130fc7 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:59.144194 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2db11-f9a8-4c45-8393-1448bc130fc7 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:59.145749 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 503/982] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:43:59.151043 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc5837-a48d-4487-b92e-caea36f7a3f7 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:59.151337 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc5837-a48d-4487-b92e-caea36f7a3f7 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:59.151616 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc5837-a48d-4487-b92e-caea36f7a3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:59.178945 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-00bc5837-a48d-4487-b92e-caea36f7a3f7 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:59.180147 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-00bc5837-a48d-4487-b92e-caea36f7a3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:59.253762 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 480/983] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:43:59.330318 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2db11-f9a8-4c45-8393-1448bc130fc7 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:59.382710 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:59.443277 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2db11-f9a8-4c45-8393-1448bc130fc7 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:59.484189 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92bb8c9-9a8c-4a13-835d-2cf13f2108e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:59.485203 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92bb8c9-9a8c-4a13-835d-2cf13f2108e6 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:59.485710 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92bb8c9-9a8c-4a13-835d-2cf13f2108e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:59.486233 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92bb8c9-9a8c-4a13-835d-2cf13f2108e6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:59.487043 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92bb8c9-9a8c-4a13-835d-2cf13f2108e6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:59.488669 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92bb8c9-9a8c-4a13-835d-2cf13f2108e6 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:59.500292 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-f92bb8c9-9a8c-4a13-835d-2cf13f2108e6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 15:43:59.500292 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:59.500292 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 15:43:59.500292 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 15:43:59.500292 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 15:43:59.500292 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 15:43:59.500292 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 15:43:59.500292 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:43:59.500292 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 15:43:59.500292 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:59.500292 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:43:59.500292 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:59.500292 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:43:59.500292 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:43:59.500292 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:43:59.500292 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:43:59.500292 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:43:59.501348 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:43:59.501348 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:43:59.501348 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:43:59.501348 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:43:59.501348 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:43:59.501348 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:43:59.501348 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 15:43:59.501348 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 15:43:59.501348 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 15:43:59.501348 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 15:43:59.501348 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:43:59.501348 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:43:59.501348 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:43:59.501348 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:43:59.501348 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:43:59.501348 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:43:59.502242 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:43:59.502242 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:43:59.502242 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:43:59.502242 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:43:59.502242 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:43:59.502242 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:43:59.502242 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:43:59.502242 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:43:59.502242 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:43:59.502242 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:43:59.502242 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 15:43:59.502242 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:43:59.502242 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 15:43:59.502242 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:43:59.510913 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc5837-a48d-4487-b92e-caea36f7a3f7 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:59.515763 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 504/984] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Sep 7 15:43:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:43:59.533413 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92bb8c9-9a8c-4a13-835d-2cf13f2108e6 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:59.550899 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:59.634485 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc5837-a48d-4487-b92e-caea36f7a3f7 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:59.649535 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92bb8c9-9a8c-4a13-835d-2cf13f2108e6 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:59.661684 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:59.676332 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb6ea83-adfe-45e0-b8ec-16a582a26b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:59.676947 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6ea83-adfe-45e0-b8ec-16a582a26b5c None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:59.677232 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6ea83-adfe-45e0-b8ec-16a582a26b5c None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:59.677714 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6ea83-adfe-45e0-b8ec-16a582a26b5c None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:59.678135 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb6ea83-adfe-45e0-b8ec-16a582a26b5c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:59.678475 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb6ea83-adfe-45e0-b8ec-16a582a26b5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:59.679843 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb6ea83-adfe-45e0-b8ec-16a582a26b5c None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:59.686220 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 481/985] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Sep 7 15:43:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:43:59.690852 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb6ea83-adfe-45e0-b8ec-16a582a26b5c None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:59.694788 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf5b26-70ad-419f-b285-b3d9100cd635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:59.695409 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf5b26-70ad-419f-b285-b3d9100cd635 None admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:59.695692 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf5b26-70ad-419f-b285-b3d9100cd635 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:59.695966 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf5b26-70ad-419f-b285-b3d9100cd635 None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:59.696615 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adf5b26-70ad-419f-b285-b3d9100cd635 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:59.697990 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adf5b26-70ad-419f-b285-b3d9100cd635 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:59.714928 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 505/986] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Sep 7 15:43:59 2022] POST /identity/v3/services => generated 242 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 15:43:59.729804 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70e66b-d8f0-4a56-98f0-eb03758825d0 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:59.730712 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70e66b-d8f0-4a56-98f0-eb03758825d0 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:59.731155 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70e66b-d8f0-4a56-98f0-eb03758825d0 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:59.733477 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 506/987] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:43:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:43:59.739265 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b97f74-cc27-4faa-bade-43c746ab5f5d None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:59.739607 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b97f74-cc27-4faa-bade-43c746ab5f5d None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:59.739830 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b97f74-cc27-4faa-bade-43c746ab5f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:59.759711 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-29b97f74-cc27-4faa-bade-43c746ab5f5d None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:43:59.761013 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-29b97f74-cc27-4faa-bade-43c746ab5f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:43:59.800651 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:59.810154 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb6ea83-adfe-45e0-b8ec-16a582a26b5c None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:43:59.846736 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 507/988] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:43:59 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 15:43:59.849158 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e96ad-116f-4ea8-92b3-dd0247b90db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:43:59.849780 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e96ad-116f-4ea8-92b3-dd0247b90db9 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:43:59.850058 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e96ad-116f-4ea8-92b3-dd0247b90db9 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:43:59.850363 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e96ad-116f-4ea8-92b3-dd0247b90db9 None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:43:59.851001 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e96ad-116f-4ea8-92b3-dd0247b90db9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:43:59.851302 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e96ad-116f-4ea8-92b3-dd0247b90db9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:43:59.852667 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e96ad-116f-4ea8-92b3-dd0247b90db9 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:43:59.859468 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 482/989] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Sep 7 15:43:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:43:59.865240 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b97f74-cc27-4faa-bade-43c746ab5f5d None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:43:59.965248 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:43:59.971567 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b97f74-cc27-4faa-bade-43c746ab5f5d None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:00.009332 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73868ecd-3350-4b61-be3c-90c97541c223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:00.009948 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73868ecd-3350-4b61-be3c-90c97541c223 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:00.010252 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73868ecd-3350-4b61-be3c-90c97541c223 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:00.010528 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73868ecd-3350-4b61-be3c-90c97541c223 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:00.011286 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73868ecd-3350-4b61-be3c-90c97541c223 None admin] RBAC: Adding query filter params (interface=admin, service_id=bd2ac96ebdcc42ae8654696ff760d5dc, region_id=RegionOne) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:44:00.012277 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73868ecd-3350-4b61-be3c-90c97541c223 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:00.013834 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73868ecd-3350-4b61-be3c-90c97541c223 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:00.019341 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 508/990] 10.222.0.16 () {56 vars in 1249 bytes} [Wed Sep 7 15:43:59 2022] GET /identity/v3/endpoints?service_id=bd2ac96ebdcc42ae8654696ff760d5dc&interface=admin®ion_id=RegionOne => generated 193 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:44:00.024943 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e96ad-116f-4ea8-92b3-dd0247b90db9 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:00.126300 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73868ecd-3350-4b61-be3c-90c97541c223 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:00.129552 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e96ad-116f-4ea8-92b3-dd0247b90db9 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:00.163822 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32885c7-d6d8-42ff-af97-5ac9a67bcd69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:00.164402 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32885c7-d6d8-42ff-af97-5ac9a67bcd69 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:00.164684 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32885c7-d6d8-42ff-af97-5ac9a67bcd69 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:00.164959 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32885c7-d6d8-42ff-af97-5ac9a67bcd69 None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:00.165563 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32885c7-d6d8-42ff-af97-5ac9a67bcd69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:00.166951 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32885c7-d6d8-42ff-af97-5ac9a67bcd69 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:00.174477 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 483/991] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Sep 7 15:44:00 2022] GET /identity/v3/services => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:44:00.237514 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73868ecd-3350-4b61-be3c-90c97541c223 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:00.277059 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a92a77-1805-4098-aa76-68105298fae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:00.277908 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a92a77-1805-4098-aa76-68105298fae3 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:00.278224 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a92a77-1805-4098-aa76-68105298fae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:00.278554 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a92a77-1805-4098-aa76-68105298fae3 None admin] PATH_INFO: `/v3/services/image` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:00.279152 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a92a77-1805-4098-aa76-68105298fae3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:00.280550 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a92a77-1805-4098-aa76-68105298fae3 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:00.290351 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-86a92a77-1805-4098-aa76-68105298fae3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 15:44:00.290351 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:44:00.290351 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 15:44:00.290351 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 15:44:00.290351 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 15:44:00.290351 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 15:44:00.290351 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 15:44:00.290351 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:44:00.290351 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 15:44:00.290351 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:44:00.290351 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:44:00.290351 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:44:00.290351 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:44:00.290351 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:44:00.290351 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:44:00.290351 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:44:00.290351 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:44:00.291406 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:44:00.291406 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:44:00.291406 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:44:00.291406 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:44:00.291406 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:44:00.291406 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:44:00.291406 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 15:44:00.291406 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 15:44:00.291406 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 15:44:00.291406 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 15:44:00.291406 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:44:00.291406 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:44:00.291406 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:44:00.291406 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:44:00.291406 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:44:00.291406 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:44:00.292289 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:44:00.292289 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:44:00.292289 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:44:00.292289 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:44:00.292289 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:44:00.292289 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:44:00.292289 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:44:00.292289 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:44:00.292289 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:44:00.292289 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:44:00.292289 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 15:44:00.292289 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:44:00.292289 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 15:44:00.292289 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:44:00.297461 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 509/992] 10.222.0.16 () {56 vars in 1105 bytes} [Wed Sep 7 15:44:00 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:44:00.298835 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32885c7-d6d8-42ff-af97-5ac9a67bcd69 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:00.328472 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:00.411453 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32885c7-d6d8-42ff-af97-5ac9a67bcd69 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:00.445711 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac4aef-f435-442a-9b87-dfcb2f599dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:00.446354 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac4aef-f435-442a-9b87-dfcb2f599dea None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:00.446641 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac4aef-f435-442a-9b87-dfcb2f599dea None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:00.446916 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac4aef-f435-442a-9b87-dfcb2f599dea None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:00.447549 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffac4aef-f435-442a-9b87-dfcb2f599dea None admin] RBAC: Adding query filter params (name=image) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:44:00.447855 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffac4aef-f435-442a-9b87-dfcb2f599dea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:00.449949 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffac4aef-f435-442a-9b87-dfcb2f599dea None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:00.455139 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 484/993] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:44:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:44:00.461017 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a92a77-1805-4098-aa76-68105298fae3 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:00.490397 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:00.571808 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a92a77-1805-4098-aa76-68105298fae3 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:00.606393 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab8ef97-cb54-438b-ac7b-7d0e8af9a984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:00.607014 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8ef97-cb54-438b-ac7b-7d0e8af9a984 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:00.607292 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8ef97-cb54-438b-ac7b-7d0e8af9a984 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:00.607566 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8ef97-cb54-438b-ac7b-7d0e8af9a984 None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:00.608470 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab8ef97-cb54-438b-ac7b-7d0e8af9a984 None admin] RBAC: Adding query filter params (type=image) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:44:00.608774 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab8ef97-cb54-438b-ac7b-7d0e8af9a984 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:00.610135 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab8ef97-cb54-438b-ac7b-7d0e8af9a984 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:00.622222 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 510/994] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:44:00 2022] GET /identity/v3/services?type=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:44:01.961646 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382b931-600b-43bb-a744-e66fdc56aaab None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:01.962165 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382b931-600b-43bb-a744-e66fdc56aaab None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:01.962502 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382b931-600b-43bb-a744-e66fdc56aaab None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:01.963607 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 485/995] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:44:01.969247 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007710e-4915-4f4f-9395-03edaabfef57 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:01.969640 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007710e-4915-4f4f-9395-03edaabfef57 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:01.969802 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007710e-4915-4f4f-9395-03edaabfef57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:01.989357 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-9007710e-4915-4f4f-9395-03edaabfef57 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:44:01.990596 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-9007710e-4915-4f4f-9395-03edaabfef57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:44:02.065908 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 511/996] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:44:01 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:44:02.339265 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a382b931-600b-43bb-a744-e66fdc56aaab None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:02.369373 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74742ab7-4d47-4960-8a2f-e542f0a3bd46 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:02.370005 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74742ab7-4d47-4960-8a2f-e542f0a3bd46 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:02.370801 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74742ab7-4d47-4960-8a2f-e542f0a3bd46 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:02.373090 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 512/997] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:44:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:44:02.378639 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971870d6-b91b-44a0-a227-193237192833 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:02.379160 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971870d6-b91b-44a0-a227-193237192833 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:02.380479 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971870d6-b91b-44a0-a227-193237192833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:02.405924 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-971870d6-b91b-44a0-a227-193237192833 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:44:02.408143 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-971870d6-b91b-44a0-a227-193237192833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:44:02.427730 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:02.436894 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:02.450136 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a382b931-600b-43bb-a744-e66fdc56aaab None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:02.486024 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbbf11c-26ee-4b3a-a756-62907ccf849b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:02.486690 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbbf11c-26ee-4b3a-a756-62907ccf849b None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:02.486969 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbbf11c-26ee-4b3a-a756-62907ccf849b None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:02.487243 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbbf11c-26ee-4b3a-a756-62907ccf849b None admin] PATH_INFO: `/v3/services/compute` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:02.487833 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbbf11c-26ee-4b3a-a756-62907ccf849b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:02.489184 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbbf11c-26ee-4b3a-a756-62907ccf849b None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:02.498913 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-2fbbf11c-26ee-4b3a-a756-62907ccf849b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 15:44:02.498913 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:44:02.498913 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 15:44:02.498913 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 15:44:02.498913 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 15:44:02.498913 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 15:44:02.498913 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 15:44:02.498913 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:44:02.498913 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 15:44:02.498913 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:44:02.498913 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:44:02.498913 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:44:02.498913 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:44:02.498913 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:44:02.498913 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:44:02.498913 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:44:02.498913 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:44:02.499899 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:44:02.499899 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:44:02.499899 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:44:02.499899 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:44:02.499899 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:44:02.499899 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:44:02.499899 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 15:44:02.499899 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 15:44:02.499899 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 15:44:02.499899 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 15:44:02.499899 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:44:02.499899 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:44:02.499899 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:44:02.499899 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:44:02.499899 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:44:02.499899 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:44:02.501331 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:44:02.501331 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:44:02.501331 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:44:02.501331 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:44:02.501331 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:44:02.501331 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:44:02.501331 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:44:02.501331 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:44:02.501331 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:44:02.501331 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:44:02.501331 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 15:44:02.501331 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:44:02.501331 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 15:44:02.501331 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:44:02.501331 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 486/998] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:44:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:44:02.504155 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 513/999] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:44:02 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:44:02.505786 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbbf11c-26ee-4b3a-a756-62907ccf849b None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:02.624966 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbbf11c-26ee-4b3a-a756-62907ccf849b None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:02.679553 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1854696b-286b-4e1e-8f22-d883202757ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:02.680499 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854696b-286b-4e1e-8f22-d883202757ec None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:02.680934 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854696b-286b-4e1e-8f22-d883202757ec None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:02.681359 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854696b-286b-4e1e-8f22-d883202757ec None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:02.682364 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1854696b-286b-4e1e-8f22-d883202757ec None admin] RBAC: Adding query filter params (name=compute) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:44:02.682842 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1854696b-286b-4e1e-8f22-d883202757ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:02.686016 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1854696b-286b-4e1e-8f22-d883202757ec None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:02.699050 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 487/1000] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Sep 7 15:44:02 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:44:02.700185 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971870d6-b91b-44a0-a227-193237192833 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:02.785115 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1854696b-286b-4e1e-8f22-d883202757ec None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:02.804485 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:02.809283 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971870d6-b91b-44a0-a227-193237192833 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:02.846158 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb5d94-5cbc-49ad-b531-a70078c1e972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:02.846791 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb5d94-5cbc-49ad-b531-a70078c1e972 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:02.847070 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb5d94-5cbc-49ad-b531-a70078c1e972 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:02.847351 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb5d94-5cbc-49ad-b531-a70078c1e972 None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:02.847969 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb5d94-5cbc-49ad-b531-a70078c1e972 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:44:02.848271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb5d94-5cbc-49ad-b531-a70078c1e972 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:02.849632 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb5d94-5cbc-49ad-b531-a70078c1e972 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:02.854316 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 514/1001] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Sep 7 15:44:02 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:44:02.859618 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b970c-e0dd-42b4-b21b-229eeba68ca6 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:02.859914 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b970c-e0dd-42b4-b21b-229eeba68ca6 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:02.860190 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b970c-e0dd-42b4-b21b-229eeba68ca6 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:02.861419 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 515/1002] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:44:02.862110 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b970c-e0dd-42b4-b21b-229eeba68ca6 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:02.877173 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:02.889960 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1854696b-286b-4e1e-8f22-d883202757ec None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:02.924729 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226dbcea-04ff-4209-b067-7ac2ff84036b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:02.925356 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226dbcea-04ff-4209-b067-7ac2ff84036b None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:02.925642 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226dbcea-04ff-4209-b067-7ac2ff84036b None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:02.925912 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226dbcea-04ff-4209-b067-7ac2ff84036b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:02.926521 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226dbcea-04ff-4209-b067-7ac2ff84036b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:02.927883 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226dbcea-04ff-4209-b067-7ac2ff84036b None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:02.936780 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-226dbcea-04ff-4209-b067-7ac2ff84036b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 15:44:02.936780 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:44:02.936780 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 15:44:02.936780 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 15:44:02.936780 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 15:44:02.936780 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 15:44:02.936780 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 15:44:02.936780 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:44:02.936780 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 15:44:02.936780 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:44:02.936780 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:44:02.936780 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:44:02.936780 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:44:02.936780 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:44:02.936780 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:44:02.936780 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:44:02.936780 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:44:02.942426 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:44:02.942426 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:44:02.942426 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:44:02.942426 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:44:02.942426 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:44:02.942426 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:44:02.942426 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 15:44:02.942426 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 15:44:02.942426 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 15:44:02.942426 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 15:44:02.942426 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:44:02.942426 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:44:02.942426 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:44:02.942426 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:44:02.942426 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:44:02.942426 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:44:02.943348 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:44:02.943348 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:44:02.943348 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:44:02.943348 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:44:02.943348 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:44:02.943348 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:44:02.943348 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:44:02.943348 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:44:02.943348 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:44:02.943348 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:44:02.943348 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 15:44:02.943348 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:44:02.943348 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 15:44:02.943348 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:44:02.943348 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 488/1003] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Sep 7 15:44:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:44:02.944175 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da5e05-540d-4bad-a665-3784df73d578 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:02.944175 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da5e05-540d-4bad-a665-3784df73d578 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:02.944175 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da5e05-540d-4bad-a665-3784df73d578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:02.956865 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-33da5e05-540d-4bad-a665-3784df73d578 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:44:02.958139 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-33da5e05-540d-4bad-a665-3784df73d578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:44:02.970325 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b970c-e0dd-42b4-b21b-229eeba68ca6 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:03.005373 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b487159-5f62-4129-940a-9e260b76b85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:03.005975 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b487159-5f62-4129-940a-9e260b76b85f None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:03.006279 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b487159-5f62-4129-940a-9e260b76b85f None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:03.006550 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b487159-5f62-4129-940a-9e260b76b85f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:03.007237 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b487159-5f62-4129-940a-9e260b76b85f None admin] RBAC: Adding query filter params (interface=public, service_id=42ad7353812c4c2ba92b9207b8368ebc, region_id=RegionOne) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:44:03.007539 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b487159-5f62-4129-940a-9e260b76b85f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:03.008885 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b487159-5f62-4129-940a-9e260b76b85f None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:03.014559 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 516/1004] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Sep 7 15:44:02 2022] GET /identity/v3/endpoints?service_id=42ad7353812c4c2ba92b9207b8368ebc&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:44:03.015327 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b487159-5f62-4129-940a-9e260b76b85f None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:03.026779 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 489/1005] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:44:02 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:44:03.027682 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da5e05-540d-4bad-a665-3784df73d578 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:03.042612 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:03.105910 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:03.137366 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b487159-5f62-4129-940a-9e260b76b85f None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:03.138406 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da5e05-540d-4bad-a665-3784df73d578 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:03.173664 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea288656-9422-46f7-8649-6dfb033bce5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:03.173871 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a70b27-4cc4-487e-9aab-9ef596658d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:03.174299 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea288656-9422-46f7-8649-6dfb033bce5d None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:03.174409 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a70b27-4cc4-487e-9aab-9ef596658d98 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:03.174586 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea288656-9422-46f7-8649-6dfb033bce5d None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:03.174683 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a70b27-4cc4-487e-9aab-9ef596658d98 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:03.174853 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea288656-9422-46f7-8649-6dfb033bce5d None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:03.174950 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a70b27-4cc4-487e-9aab-9ef596658d98 None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:03.175549 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a70b27-4cc4-487e-9aab-9ef596658d98 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:44:03.175661 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea288656-9422-46f7-8649-6dfb033bce5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:03.175855 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a70b27-4cc4-487e-9aab-9ef596658d98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:03.176908 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea288656-9422-46f7-8649-6dfb033bce5d None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:03.177200 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a70b27-4cc4-487e-9aab-9ef596658d98 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:03.182213 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 517/1006] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Sep 7 15:44:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:44:03.184283 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 490/1007] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Sep 7 15:44:03 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:44:03.188322 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a70b27-4cc4-487e-9aab-9ef596658d98 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:03.296008 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea288656-9422-46f7-8649-6dfb033bce5d None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:03.298620 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a70b27-4cc4-487e-9aab-9ef596658d98 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:03.336751 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8672f1d-6a9a-443e-857e-ce3e2b337de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:03.337378 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8672f1d-6a9a-443e-857e-ce3e2b337de5 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:03.337658 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8672f1d-6a9a-443e-857e-ce3e2b337de5 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:03.337932 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8672f1d-6a9a-443e-857e-ce3e2b337de5 None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:03.338602 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8672f1d-6a9a-443e-857e-ce3e2b337de5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:44:03.338912 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8672f1d-6a9a-443e-857e-ce3e2b337de5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:03.340529 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8672f1d-6a9a-443e-857e-ce3e2b337de5 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:03.346136 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 518/1008] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Sep 7 15:44:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:44:03.351496 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8672f1d-6a9a-443e-857e-ce3e2b337de5 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:03.355806 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:03.390963 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:03.418901 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea288656-9422-46f7-8649-6dfb033bce5d None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:03.456746 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab0086-7812-4b5c-a336-d5f25c9dffed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:03.457352 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab0086-7812-4b5c-a336-d5f25c9dffed None admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:03.457634 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab0086-7812-4b5c-a336-d5f25c9dffed None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:03.457903 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab0086-7812-4b5c-a336-d5f25c9dffed None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:03.458612 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ab0086-7812-4b5c-a336-d5f25c9dffed None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:03.460175 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ab0086-7812-4b5c-a336-d5f25c9dffed None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:03.462471 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8672f1d-6a9a-443e-857e-ce3e2b337de5 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:03.482356 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 491/1009] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Sep 7 15:44:03 2022] POST /identity/v3/services => generated 242 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 15:44:03.512704 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d3018-0e53-4b98-9a90-22626a76d9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:03.513328 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d3018-0e53-4b98-9a90-22626a76d9c4 None admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:03.513610 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d3018-0e53-4b98-9a90-22626a76d9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:03.513885 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d3018-0e53-4b98-9a90-22626a76d9c4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:03.514633 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d3018-0e53-4b98-9a90-22626a76d9c4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:03.516045 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d3018-0e53-4b98-9a90-22626a76d9c4 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:03.542207 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 519/1010] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:44:03 2022] POST /identity/v3/endpoints => generated 325 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:44:05.373125 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809bbf8-69cf-4c26-9cb3-7627b1b8c1e6 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:05.373616 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809bbf8-69cf-4c26-9cb3-7627b1b8c1e6 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:05.373616 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809bbf8-69cf-4c26-9cb3-7627b1b8c1e6 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:05.375095 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 492/1011] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:44:05.380125 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c76620-ff7d-476d-954e-757960b9ad67 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:05.380500 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c76620-ff7d-476d-954e-757960b9ad67 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:05.380677 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c76620-ff7d-476d-954e-757960b9ad67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:05.399574 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-85c76620-ff7d-476d-954e-757960b9ad67 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:44:05.400774 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-85c76620-ff7d-476d-954e-757960b9ad67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:44:05.458608 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:05.477748 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 520/1012] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:44:05 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:44:05.682512 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb7b62-bc60-4f12-b389-8ae0d08f65f7 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:05.682881 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb7b62-bc60-4f12-b389-8ae0d08f65f7 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:05.683214 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb7b62-bc60-4f12-b389-8ae0d08f65f7 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:05.684609 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 493/1013] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:44:05.689843 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0885c31-a7f7-4980-b225-92b7558bc261 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:05.690125 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0885c31-a7f7-4980-b225-92b7558bc261 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:05.690426 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0885c31-a7f7-4980-b225-92b7558bc261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:05.710483 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-d0885c31-a7f7-4980-b225-92b7558bc261 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:44:05.711696 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-d0885c31-a7f7-4980-b225-92b7558bc261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:44:05.750616 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beb7b62-bc60-4f12-b389-8ae0d08f65f7 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:05.785068 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 521/1014] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:44:05 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:44:05.821125 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92963b9-4ac3-4dca-9b4a-aef6699f5b7e None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:05.821458 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92963b9-4ac3-4dca-9b4a-aef6699f5b7e None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:05.821675 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92963b9-4ac3-4dca-9b4a-aef6699f5b7e None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:05.823160 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 522/1015] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:44:05.828736 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e8d50-ae28-47a3-9d98-e3dd71af80f4 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:05.829023 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e8d50-ae28-47a3-9d98-e3dd71af80f4 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:05.829304 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e8d50-ae28-47a3-9d98-e3dd71af80f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:05.851884 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-a55e8d50-ae28-47a3-9d98-e3dd71af80f4 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:44:05.853357 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-a55e8d50-ae28-47a3-9d98-e3dd71af80f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:44:05.858010 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beb7b62-bc60-4f12-b389-8ae0d08f65f7 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:05.894805 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e347be-f0bf-4c5f-a3a5-408f7e6ffb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:05.895435 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e347be-f0bf-4c5f-a3a5-408f7e6ffb34 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:05.895716 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e347be-f0bf-4c5f-a3a5-408f7e6ffb34 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:05.895989 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e347be-f0bf-4c5f-a3a5-408f7e6ffb34 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:05.896569 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e347be-f0bf-4c5f-a3a5-408f7e6ffb34 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:05.897923 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e347be-f0bf-4c5f-a3a5-408f7e6ffb34 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:05.899840 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:05.908583 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-e8e347be-f0bf-4c5f-a3a5-408f7e6ffb34 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 15:44:05.908583 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:44:05.908583 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 15:44:05.908583 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 15:44:05.908583 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 15:44:05.908583 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 15:44:05.908583 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 15:44:05.908583 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:44:05.908583 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 15:44:05.908583 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:44:05.908583 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:44:05.908583 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:44:05.908583 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:44:05.908583 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:44:05.908583 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:44:05.908583 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:44:05.908583 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:44:05.909680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:44:05.909680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:44:05.909680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:44:05.909680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:44:05.909680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:44:05.909680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:44:05.909680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 15:44:05.909680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 15:44:05.909680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 15:44:05.909680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 15:44:05.909680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:44:05.909680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:44:05.909680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:44:05.909680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:44:05.909680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:44:05.909680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:44:05.910598 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:44:05.910598 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:44:05.910598 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:44:05.910598 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:44:05.910598 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:44:05.910598 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:44:05.910598 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:44:05.910598 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:44:05.910598 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:44:05.910598 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:44:05.910598 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 15:44:05.910598 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:44:05.910598 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 15:44:05.910598 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:44:05.910598 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 494/1016] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:44:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:44:05.915474 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e347be-f0bf-4c5f-a3a5-408f7e6ffb34 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:05.930292 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 523/1017] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:44:05 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 15:44:06.022414 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e347be-f0bf-4c5f-a3a5-408f7e6ffb34 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:06.057663 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e8d50-ae28-47a3-9d98-e3dd71af80f4 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:06.061322 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6d965-5518-4d83-8142-be2d096bf63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:06.061938 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6d965-5518-4d83-8142-be2d096bf63f None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:06.062247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6d965-5518-4d83-8142-be2d096bf63f None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:06.062533 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6d965-5518-4d83-8142-be2d096bf63f None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:06.063167 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e6d965-5518-4d83-8142-be2d096bf63f None admin] RBAC: Adding query filter params (name=compute) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:44:06.063474 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e6d965-5518-4d83-8142-be2d096bf63f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:06.064852 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e6d965-5518-4d83-8142-be2d096bf63f None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:06.074408 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 495/1018] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Sep 7 15:44:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:44:06.076742 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6d965-5518-4d83-8142-be2d096bf63f None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:06.110910 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:06.143580 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:06.171090 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e8d50-ae28-47a3-9d98-e3dd71af80f4 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:06.185241 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6d965-5518-4d83-8142-be2d096bf63f None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:06.208999 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deabc068-6daf-45a7-bc0a-eb08f94a04a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:06.209636 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabc068-6daf-45a7-bc0a-eb08f94a04a6 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:06.209913 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabc068-6daf-45a7-bc0a-eb08f94a04a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:06.210198 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabc068-6daf-45a7-bc0a-eb08f94a04a6 None admin] PATH_INFO: `/v3/services/image` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:06.210791 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deabc068-6daf-45a7-bc0a-eb08f94a04a6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:06.212153 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deabc068-6daf-45a7-bc0a-eb08f94a04a6 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:06.219569 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bfeec1-062e-4a89-924c-2a63dcbcce1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:06.220210 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bfeec1-062e-4a89-924c-2a63dcbcce1a None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:06.220496 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bfeec1-062e-4a89-924c-2a63dcbcce1a None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:06.220772 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bfeec1-062e-4a89-924c-2a63dcbcce1a None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:06.221004 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-deabc068-6daf-45a7-bc0a-eb08f94a04a6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 15:44:06.221004 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:44:06.221004 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 15:44:06.221004 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 15:44:06.221004 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 15:44:06.221004 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 15:44:06.221004 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 15:44:06.221004 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:44:06.221004 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 15:44:06.221004 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:44:06.221004 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:44:06.221004 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:44:06.221004 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:44:06.221004 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:44:06.221004 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:44:06.221004 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:44:06.221004 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:44:06.222153 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:44:06.222153 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:44:06.222153 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:44:06.222153 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:44:06.222153 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:44:06.222153 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:44:06.222153 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 15:44:06.222153 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 15:44:06.222153 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 15:44:06.222153 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 15:44:06.222153 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:44:06.222153 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:44:06.222153 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:44:06.222153 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:44:06.222153 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:44:06.222153 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:44:06.223298 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:44:06.223298 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:44:06.223298 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:44:06.223298 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:44:06.223298 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:44:06.223298 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:44:06.223298 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:44:06.223298 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:44:06.223298 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:44:06.223298 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:44:06.223298 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 15:44:06.223298 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:44:06.223298 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 15:44:06.223298 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:44:06.224043 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bfeec1-062e-4a89-924c-2a63dcbcce1a None admin] RBAC: Adding query filter params (type=compute) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:44:06.224043 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bfeec1-062e-4a89-924c-2a63dcbcce1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:06.224177 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 524/1019] 10.222.0.16 () {56 vars in 1105 bytes} [Wed Sep 7 15:44:06 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:44:06.224248 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bfeec1-062e-4a89-924c-2a63dcbcce1a None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:06.224323 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deabc068-6daf-45a7-bc0a-eb08f94a04a6 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:06.230228 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 496/1020] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Sep 7 15:44:06 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:44:06.230228 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bfeec1-062e-4a89-924c-2a63dcbcce1a None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:06.327906 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deabc068-6daf-45a7-bc0a-eb08f94a04a6 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:06.333993 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bfeec1-062e-4a89-924c-2a63dcbcce1a None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:06.338545 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:06.359927 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:06.364680 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e4965a-2436-4f88-a244-960f2d768cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:06.365319 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4965a-2436-4f88-a244-960f2d768cfe None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:06.365732 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4965a-2436-4f88-a244-960f2d768cfe None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:06.366141 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4965a-2436-4f88-a244-960f2d768cfe None admin] PATH_INFO: `/v3/domains/default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:06.367657 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e4965a-2436-4f88-a244-960f2d768cfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:06.369322 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c97f7-bd6d-4c73-ad0f-bd8368703094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:06.369568 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e4965a-2436-4f88-a244-960f2d768cfe None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:06.369956 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c97f7-bd6d-4c73-ad0f-bd8368703094 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:06.370219 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c97f7-bd6d-4c73-ad0f-bd8368703094 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:06.370500 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c97f7-bd6d-4c73-ad0f-bd8368703094 None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:06.371797 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c97f7-bd6d-4c73-ad0f-bd8368703094 None admin] RBAC: Adding query filter params (name=image) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:44:06.372089 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c97f7-bd6d-4c73-ad0f-bd8368703094 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:06.372259 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 525/1021] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:44:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:44:06.373091 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e4965a-2436-4f88-a244-960f2d768cfe None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:06.376358 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c97f7-bd6d-4c73-ad0f-bd8368703094 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:06.385459 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 497/1022] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:44:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:44:06.385459 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c97f7-bd6d-4c73-ad0f-bd8368703094 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:06.473264 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e4965a-2436-4f88-a244-960f2d768cfe None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:06.482776 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c97f7-bd6d-4c73-ad0f-bd8368703094 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:06.506889 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa368277-44bc-4301-b7b3-48a56f804842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:06.507546 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa368277-44bc-4301-b7b3-48a56f804842 None admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:06.507755 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa368277-44bc-4301-b7b3-48a56f804842 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:06.508027 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa368277-44bc-4301-b7b3-48a56f804842 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:06.508676 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa368277-44bc-4301-b7b3-48a56f804842 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:06.510028 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa368277-44bc-4301-b7b3-48a56f804842 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:06.517521 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98fe14-8064-445d-bcf5-c6a7d4533ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:06.518124 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98fe14-8064-445d-bcf5-c6a7d4533ab2 None admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:06.518433 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98fe14-8064-445d-bcf5-c6a7d4533ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:06.518705 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98fe14-8064-445d-bcf5-c6a7d4533ab2 None admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:06.519344 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f98fe14-8064-445d-bcf5-c6a7d4533ab2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:06.520758 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f98fe14-8064-445d-bcf5-c6a7d4533ab2 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:06.531153 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 526/1023] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:44:06 2022] POST /identity/v3/endpoints => generated 334 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:44:06.531969 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa368277-44bc-4301-b7b3-48a56f804842 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:06.573977 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 498/1024] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Sep 7 15:44:06 2022] POST /identity/v3/projects => generated 311 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:44:06.574537 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:06.667419 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa368277-44bc-4301-b7b3-48a56f804842 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:06.707852 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531277de-7711-4638-ad3a-0c8716c8941d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:06.708493 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531277de-7711-4638-ad3a-0c8716c8941d None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:06.708779 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531277de-7711-4638-ad3a-0c8716c8941d None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:06.709057 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531277de-7711-4638-ad3a-0c8716c8941d None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:06.709714 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531277de-7711-4638-ad3a-0c8716c8941d None admin] RBAC: Adding query filter params (type=image) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:44:06.710021 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531277de-7711-4638-ad3a-0c8716c8941d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:06.711515 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531277de-7711-4638-ad3a-0c8716c8941d None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:06.722233 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 527/1025] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:44:06 2022] GET /identity/v3/services?type=image => generated 350 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:44:06.725434 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98fe14-8064-445d-bcf5-c6a7d4533ab2 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:06.772954 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:06.833636 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98fe14-8064-445d-bcf5-c6a7d4533ab2 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:06.872203 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580fa633-af27-4a1e-bdd2-aa6464fd09e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:06.872834 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580fa633-af27-4a1e-bdd2-aa6464fd09e8 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:06.873141 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580fa633-af27-4a1e-bdd2-aa6464fd09e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:06.873414 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580fa633-af27-4a1e-bdd2-aa6464fd09e8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:06.874112 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580fa633-af27-4a1e-bdd2-aa6464fd09e8 None admin] RBAC: Adding query filter params (interface=public, service_id=e37480e8a21a44c0872524241102ab70, region_id=RegionOne) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:44:06.874496 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580fa633-af27-4a1e-bdd2-aa6464fd09e8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:06.875848 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580fa633-af27-4a1e-bdd2-aa6464fd09e8 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:06.881282 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 499/1026] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Sep 7 15:44:06 2022] GET /identity/v3/endpoints?service_id=e37480e8a21a44c0872524241102ab70&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:44:06.887387 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531277de-7711-4638-ad3a-0c8716c8941d None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:06.984542 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:06.992795 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531277de-7711-4638-ad3a-0c8716c8941d None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:07.028293 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad7dbe-7a62-4473-9499-5c329c4d38b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:07.028903 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad7dbe-7a62-4473-9499-5c329c4d38b3 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:07.029184 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad7dbe-7a62-4473-9499-5c329c4d38b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:07.029462 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad7dbe-7a62-4473-9499-5c329c4d38b3 None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:07.030060 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ad7dbe-7a62-4473-9499-5c329c4d38b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:07.036094 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ad7dbe-7a62-4473-9499-5c329c4d38b3 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:07.044311 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 528/1027] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Sep 7 15:44:06 2022] GET /identity/v3/services => generated 1957 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 15:44:08.872251 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c87ad-3e03-48cb-b799-288393f2fa49 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:08.872812 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c87ad-3e03-48cb-b799-288393f2fa49 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:08.872812 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c87ad-3e03-48cb-b799-288393f2fa49 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:08.874222 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 500/1028] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:44:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:44:08.879581 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b043a-835b-4416-8c2b-0a4e97a79795 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:08.880015 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b043a-835b-4416-8c2b-0a4e97a79795 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:08.880208 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b043a-835b-4416-8c2b-0a4e97a79795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:08.900165 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-287b043a-835b-4416-8c2b-0a4e97a79795 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:44:08.901392 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-287b043a-835b-4416-8c2b-0a4e97a79795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:44:08.943676 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb094f-a9b7-4045-add6-62825d06e7b6 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:08.944924 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb094f-a9b7-4045-add6-62825d06e7b6 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:08.944924 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb094f-a9b7-4045-add6-62825d06e7b6 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:08.945991 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 501/1029] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:44:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:44:08.951480 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4bf089-3d87-48c2-b185-0ea8cf9ad19a None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:08.951764 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4bf089-3d87-48c2-b185-0ea8cf9ad19a None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:08.952058 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4bf089-3d87-48c2-b185-0ea8cf9ad19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:08.973830 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-9a4bf089-3d87-48c2-b185-0ea8cf9ad19a None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:44:08.975198 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-9a4bf089-3d87-48c2-b185-0ea8cf9ad19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:44:08.981429 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 529/1030] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:44:08 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:44:09.064575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 502/1031] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:44:08 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 15:44:09.259907 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b043a-835b-4416-8c2b-0a4e97a79795 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:09.299351 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b87abd-7fa5-4212-8343-3690544d86a4 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:09.299662 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b87abd-7fa5-4212-8343-3690544d86a4 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:09.299915 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b87abd-7fa5-4212-8343-3690544d86a4 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:09.301410 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 503/1032] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:44:09.306496 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16549553-03d8-4ba2-b066-92f46d1eb9d8 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:09.307035 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16549553-03d8-4ba2-b066-92f46d1eb9d8 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:09.307311 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16549553-03d8-4ba2-b066-92f46d1eb9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:09.326612 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-16549553-03d8-4ba2-b066-92f46d1eb9d8 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:44:09.327802 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-16549553-03d8-4ba2-b066-92f46d1eb9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:44:09.351271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:09.360733 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:09.365010 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b043a-835b-4416-8c2b-0a4e97a79795 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:09.404302 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfea8ec-6c1b-4b34-8f40-58129cb46837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:09.404929 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfea8ec-6c1b-4b34-8f40-58129cb46837 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:09.405204 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfea8ec-6c1b-4b34-8f40-58129cb46837 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:09.405473 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfea8ec-6c1b-4b34-8f40-58129cb46837 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:09.406535 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 504/1033] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:44:09 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:44:09.407384 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16549553-03d8-4ba2-b066-92f46d1eb9d8 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:09.420724 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfea8ec-6c1b-4b34-8f40-58129cb46837 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:44:09.425629 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-1bfea8ec-6c1b-4b34-8f40-58129cb46837 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 15:44:09.425629 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:44:09.425629 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:44:09.425629 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:44:09.425629 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:44:09.425629 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:44:09.425629 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:44:09.425629 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:44:09.425629 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:44:09.425629 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:44:09.425629 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:44:09.425629 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:44:09.425629 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:44:09.425629 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:44:09.425629 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:44:09.425629 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:44:09.426636 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:44:09.426636 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:44:09.426636 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:44:09.426636 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:44:09.426636 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:44:09.426636 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:44:09.426636 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:44:09.426636 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:44:09.426636 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:44:09.426636 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:44:09.426636 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:44:09.426636 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:44:09.426636 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:44:09.426636 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:44:09.426636 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:44:09.426636 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:44:09.427488 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:44:09.427488 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:44:09.427488 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:44:09.427488 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:44:09.427488 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:44:09.427488 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:44:09.427488 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:44:09.427488 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:44:09.427488 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:44:09.427488 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:44:09.427488 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 15:44:09.427488 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:44:09.427488 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 530/1034] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Sep 7 15:44:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:44:09.432899 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfea8ec-6c1b-4b34-8f40-58129cb46837 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:09.524179 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16549553-03d8-4ba2-b066-92f46d1eb9d8 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:09.536292 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfea8ec-6c1b-4b34-8f40-58129cb46837 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:09.565031 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d587429-678b-42d3-82fd-9cebfd1d0292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:09.565745 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d587429-678b-42d3-82fd-9cebfd1d0292 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:09.566025 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d587429-678b-42d3-82fd-9cebfd1d0292 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:09.566339 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d587429-678b-42d3-82fd-9cebfd1d0292 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:09.567442 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d587429-678b-42d3-82fd-9cebfd1d0292 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:09.568861 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d587429-678b-42d3-82fd-9cebfd1d0292 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:09.570451 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 505/1035] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:44:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:44:09.576071 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780bf3e1-8f7e-459b-9a6a-fd0b12bbf52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:09.576601 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d587429-678b-42d3-82fd-9cebfd1d0292 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:09.576704 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780bf3e1-8f7e-459b-9a6a-fd0b12bbf52f None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:09.576943 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780bf3e1-8f7e-459b-9a6a-fd0b12bbf52f None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:09.577315 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780bf3e1-8f7e-459b-9a6a-fd0b12bbf52f None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:09.578019 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780bf3e1-8f7e-459b-9a6a-fd0b12bbf52f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:44:09.578316 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780bf3e1-8f7e-459b-9a6a-fd0b12bbf52f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:09.579669 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780bf3e1-8f7e-459b-9a6a-fd0b12bbf52f None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:09.593158 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 531/1036] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Sep 7 15:44:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:44:09.594933 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780bf3e1-8f7e-459b-9a6a-fd0b12bbf52f None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:09.609219 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:09.614916 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:09.686925 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d587429-678b-42d3-82fd-9cebfd1d0292 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:09.707630 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780bf3e1-8f7e-459b-9a6a-fd0b12bbf52f None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:09.720456 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e84e87-534f-4e38-ac97-351cac599852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:09.721058 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e84e87-534f-4e38-ac97-351cac599852 None admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:09.721337 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e84e87-534f-4e38-ac97-351cac599852 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:09.721610 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e84e87-534f-4e38-ac97-351cac599852 None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:09.722381 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e84e87-534f-4e38-ac97-351cac599852 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:09.723797 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e84e87-534f-4e38-ac97-351cac599852 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:09.741057 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4cf014-5167-4d0a-aacd-f1960a1e46e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:09.741684 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4cf014-5167-4d0a-aacd-f1960a1e46e3 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:09.741960 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4cf014-5167-4d0a-aacd-f1960a1e46e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:09.742258 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4cf014-5167-4d0a-aacd-f1960a1e46e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:09.744501 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 506/1037] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Sep 7 15:44:09 2022] POST /identity/v3/users => generated 285 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 15:44:09.745297 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e84e87-534f-4e38-ac97-351cac599852 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:09.754286 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4cf014-5167-4d0a-aacd-f1960a1e46e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:09.755782 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4cf014-5167-4d0a-aacd-f1960a1e46e3 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:09.772538 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-1a4cf014-5167-4d0a-aacd-f1960a1e46e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:44:09.772538 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:44:09.772538 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:44:09.772538 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:44:09.772538 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:44:09.772538 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:44:09.772538 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:44:09.772538 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:44:09.772538 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:44:09.772538 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:44:09.772538 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:44:09.772538 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:44:09.772538 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:44:09.772538 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:44:09.772538 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:44:09.772538 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:44:09.773601 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:44:09.773601 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:44:09.773601 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:44:09.773601 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:44:09.773601 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:44:09.773601 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:44:09.773601 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:44:09.773601 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:44:09.773601 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:44:09.773601 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:44:09.773601 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:44:09.773601 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:44:09.773601 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:44:09.773601 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:44:09.773601 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:44:09.773601 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:44:09.773601 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:44:09.774677 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:44:09.774677 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:44:09.774677 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:44:09.774677 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 532/1038] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:44:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:44:09.779965 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4cf014-5167-4d0a-aacd-f1960a1e46e3 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:09.850452 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:09.854414 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:09.863322 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e84e87-534f-4e38-ac97-351cac599852 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:09.900571 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4cf014-5167-4d0a-aacd-f1960a1e46e3 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:09.904192 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f02ff7-ef16-497d-a389-5f72bc012973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:09.904848 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f02ff7-ef16-497d-a389-5f72bc012973 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:09.905128 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f02ff7-ef16-497d-a389-5f72bc012973 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:09.905445 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f02ff7-ef16-497d-a389-5f72bc012973 None admin] PATH_INFO: `/v3/services/image` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:09.906037 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f02ff7-ef16-497d-a389-5f72bc012973 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:09.907457 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f02ff7-ef16-497d-a389-5f72bc012973 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:09.916862 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-c0f02ff7-ef16-497d-a389-5f72bc012973 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 15:44:09.916862 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:44:09.916862 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 15:44:09.916862 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 15:44:09.916862 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 15:44:09.916862 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 15:44:09.916862 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 15:44:09.916862 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:44:09.916862 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 15:44:09.916862 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:44:09.916862 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:44:09.916862 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:44:09.916862 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:44:09.916862 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:44:09.916862 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:44:09.916862 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:44:09.916862 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:44:09.917995 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:44:09.917995 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:44:09.917995 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:44:09.917995 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:44:09.917995 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:44:09.917995 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:44:09.917995 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 15:44:09.917995 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 15:44:09.917995 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 15:44:09.917995 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 15:44:09.917995 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:44:09.917995 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:44:09.917995 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:44:09.917995 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:44:09.917995 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:44:09.917995 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:44:09.919460 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:44:09.919460 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:44:09.919460 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:44:09.919460 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:44:09.919460 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:44:09.919460 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:44:09.919460 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:44:09.919460 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:44:09.919460 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:44:09.919460 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:44:09.919460 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 15:44:09.919460 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:44:09.919460 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 15:44:09.919460 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:44:09.919460 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 507/1039] 10.222.0.16 () {56 vars in 1105 bytes} [Wed Sep 7 15:44:09 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:44:09.924205 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f02ff7-ef16-497d-a389-5f72bc012973 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:09.945300 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58788e6-4543-40da-8256-11e6f4dce7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:09.945909 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58788e6-4543-40da-8256-11e6f4dce7e8 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:09.946232 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58788e6-4543-40da-8256-11e6f4dce7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:09.946555 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58788e6-4543-40da-8256-11e6f4dce7e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:09.947189 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58788e6-4543-40da-8256-11e6f4dce7e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:44:09.948467 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58788e6-4543-40da-8256-11e6f4dce7e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:09.948986 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58788e6-4543-40da-8256-11e6f4dce7e8 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:09.962372 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 533/1040] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:44:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:44:09.968331 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58788e6-4543-40da-8256-11e6f4dce7e8 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:10.048646 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f02ff7-ef16-497d-a389-5f72bc012973 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:10.082577 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58788e6-4543-40da-8256-11e6f4dce7e8 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:10.087947 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6b9f4-a035-4f97-acdf-5f8547101de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:10.088597 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6b9f4-a035-4f97-acdf-5f8547101de9 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:10.088881 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6b9f4-a035-4f97-acdf-5f8547101de9 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:10.089151 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6b9f4-a035-4f97-acdf-5f8547101de9 None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:10.090569 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a6b9f4-a035-4f97-acdf-5f8547101de9 None admin] RBAC: Adding query filter params (name=image) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:44:10.090881 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a6b9f4-a035-4f97-acdf-5f8547101de9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:10.092616 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a6b9f4-a035-4f97-acdf-5f8547101de9 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:10.103779 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 508/1041] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:44:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:44:10.105462 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6b9f4-a035-4f97-acdf-5f8547101de9 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:10.106224 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:10.120021 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b7528-04f5-4bbc-8b3f-efc67626f0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:10.120963 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b7528-04f5-4bbc-8b3f-efc67626f0a0 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:10.121243 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b7528-04f5-4bbc-8b3f-efc67626f0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:10.121517 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b7528-04f5-4bbc-8b3f-efc67626f0a0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:10.126518 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:10.129008 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3b7528-04f5-4bbc-8b3f-efc67626f0a0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:10.130490 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3b7528-04f5-4bbc-8b3f-efc67626f0a0 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:10.143304 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-cc3b7528-04f5-4bbc-8b3f-efc67626f0a0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 15:44:10.143304 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:44:10.143304 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:44:10.143304 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:44:10.143304 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:44:10.143304 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:44:10.143304 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:44:10.143304 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:44:10.143304 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:44:10.143304 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:44:10.143304 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:44:10.143304 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:44:10.143304 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:44:10.143304 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:44:10.143304 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:44:10.143304 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:44:10.144288 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:44:10.144288 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:44:10.144288 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:44:10.144288 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:44:10.144288 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:44:10.144288 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:44:10.144288 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:44:10.144288 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:44:10.144288 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:44:10.144288 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:44:10.144288 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:44:10.144288 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:44:10.144288 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:44:10.144288 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:44:10.144288 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:44:10.144288 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:44:10.144288 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:44:10.144288 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:44:10.145271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:44:10.145271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:44:10.145271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:44:10.145271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:44:10.145271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:44:10.145271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:44:10.145271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:44:10.145271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:44:10.145271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 15:44:10.145271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:44:10.145271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 534/1042] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Sep 7 15:44:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:44:10.150320 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b7528-04f5-4bbc-8b3f-efc67626f0a0 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:10.216378 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6b9f4-a035-4f97-acdf-5f8547101de9 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:10.253455 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba44381-9e2e-4c5d-ac4c-5b781b3fcefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:10.254064 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba44381-9e2e-4c5d-ac4c-5b781b3fcefe None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:10.254389 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba44381-9e2e-4c5d-ac4c-5b781b3fcefe None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:10.254659 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba44381-9e2e-4c5d-ac4c-5b781b3fcefe None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:10.255286 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba44381-9e2e-4c5d-ac4c-5b781b3fcefe None admin] RBAC: Adding query filter params (type=image) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:44:10.255594 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba44381-9e2e-4c5d-ac4c-5b781b3fcefe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:10.256953 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba44381-9e2e-4c5d-ac4c-5b781b3fcefe None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:10.261996 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 509/1043] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:44:10 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:44:10.267595 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba44381-9e2e-4c5d-ac4c-5b781b3fcefe None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:10.274540 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b7528-04f5-4bbc-8b3f-efc67626f0a0 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:10.314555 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2cae0e-1421-45d2-be50-5ca87af61f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:10.315086 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2cae0e-1421-45d2-be50-5ca87af61f98 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:10.315353 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2cae0e-1421-45d2-be50-5ca87af61f98 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:10.315628 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2cae0e-1421-45d2-be50-5ca87af61f98 None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:10.316363 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2cae0e-1421-45d2-be50-5ca87af61f98 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:44:10.316651 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2cae0e-1421-45d2-be50-5ca87af61f98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:10.318074 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2cae0e-1421-45d2-be50-5ca87af61f98 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:10.336033 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 535/1044] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Sep 7 15:44:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:44:10.342896 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2cae0e-1421-45d2-be50-5ca87af61f98 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:10.357627 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:10.377959 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba44381-9e2e-4c5d-ac4c-5b781b3fcefe None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:10.389590 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:10.413889 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c3917-9eff-4d1e-ad2f-fe4cfb2da3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:10.414550 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c3917-9eff-4d1e-ad2f-fe4cfb2da3b0 None admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:10.414830 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c3917-9eff-4d1e-ad2f-fe4cfb2da3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:10.415100 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c3917-9eff-4d1e-ad2f-fe4cfb2da3b0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:10.415750 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c3917-9eff-4d1e-ad2f-fe4cfb2da3b0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:10.417110 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c3917-9eff-4d1e-ad2f-fe4cfb2da3b0 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:10.438417 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 510/1045] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:44:10 2022] POST /identity/v3/endpoints => generated 327 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 15:44:10.455915 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2cae0e-1421-45d2-be50-5ca87af61f98 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:10.503131 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9d74d-1ba6-406f-8110-12745023e7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:10.503761 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9d74d-1ba6-406f-8110-12745023e7ed None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:10.504043 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9d74d-1ba6-406f-8110-12745023e7ed None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:10.504324 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9d74d-1ba6-406f-8110-12745023e7ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:10.583150 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b9d74d-1ba6-406f-8110-12745023e7ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:10.584531 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b9d74d-1ba6-406f-8110-12745023e7ed None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:10.624903 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:10.695368 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 536/1046] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:44:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 15:44:10.702137 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c3917-9eff-4d1e-ad2f-fe4cfb2da3b0 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:10.802432 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c3917-9eff-4d1e-ad2f-fe4cfb2da3b0 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:10.835578 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a463fd3-b559-406a-b67d-97506b680b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:10.836132 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a463fd3-b559-406a-b67d-97506b680b83 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:10.836411 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a463fd3-b559-406a-b67d-97506b680b83 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:10.836682 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a463fd3-b559-406a-b67d-97506b680b83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:10.843776 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:10.849112 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a463fd3-b559-406a-b67d-97506b680b83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:10.850608 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a463fd3-b559-406a-b67d-97506b680b83 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:10.866548 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-2a463fd3-b559-406a-b67d-97506b680b83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:44:10.866548 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:44:10.866548 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:44:10.866548 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:44:10.866548 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:44:10.866548 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:44:10.866548 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:44:10.866548 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:44:10.866548 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:44:10.866548 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:44:10.866548 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:44:10.866548 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:44:10.866548 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:44:10.866548 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:44:10.866548 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:44:10.866548 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:44:10.867504 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:44:10.867504 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:44:10.867504 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:44:10.867504 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:44:10.867504 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:44:10.867504 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:44:10.867504 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:44:10.867504 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:44:10.867504 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:44:10.867504 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:44:10.867504 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:44:10.867504 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:44:10.867504 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:44:10.867504 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:44:10.867504 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:44:10.867504 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:44:10.867504 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:44:10.874004 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:44:10.874004 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:44:10.874004 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:44:10.874004 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 511/1047] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:44:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:44:10.875864 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9d74d-1ba6-406f-8110-12745023e7ed None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:10.978464 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9d74d-1ba6-406f-8110-12745023e7ed None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:11.014387 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783f82f-3244-4127-8a66-6e1ab7101704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:11.015151 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783f82f-3244-4127-8a66-6e1ab7101704 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:11.015524 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783f82f-3244-4127-8a66-6e1ab7101704 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:11.015911 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783f82f-3244-4127-8a66-6e1ab7101704 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:11.016644 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a783f82f-3244-4127-8a66-6e1ab7101704 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:44:11.017042 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a783f82f-3244-4127-8a66-6e1ab7101704 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:11.018512 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a783f82f-3244-4127-8a66-6e1ab7101704 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:11.020981 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:11.036511 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 537/1048] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:44:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:44:11.038089 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a463fd3-b559-406a-b67d-97506b680b83 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:11.145510 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a463fd3-b559-406a-b67d-97506b680b83 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:11.178956 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae820973-fb51-4d9b-874c-25224e8d567a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:11.179586 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae820973-fb51-4d9b-874c-25224e8d567a None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:11.179862 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae820973-fb51-4d9b-874c-25224e8d567a None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:11.180128 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae820973-fb51-4d9b-874c-25224e8d567a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:11.187735 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae820973-fb51-4d9b-874c-25224e8d567a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:11.189155 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae820973-fb51-4d9b-874c-25224e8d567a None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:11.202662 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-ae820973-fb51-4d9b-874c-25224e8d567a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:44:11.202662 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:44:11.202662 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:44:11.202662 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:44:11.202662 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:44:11.202662 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:44:11.202662 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:44:11.202662 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:44:11.202662 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:44:11.202662 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:44:11.202662 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:44:11.202662 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:44:11.202662 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:44:11.202662 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:44:11.202662 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:44:11.203575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:44:11.203575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:44:11.203575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:44:11.203575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:44:11.203575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:44:11.203575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:44:11.203575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:44:11.203575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:44:11.203575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:44:11.203575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:44:11.203575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:44:11.203575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:44:11.203575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:44:11.203575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:44:11.203575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:44:11.203575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:44:11.203575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:44:11.204479 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:44:11.204479 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:44:11.204479 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:44:11.204479 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:44:11.204479 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:44:11.204479 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:44:11.204479 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:44:11.204479 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:44:11.209099 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 512/1049] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:44:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:44:11.210527 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783f82f-3244-4127-8a66-6e1ab7101704 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:11.310571 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783f82f-3244-4127-8a66-6e1ab7101704 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:11.344011 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada6ead9-48cd-45c1-ad70-e145af199837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:11.344643 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada6ead9-48cd-45c1-ad70-e145af199837 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:11.344921 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada6ead9-48cd-45c1-ad70-e145af199837 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:11.345190 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada6ead9-48cd-45c1-ad70-e145af199837 None admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:11.345898 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada6ead9-48cd-45c1-ad70-e145af199837 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:44:11.346227 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada6ead9-48cd-45c1-ad70-e145af199837 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:11.347697 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada6ead9-48cd-45c1-ad70-e145af199837 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:11.361602 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 538/1050] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 7 15:44:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:44:11.367948 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae820973-fb51-4d9b-874c-25224e8d567a None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:11.418282 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:11.469782 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae820973-fb51-4d9b-874c-25224e8d567a None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:11.503115 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbfbfb2-f25f-4723-a873-a1874cfad351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:11.503713 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbfbfb2-f25f-4723-a873-a1874cfad351 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:11.503990 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbfbfb2-f25f-4723-a873-a1874cfad351 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:11.504257 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbfbfb2-f25f-4723-a873-a1874cfad351 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:11.504966 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbfbfb2-f25f-4723-a873-a1874cfad351 None admin] RBAC: Adding query filter params (role.id=aff163e4c39f4c2f980bc6a6a6ca3d43, scope.project.id=488830167943488f85743236584113d7, user.id=f9b13331a5fd48f5a2521ed1600f9f35) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:44:11.505269 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbfbfb2-f25f-4723-a873-a1874cfad351 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:11.506705 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbfbfb2-f25f-4723-a873-a1874cfad351 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:11.518234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 513/1051] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 7 15:44:11 2022] GET /identity/v3/role_assignments?user.id=f9b13331a5fd48f5a2521ed1600f9f35&scope.project.id=488830167943488f85743236584113d7&role.id=aff163e4c39f4c2f980bc6a6a6ca3d43 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:44:12.007688 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca49be2-556e-4a66-adf4-af05fa14f3a3 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:12.008245 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca49be2-556e-4a66-adf4-af05fa14f3a3 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:12.008245 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca49be2-556e-4a66-adf4-af05fa14f3a3 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:12.009804 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 539/1052] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:44:12.015413 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47e53d-cbe6-4ef8-9426-8ac76a1b2b56 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:12.015708 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47e53d-cbe6-4ef8-9426-8ac76a1b2b56 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:12.015987 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47e53d-cbe6-4ef8-9426-8ac76a1b2b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:12.043237 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-9e47e53d-cbe6-4ef8-9426-8ac76a1b2b56 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:44:12.044420 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-9e47e53d-cbe6-4ef8-9426-8ac76a1b2b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:44:12.111862 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 514/1053] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:44:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:44:12.388584 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca49be2-556e-4a66-adf4-af05fa14f3a3 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:12.446103 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:12.492826 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca49be2-556e-4a66-adf4-af05fa14f3a3 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:12.529063 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f014be-f2d3-4326-b06b-2589a83595ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:12.529726 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f014be-f2d3-4326-b06b-2589a83595ed None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:12.530006 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f014be-f2d3-4326-b06b-2589a83595ed None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:12.530317 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f014be-f2d3-4326-b06b-2589a83595ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:12.543084 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f014be-f2d3-4326-b06b-2589a83595ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:44:12.548383 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-70f014be-f2d3-4326-b06b-2589a83595ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:44:12.548383 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:44:12.548383 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:44:12.548383 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:44:12.548383 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:44:12.548383 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:44:12.548383 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:44:12.548383 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:44:12.548383 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:44:12.548383 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:44:12.548383 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:44:12.548383 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:44:12.548383 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:44:12.548383 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:44:12.548383 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:44:12.548383 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:44:12.549365 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:44:12.549365 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:44:12.549365 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:44:12.549365 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:44:12.549365 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:44:12.549365 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:44:12.549365 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:44:12.549365 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:44:12.549365 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:44:12.549365 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:44:12.549365 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:44:12.549365 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:44:12.549365 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:44:12.549365 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:44:12.549365 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:44:12.549365 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:44:12.550643 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:44:12.550643 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:44:12.550643 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:44:12.550643 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:44:12.550643 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:44:12.550643 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:44:12.550643 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:44:12.550643 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:44:12.550643 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:44:12.550643 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:44:12.550643 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:44:12.550643 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:44:12.554433 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 540/1054] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 7 15:44:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:44:12.556050 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47e53d-cbe6-4ef8-9426-8ac76a1b2b56 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:12.604718 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:12.650603 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f36514-cbab-4e84-9b8a-1e329a71da48 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:12.650909 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f36514-cbab-4e84-9b8a-1e329a71da48 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:12.651188 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f36514-cbab-4e84-9b8a-1e329a71da48 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:12.653572 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 541/1055] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:44:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:44:12.659052 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6a6f7-2bd5-4cc6-a180-af5c2b95008e None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:12.659390 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6a6f7-2bd5-4cc6-a180-af5c2b95008e None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:12.659613 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6a6f7-2bd5-4cc6-a180-af5c2b95008e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:12.663144 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47e53d-cbe6-4ef8-9426-8ac76a1b2b56 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:12.683443 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-a9c6a6f7-2bd5-4cc6-a180-af5c2b95008e None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:44:12.684657 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-a9c6a6f7-2bd5-4cc6-a180-af5c2b95008e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:44:12.701726 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36f469-84b1-4e06-90f1-1c72a517c017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:12.702469 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36f469-84b1-4e06-90f1-1c72a517c017 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:12.702748 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36f469-84b1-4e06-90f1-1c72a517c017 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:12.703161 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36f469-84b1-4e06-90f1-1c72a517c017 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:12.703822 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e36f469-84b1-4e06-90f1-1c72a517c017 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:44:12.704124 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e36f469-84b1-4e06-90f1-1c72a517c017 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:12.705472 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e36f469-84b1-4e06-90f1-1c72a517c017 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:12.715960 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 515/1056] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:44:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:44:12.721496 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36f469-84b1-4e06-90f1-1c72a517c017 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:12.762534 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 542/1057] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:44:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 15:44:12.845212 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36f469-84b1-4e06-90f1-1c72a517c017 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:12.854593 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:12.888655 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcbf74e-d91b-4e1d-9a97-629b68584dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:12.889293 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbf74e-d91b-4e1d-9a97-629b68584dd0 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:12.889574 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbf74e-d91b-4e1d-9a97-629b68584dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:12.889844 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbf74e-d91b-4e1d-9a97-629b68584dd0 None admin] PATH_INFO: `/v3/users/ff5f9970f5884e459fcea85c6b835ed2` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:12.904073 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcbf74e-d91b-4e1d-9a97-629b68584dd0 None admin] RBAC: Authorizing `identity:get_user(user_id=ff5f9970f5884e459fcea85c6b835ed2)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:12.905447 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcbf74e-d91b-4e1d-9a97-629b68584dd0 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:12.911818 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 516/1058] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 7 15:44:12 2022] GET /identity/v3/users/ff5f9970f5884e459fcea85c6b835ed2 => generated 285 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:44:12.912878 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6a6f7-2bd5-4cc6-a180-af5c2b95008e None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:12.959786 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:13.014199 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6a6f7-2bd5-4cc6-a180-af5c2b95008e None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:13.030600 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcbf74e-d91b-4e1d-9a97-629b68584dd0 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:13.056485 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f6568-4152-4eb5-9160-262bd4bbf6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:13.057095 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f6568-4152-4eb5-9160-262bd4bbf6d4 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:13.057373 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f6568-4152-4eb5-9160-262bd4bbf6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:13.057646 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f6568-4152-4eb5-9160-262bd4bbf6d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:13.128705 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8f6568-4152-4eb5-9160-262bd4bbf6d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:13.130159 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8f6568-4152-4eb5-9160-262bd4bbf6d4 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:13.147604 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcbf74e-d91b-4e1d-9a97-629b68584dd0 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:13.176916 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:13.186694 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452fa37-a47d-4c9e-9092-cb892dac7e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:13.187312 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452fa37-a47d-4c9e-9092-cb892dac7e18 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:13.187585 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452fa37-a47d-4c9e-9092-cb892dac7e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:13.187853 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452fa37-a47d-4c9e-9092-cb892dac7e18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:13.222316 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:13.236774 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 543/1059] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:44:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 07 15:44:13.242499 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f6568-4152-4eb5-9160-262bd4bbf6d4 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:13.263949 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0452fa37-a47d-4c9e-9092-cb892dac7e18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:13.265402 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0452fa37-a47d-4c9e-9092-cb892dac7e18 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:13.346143 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f6568-4152-4eb5-9160-262bd4bbf6d4 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:13.374568 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 517/1060] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:44:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 07 15:44:13.380255 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452fa37-a47d-4c9e-9092-cb892dac7e18 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:13.387734 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af572a7-21bd-45fb-bd41-af765eb50431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:13.388487 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af572a7-21bd-45fb-bd41-af765eb50431 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:13.388736 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af572a7-21bd-45fb-bd41-af765eb50431 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:13.389013 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af572a7-21bd-45fb-bd41-af765eb50431 None admin] PATH_INFO: `/v3/projects/3d8d975bfe0a4dd5b52faa2adb613abb` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:13.390118 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af572a7-21bd-45fb-bd41-af765eb50431 None admin] RBAC: Authorizing `identity:get_project(project_id=3d8d975bfe0a4dd5b52faa2adb613abb)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:13.391589 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af572a7-21bd-45fb-bd41-af765eb50431 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:13.393449 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 544/1061] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 7 15:44:13 2022] GET /identity/v3/projects/3d8d975bfe0a4dd5b52faa2adb613abb => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:44:13.399209 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af572a7-21bd-45fb-bd41-af765eb50431 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:13.416565 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:13.444813 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:13.487007 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452fa37-a47d-4c9e-9092-cb892dac7e18 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:13.507994 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af572a7-21bd-45fb-bd41-af765eb50431 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:13.520019 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1417cbe-74bf-4e4e-afe9-9fa72f7192ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:13.520651 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1417cbe-74bf-4e4e-afe9-9fa72f7192ad None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:13.520927 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1417cbe-74bf-4e4e-afe9-9fa72f7192ad None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:13.521199 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1417cbe-74bf-4e4e-afe9-9fa72f7192ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:13.531930 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1417cbe-74bf-4e4e-afe9-9fa72f7192ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:13.533368 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1417cbe-74bf-4e4e-afe9-9fa72f7192ad None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:13.545682 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef3b4df-ab32-464e-b49c-57af065bc13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:13.546315 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3b4df-ab32-464e-b49c-57af065bc13e None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:13.546593 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3b4df-ab32-464e-b49c-57af065bc13e None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:13.546862 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3b4df-ab32-464e-b49c-57af065bc13e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:13.547571 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef3b4df-ab32-464e-b49c-57af065bc13e None admin] RBAC: Adding query filter params (role.id=61605ebf17e643258730e55bf6db15ad, scope.project.id=3d8d975bfe0a4dd5b52faa2adb613abb, user.id=ff5f9970f5884e459fcea85c6b835ed2) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:44:13.547875 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef3b4df-ab32-464e-b49c-57af065bc13e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:13.549281 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef3b4df-ab32-464e-b49c-57af065bc13e None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:13.550039 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-e1417cbe-74bf-4e4e-afe9-9fa72f7192ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:44:13.550039 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:44:13.550039 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:44:13.550039 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:44:13.550039 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:44:13.550039 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:44:13.550039 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:44:13.550039 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:44:13.550039 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:44:13.550039 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:44:13.550039 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:44:13.550039 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:44:13.550039 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:44:13.550039 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:44:13.550039 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:44:13.550039 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:44:13.551074 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:44:13.551074 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:44:13.551074 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:44:13.551074 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:44:13.551074 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:44:13.551074 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:44:13.551074 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:44:13.551074 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:44:13.551074 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:44:13.551074 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:44:13.551074 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:44:13.551074 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:44:13.551074 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:44:13.551074 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:44:13.551074 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:44:13.551074 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:44:13.551074 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:44:13.551972 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:44:13.551972 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:44:13.551972 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:44:13.554327 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 518/1062] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:44:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:44:13.557143 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1417cbe-74bf-4e4e-afe9-9fa72f7192ad None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:13.559970 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 545/1063] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 7 15:44:13 2022] GET /identity/v3/role_assignments?user.id=ff5f9970f5884e459fcea85c6b835ed2&scope.project.id=3d8d975bfe0a4dd5b52faa2adb613abb&role.id=61605ebf17e643258730e55bf6db15ad => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:44:13.674013 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1417cbe-74bf-4e4e-afe9-9fa72f7192ad None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:13.692408 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:13.712647 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df339959-0a18-4882-b5d8-d415350ebca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:13.713176 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df339959-0a18-4882-b5d8-d415350ebca4 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:13.713455 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df339959-0a18-4882-b5d8-d415350ebca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:13.713727 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df339959-0a18-4882-b5d8-d415350ebca4 None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:13.714948 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df339959-0a18-4882-b5d8-d415350ebca4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:44:13.715250 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df339959-0a18-4882-b5d8-d415350ebca4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:13.716631 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df339959-0a18-4882-b5d8-d415350ebca4 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:13.719244 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa7fca-63f7-4dec-8a52-ee5918ee5f32 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:13.719534 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa7fca-63f7-4dec-8a52-ee5918ee5f32 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:13.719817 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa7fca-63f7-4dec-8a52-ee5918ee5f32 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:13.721312 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 546/1064] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:44:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:44:13.726830 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b87c4-ad47-4abc-b8e7-a997adb0ce13 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:13.727336 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b87c4-ad47-4abc-b8e7-a997adb0ce13 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:13.727625 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b87c4-ad47-4abc-b8e7-a997adb0ce13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:13.738219 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 519/1065] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:44:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:44:13.748814 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-db6b87c4-ad47-4abc-b8e7-a997adb0ce13 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:44:13.750067 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-db6b87c4-ad47-4abc-b8e7-a997adb0ce13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:44:13.829461 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 547/1066] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:44:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 15:44:14.114457 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df339959-0a18-4882-b5d8-d415350ebca4 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:14.212830 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df339959-0a18-4882-b5d8-d415350ebca4 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:14.247188 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2b169-b10e-42f1-bbe2-37ef8b99d863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:14.247810 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2b169-b10e-42f1-bbe2-37ef8b99d863 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:14.248089 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2b169-b10e-42f1-bbe2-37ef8b99d863 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:14.248359 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2b169-b10e-42f1-bbe2-37ef8b99d863 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:14.258292 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d2b169-b10e-42f1-bbe2-37ef8b99d863 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:44:14.263275 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-a5d2b169-b10e-42f1-bbe2-37ef8b99d863 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 15:44:14.263275 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:44:14.263275 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:44:14.263275 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:44:14.263275 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:44:14.263275 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:44:14.263275 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:44:14.263275 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:44:14.263275 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:44:14.263275 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:44:14.263275 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:44:14.263275 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:44:14.263275 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:44:14.263275 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:44:14.263275 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:44:14.263275 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:44:14.264291 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:44:14.264291 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:44:14.264291 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:44:14.264291 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:44:14.264291 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:44:14.264291 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:44:14.264291 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:44:14.264291 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:44:14.264291 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:44:14.264291 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:44:14.264291 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:44:14.264291 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:44:14.264291 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:44:14.264291 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:44:14.264291 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:44:14.264291 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:44:14.265189 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:44:14.265189 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:44:14.265189 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:44:14.265189 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:44:14.265189 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:44:14.265189 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:44:14.265189 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:44:14.265189 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:44:14.265189 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:44:14.265189 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:44:14.265189 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 15:44:14.265189 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:44:14.265189 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 520/1067] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Sep 7 15:44:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:44:14.270361 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b87c4-ad47-4abc-b8e7-a997adb0ce13 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:14.281231 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:14.370839 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b87c4-ad47-4abc-b8e7-a997adb0ce13 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:14.404282 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a231290-7aa6-413f-8166-e1ebf4be4835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:14.404885 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a231290-7aa6-413f-8166-e1ebf4be4835 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:14.405163 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a231290-7aa6-413f-8166-e1ebf4be4835 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:14.405434 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a231290-7aa6-413f-8166-e1ebf4be4835 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:14.406087 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a231290-7aa6-413f-8166-e1ebf4be4835 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:44:14.406423 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a231290-7aa6-413f-8166-e1ebf4be4835 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:14.407778 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a231290-7aa6-413f-8166-e1ebf4be4835 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:14.415637 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 548/1068] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Sep 7 15:44:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:44:14.422375 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2b169-b10e-42f1-bbe2-37ef8b99d863 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:14.460170 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:14.525982 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2b169-b10e-42f1-bbe2-37ef8b99d863 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:14.559389 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c7239-8699-4aab-9aaa-0cd2cba90876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:14.560009 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c7239-8699-4aab-9aaa-0cd2cba90876 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:14.560286 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c7239-8699-4aab-9aaa-0cd2cba90876 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:14.560551 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c7239-8699-4aab-9aaa-0cd2cba90876 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:14.570266 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c7239-8699-4aab-9aaa-0cd2cba90876 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:14.571693 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c7239-8699-4aab-9aaa-0cd2cba90876 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:14.587895 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-df5c7239-8699-4aab-9aaa-0cd2cba90876 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:44:14.587895 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:44:14.587895 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:44:14.587895 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:44:14.587895 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:44:14.587895 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:44:14.587895 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:44:14.587895 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:44:14.587895 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:44:14.587895 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:44:14.587895 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:44:14.587895 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:44:14.587895 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:44:14.587895 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:44:14.587895 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:44:14.587895 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:44:14.593826 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:44:14.593826 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:44:14.593826 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:44:14.593826 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:44:14.593826 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:44:14.593826 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:44:14.593826 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:44:14.593826 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:44:14.593826 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:44:14.593826 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:44:14.593826 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:44:14.593826 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:44:14.593826 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:44:14.593826 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:44:14.593826 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:44:14.593826 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:44:14.593826 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:44:14.594828 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:44:14.594828 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:44:14.594828 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:44:14.594828 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 521/1069] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:44:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:44:14.596249 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a231290-7aa6-413f-8166-e1ebf4be4835 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:14.664858 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:14.697313 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a231290-7aa6-413f-8166-e1ebf4be4835 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:14.729497 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a1774c-9315-4af3-890e-0a19342953f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:14.730642 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1774c-9315-4af3-890e-0a19342953f9 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:14.730915 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1774c-9315-4af3-890e-0a19342953f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:14.731186 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1774c-9315-4af3-890e-0a19342953f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:14.731812 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a1774c-9315-4af3-890e-0a19342953f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:44:14.732113 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a1774c-9315-4af3-890e-0a19342953f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:14.733726 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a1774c-9315-4af3-890e-0a19342953f9 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:14.745122 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 549/1070] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:44:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:44:14.750792 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c7239-8699-4aab-9aaa-0cd2cba90876 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:14.837528 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:14.850262 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c7239-8699-4aab-9aaa-0cd2cba90876 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:14.884757 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586e515-0eff-4904-883f-2002a2a2174d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:14.885374 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586e515-0eff-4904-883f-2002a2a2174d None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:14.885651 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586e515-0eff-4904-883f-2002a2a2174d None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:14.885918 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586e515-0eff-4904-883f-2002a2a2174d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:14.893512 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b586e515-0eff-4904-883f-2002a2a2174d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:14.894956 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b586e515-0eff-4904-883f-2002a2a2174d None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:14.906387 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-b586e515-0eff-4904-883f-2002a2a2174d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 15:44:14.906387 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:44:14.906387 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:44:14.906387 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:44:14.906387 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:44:14.906387 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:44:14.906387 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:44:14.906387 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:44:14.906387 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:44:14.906387 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:44:14.906387 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:44:14.906387 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:44:14.906387 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:44:14.906387 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:44:14.906387 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:44:14.906387 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:44:14.907533 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:44:14.907533 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:44:14.907533 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:44:14.907533 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:44:14.907533 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:44:14.907533 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:44:14.907533 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:44:14.907533 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:44:14.907533 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:44:14.907533 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:44:14.907533 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:44:14.907533 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:44:14.907533 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:44:14.907533 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:44:14.907533 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:44:14.907533 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:44:14.907533 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:44:14.907533 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:44:14.908784 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:44:14.908784 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:44:14.908784 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:44:14.908784 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:44:14.908784 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:44:14.908784 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:44:14.908784 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:44:14.908784 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:44:14.908784 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 15:44:14.908784 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:44:14.908784 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 522/1071] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Sep 7 15:44:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:44:14.913231 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a1774c-9315-4af3-890e-0a19342953f9 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:15.010872 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a1774c-9315-4af3-890e-0a19342953f9 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:15.041439 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:15.047621 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90b7584-8c9e-4363-bc44-36c5dc889c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:15.048224 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b7584-8c9e-4363-bc44-36c5dc889c42 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:15.048500 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b7584-8c9e-4363-bc44-36c5dc889c42 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:15.048769 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b7584-8c9e-4363-bc44-36c5dc889c42 None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:15.049482 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90b7584-8c9e-4363-bc44-36c5dc889c42 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:44:15.049782 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90b7584-8c9e-4363-bc44-36c5dc889c42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:15.051250 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90b7584-8c9e-4363-bc44-36c5dc889c42 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:15.068367 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 550/1072] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Sep 7 15:44:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:44:15.074681 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586e515-0eff-4904-883f-2002a2a2174d None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:15.171464 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586e515-0eff-4904-883f-2002a2a2174d None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:15.204519 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92867f3-bff9-49bb-8b37-7cfa68732aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:15.205141 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92867f3-bff9-49bb-8b37-7cfa68732aa6 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:15.205423 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92867f3-bff9-49bb-8b37-7cfa68732aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:15.205699 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92867f3-bff9-49bb-8b37-7cfa68732aa6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:15.216327 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92867f3-bff9-49bb-8b37-7cfa68732aa6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:15.217763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92867f3-bff9-49bb-8b37-7cfa68732aa6 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:15.225692 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:15.233001 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-a92867f3-bff9-49bb-8b37-7cfa68732aa6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:44:15.233001 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:44:15.233001 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:44:15.233001 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:44:15.233001 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:44:15.233001 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:44:15.233001 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:44:15.233001 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:44:15.233001 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:44:15.233001 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:44:15.233001 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:44:15.233001 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:44:15.233001 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:44:15.233001 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:44:15.233001 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:44:15.233001 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:44:15.234296 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:44:15.234296 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:44:15.234296 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:44:15.234296 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:44:15.234296 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:44:15.234296 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:44:15.234296 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:44:15.234296 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:44:15.234296 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:44:15.234296 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:44:15.234296 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:44:15.234296 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:44:15.234296 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:44:15.234296 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:44:15.234296 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:44:15.234296 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:44:15.234296 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:44:15.235212 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:44:15.235212 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:44:15.235212 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:44:15.235212 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 523/1073] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:44:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:44:15.240415 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90b7584-8c9e-4363-bc44-36c5dc889c42 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:15.337712 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90b7584-8c9e-4363-bc44-36c5dc889c42 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:15.372105 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d4237-1c44-4268-bd7b-bee94673a032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:15.372711 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d4237-1c44-4268-bd7b-bee94673a032 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:15.372989 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d4237-1c44-4268-bd7b-bee94673a032 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:15.373257 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d4237-1c44-4268-bd7b-bee94673a032 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:15.373890 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d4237-1c44-4268-bd7b-bee94673a032 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:44:15.374203 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d4237-1c44-4268-bd7b-bee94673a032 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:15.375561 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d4237-1c44-4268-bd7b-bee94673a032 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:15.386852 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 551/1074] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:44:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:44:15.392522 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92867f3-bff9-49bb-8b37-7cfa68732aa6 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:15.490435 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92867f3-bff9-49bb-8b37-7cfa68732aa6 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:15.523327 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844e1c9-ca13-4526-a522-bcf30d2323ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:15.523947 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844e1c9-ca13-4526-a522-bcf30d2323ec None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:15.524228 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844e1c9-ca13-4526-a522-bcf30d2323ec None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:15.524501 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844e1c9-ca13-4526-a522-bcf30d2323ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:15.531383 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844e1c9-ca13-4526-a522-bcf30d2323ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:15.532807 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844e1c9-ca13-4526-a522-bcf30d2323ec None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:15.544447 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-8844e1c9-ca13-4526-a522-bcf30d2323ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:44:15.544447 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:44:15.544447 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:44:15.544447 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:44:15.544447 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:44:15.544447 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:44:15.544447 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:44:15.544447 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:44:15.544447 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:44:15.544447 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:44:15.544447 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:44:15.544447 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:44:15.544447 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:44:15.544447 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:44:15.544447 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:44:15.545522 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:44:15.545522 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:44:15.545522 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:44:15.545522 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:44:15.545522 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:44:15.545522 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:44:15.545522 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:44:15.545522 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:44:15.545522 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:44:15.545522 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:44:15.545522 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:44:15.545522 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:44:15.545522 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:44:15.545522 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:44:15.545522 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:44:15.545522 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:44:15.545522 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:44:15.546893 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:44:15.546893 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:44:15.546893 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:44:15.546893 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:44:15.546893 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:44:15.546893 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:44:15.546893 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:44:15.546893 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:44:15.550386 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 524/1075] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:44:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:44:15.551359 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d4237-1c44-4268-bd7b-bee94673a032 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:15.600934 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:15.666290 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d4237-1c44-4268-bd7b-bee94673a032 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:15.700099 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40032d2b-91c6-42fc-ad6c-9a9e3b2f3592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:15.700708 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40032d2b-91c6-42fc-ad6c-9a9e3b2f3592 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:15.700988 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40032d2b-91c6-42fc-ad6c-9a9e3b2f3592 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:15.701265 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40032d2b-91c6-42fc-ad6c-9a9e3b2f3592 None admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:15.701978 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40032d2b-91c6-42fc-ad6c-9a9e3b2f3592 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:44:15.702325 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40032d2b-91c6-42fc-ad6c-9a9e3b2f3592 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:15.703748 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40032d2b-91c6-42fc-ad6c-9a9e3b2f3592 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:15.716063 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 552/1076] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 7 15:44:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:44:15.721957 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844e1c9-ca13-4526-a522-bcf30d2323ec None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:15.744642 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c1b82-bda0-46d8-8578-1e33b36e02da None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:15.744927 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c1b82-bda0-46d8-8578-1e33b36e02da None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:15.745202 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c1b82-bda0-46d8-8578-1e33b36e02da None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:15.747170 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 553/1077] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:44:15.752158 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655b567-8dc6-423f-bc70-88f56599df51 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:15.752443 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655b567-8dc6-423f-bc70-88f56599df51 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:15.752717 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655b567-8dc6-423f-bc70-88f56599df51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:15.770407 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-f655b567-8dc6-423f-bc70-88f56599df51 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:44:15.771592 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-f655b567-8dc6-423f-bc70-88f56599df51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:44:15.780571 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:15.822117 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844e1c9-ca13-4526-a522-bcf30d2323ec None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:15.838040 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 554/1078] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:44:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 15:44:15.856009 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec520f1-c2c3-4198-a723-7bce4a89b756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:15.856595 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec520f1-c2c3-4198-a723-7bce4a89b756 None admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:15.856874 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec520f1-c2c3-4198-a723-7bce4a89b756 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:15.857143 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec520f1-c2c3-4198-a723-7bce4a89b756 None admin] PATH_INFO: `/v3/projects/488830167943488f85743236584113d7/users/f9b13331a5fd48f5a2521ed1600f9f35/roles/aff163e4c39f4c2f980bc6a6a6ca3d43` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:15.859522 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec520f1-c2c3-4198-a723-7bce4a89b756 None admin] RBAC: Authorizing `identity:create_grant(project_id=488830167943488f85743236584113d7, user_id=f9b13331a5fd48f5a2521ed1600f9f35, role_id=aff163e4c39f4c2f980bc6a6a6ca3d43)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:15.860940 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec520f1-c2c3-4198-a723-7bce4a89b756 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:15.873252 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 525/1079] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 7 15:44:15 2022] PUT /identity/v3/projects/488830167943488f85743236584113d7/users/f9b13331a5fd48f5a2521ed1600f9f35/roles/aff163e4c39f4c2f980bc6a6a6ca3d43 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:44:16.111585 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f655b567-8dc6-423f-bc70-88f56599df51 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:16.152311 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:16.211248 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f655b567-8dc6-423f-bc70-88f56599df51 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:16.246097 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb24a0-0481-4e71-bc51-883e664d6fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:16.246757 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb24a0-0481-4e71-bc51-883e664d6fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:16.247036 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb24a0-0481-4e71-bc51-883e664d6fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:16.247308 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb24a0-0481-4e71-bc51-883e664d6fb3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:16.257827 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafb24a0-0481-4e71-bc51-883e664d6fb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:44:16.263299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-aafb24a0-0481-4e71-bc51-883e664d6fb3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:44:16.263299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:44:16.263299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:44:16.263299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:44:16.263299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:44:16.263299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:44:16.263299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:44:16.263299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:44:16.263299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:44:16.263299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:44:16.263299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:44:16.263299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:44:16.263299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:44:16.263299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:44:16.263299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:44:16.263299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:44:16.264433 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:44:16.264433 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:44:16.264433 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:44:16.264433 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:44:16.264433 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:44:16.264433 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:44:16.264433 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:44:16.264433 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:44:16.264433 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:44:16.264433 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:44:16.264433 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:44:16.264433 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:44:16.264433 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:44:16.264433 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:44:16.264433 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:44:16.264433 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:44:16.265734 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:44:16.265734 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:44:16.265734 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:44:16.265734 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:44:16.265734 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:44:16.265734 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:44:16.265734 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:44:16.265734 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:44:16.265734 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:44:16.265734 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:44:16.265734 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:44:16.265734 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:44:16.265734 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 555/1080] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 7 15:44:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:44:16.270485 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec520f1-c2c3-4198-a723-7bce4a89b756 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:16.369711 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec520f1-c2c3-4198-a723-7bce4a89b756 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:16.389065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:16.404570 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065df79-ab5d-4faf-893f-faf92fa79ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:16.405175 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065df79-ab5d-4faf-893f-faf92fa79ce7 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:16.405455 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065df79-ab5d-4faf-893f-faf92fa79ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:16.405732 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065df79-ab5d-4faf-893f-faf92fa79ce7 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:16.406419 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065df79-ab5d-4faf-893f-faf92fa79ce7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:44:16.406726 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065df79-ab5d-4faf-893f-faf92fa79ce7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:16.408089 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065df79-ab5d-4faf-893f-faf92fa79ce7 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:16.417264 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 526/1081] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:44:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:44:16.423831 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb24a0-0481-4e71-bc51-883e664d6fb3 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:16.518991 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:16.523270 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb24a0-0481-4e71-bc51-883e664d6fb3 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:16.557235 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc615b-dbe6-404c-9a3e-60f306548307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:16.557901 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc615b-dbe6-404c-9a3e-60f306548307 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:16.558389 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc615b-dbe6-404c-9a3e-60f306548307 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:16.558667 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc615b-dbe6-404c-9a3e-60f306548307 None admin] PATH_INFO: `/v3/users/ff5f9970f5884e459fcea85c6b835ed2` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:16.559823 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cc615b-dbe6-404c-9a3e-60f306548307 None admin] RBAC: Authorizing `identity:get_user(user_id=ff5f9970f5884e459fcea85c6b835ed2)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:16.561245 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cc615b-dbe6-404c-9a3e-60f306548307 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:16.562838 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 556/1082] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 7 15:44:16 2022] GET /identity/v3/users/ff5f9970f5884e459fcea85c6b835ed2 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:44:16.568646 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065df79-ab5d-4faf-893f-faf92fa79ce7 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:16.669416 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065df79-ab5d-4faf-893f-faf92fa79ce7 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:16.701836 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae36eb02-6d88-40eb-8269-f1417362d4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:16.702489 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36eb02-6d88-40eb-8269-f1417362d4f5 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:16.702770 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36eb02-6d88-40eb-8269-f1417362d4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:16.703048 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36eb02-6d88-40eb-8269-f1417362d4f5 None admin] PATH_INFO: `/v3/projects/3d8d975bfe0a4dd5b52faa2adb613abb` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:16.704155 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae36eb02-6d88-40eb-8269-f1417362d4f5 None admin] RBAC: Authorizing `identity:get_project(project_id=3d8d975bfe0a4dd5b52faa2adb613abb)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:16.705574 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae36eb02-6d88-40eb-8269-f1417362d4f5 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:16.707224 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 527/1083] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 7 15:44:16 2022] GET /identity/v3/projects/3d8d975bfe0a4dd5b52faa2adb613abb => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:44:16.713170 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc615b-dbe6-404c-9a3e-60f306548307 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:16.814394 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc615b-dbe6-404c-9a3e-60f306548307 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:16.846900 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577ffb6-8625-4010-96bd-5e9c582e3172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:16.847549 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577ffb6-8625-4010-96bd-5e9c582e3172 None admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:16.847826 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577ffb6-8625-4010-96bd-5e9c582e3172 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:16.848098 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577ffb6-8625-4010-96bd-5e9c582e3172 None admin] PATH_INFO: `/v3/projects/3d8d975bfe0a4dd5b52faa2adb613abb/users/ff5f9970f5884e459fcea85c6b835ed2/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:16.849964 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577ffb6-8625-4010-96bd-5e9c582e3172 None admin] RBAC: Authorizing `identity:create_grant(project_id=3d8d975bfe0a4dd5b52faa2adb613abb, user_id=ff5f9970f5884e459fcea85c6b835ed2, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:16.851412 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577ffb6-8625-4010-96bd-5e9c582e3172 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:16.864824 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 557/1084] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 7 15:44:16 2022] PUT /identity/v3/projects/3d8d975bfe0a4dd5b52faa2adb613abb/users/ff5f9970f5884e459fcea85c6b835ed2/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 15:44:18.036074 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3c323-5df5-43d3-824a-66616c8696fb None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:18.036074 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3c323-5df5-43d3-824a-66616c8696fb None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:18.036074 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3c323-5df5-43d3-824a-66616c8696fb None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:18.037241 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 528/1085] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:44:18.042974 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca1262-a337-4627-887e-c954e5f0d5fb None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:18.043421 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca1262-a337-4627-887e-c954e5f0d5fb None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:18.043524 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca1262-a337-4627-887e-c954e5f0d5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:18.061567 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-3eca1262-a337-4627-887e-c954e5f0d5fb None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:44:18.062774 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-3eca1262-a337-4627-887e-c954e5f0d5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:44:18.083058 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:18.131847 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 558/1086] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:44:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:44:18.401710 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3c323-5df5-43d3-824a-66616c8696fb None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:18.452392 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:18.502504 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3c323-5df5-43d3-824a-66616c8696fb None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:18.535511 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da4b67-d952-4539-a968-144afe666456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:18.536142 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da4b67-d952-4539-a968-144afe666456 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:18.536420 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da4b67-d952-4539-a968-144afe666456 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:18.536691 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da4b67-d952-4539-a968-144afe666456 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:18.547338 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50da4b67-d952-4539-a968-144afe666456 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:44:18.552148 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-50da4b67-d952-4539-a968-144afe666456 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 15:44:18.552148 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:44:18.552148 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:44:18.552148 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:44:18.552148 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:44:18.552148 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:44:18.552148 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:44:18.552148 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:44:18.552148 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:44:18.552148 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:44:18.552148 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:44:18.552148 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:44:18.552148 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:44:18.552148 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:44:18.552148 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:44:18.552148 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:44:18.553206 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:44:18.553206 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:44:18.553206 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:44:18.553206 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:44:18.553206 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:44:18.553206 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:44:18.553206 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:44:18.553206 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:44:18.553206 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:44:18.553206 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:44:18.553206 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:44:18.553206 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:44:18.553206 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:44:18.553206 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:44:18.553206 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:44:18.553206 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:44:18.554065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:44:18.554065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:44:18.554065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:44:18.554065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:44:18.554065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:44:18.554065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:44:18.554065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:44:18.554065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:44:18.554065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:44:18.554065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:44:18.554065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 15:44:18.554065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:44:18.554065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 529/1087] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Sep 7 15:44:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:44:18.559437 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca1262-a337-4627-887e-c954e5f0d5fb None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:18.657882 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca1262-a337-4627-887e-c954e5f0d5fb None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:18.691116 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2cc376-72fe-4d58-873e-52b399625a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:18.691720 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2cc376-72fe-4d58-873e-52b399625a1a None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:18.691994 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2cc376-72fe-4d58-873e-52b399625a1a None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:18.692264 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2cc376-72fe-4d58-873e-52b399625a1a None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:18.692922 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2cc376-72fe-4d58-873e-52b399625a1a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:44:18.693223 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2cc376-72fe-4d58-873e-52b399625a1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:18.694611 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2cc376-72fe-4d58-873e-52b399625a1a None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:18.702480 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 559/1088] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Sep 7 15:44:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:44:18.708257 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da4b67-d952-4539-a968-144afe666456 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:18.805313 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da4b67-d952-4539-a968-144afe666456 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:18.816113 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:18.839551 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1996909-5468-488c-8945-6aeacc29953d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:18.840171 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1996909-5468-488c-8945-6aeacc29953d None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:18.840447 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1996909-5468-488c-8945-6aeacc29953d None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:18.840714 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1996909-5468-488c-8945-6aeacc29953d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:18.850486 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1996909-5468-488c-8945-6aeacc29953d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:18.851909 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1996909-5468-488c-8945-6aeacc29953d None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:18.866374 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-c1996909-5468-488c-8945-6aeacc29953d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:44:18.866374 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:44:18.866374 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:44:18.866374 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:44:18.866374 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:44:18.866374 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:44:18.866374 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:44:18.866374 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:44:18.866374 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:44:18.866374 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:44:18.866374 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:44:18.866374 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:44:18.866374 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:44:18.866374 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:44:18.866374 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:44:18.866374 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:44:18.867524 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:44:18.867524 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:44:18.867524 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:44:18.867524 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:44:18.867524 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:44:18.867524 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:44:18.867524 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:44:18.867524 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:44:18.867524 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:44:18.867524 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:44:18.867524 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:44:18.867524 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:44:18.867524 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:44:18.867524 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:44:18.867524 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:44:18.867524 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:44:18.867524 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:44:18.868936 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:44:18.868936 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:44:18.868936 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:44:18.868936 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 530/1089] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:44:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:44:18.873842 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2cc376-72fe-4d58-873e-52b399625a1a None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:18.894114 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:18.977604 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2cc376-72fe-4d58-873e-52b399625a1a None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:19.010718 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa57c73-58c0-48c3-85df-e3c38c94d364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:19.011971 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa57c73-58c0-48c3-85df-e3c38c94d364 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:19.012244 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa57c73-58c0-48c3-85df-e3c38c94d364 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:19.012510 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa57c73-58c0-48c3-85df-e3c38c94d364 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:19.013137 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa57c73-58c0-48c3-85df-e3c38c94d364 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:44:19.013436 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa57c73-58c0-48c3-85df-e3c38c94d364 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:19.014824 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa57c73-58c0-48c3-85df-e3c38c94d364 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:19.026458 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 560/1090] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:44:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:44:19.029645 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463a988-c599-41cb-81a9-4f16521ebc46 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:19.029931 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463a988-c599-41cb-81a9-4f16521ebc46 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:19.030236 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463a988-c599-41cb-81a9-4f16521ebc46 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:19.031636 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 531/1091] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:44:19.032281 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa57c73-58c0-48c3-85df-e3c38c94d364 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:19.036848 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94385e5-e94f-4c9c-987f-197525c7aff6 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:19.037285 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94385e5-e94f-4c9c-987f-197525c7aff6 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:19.037483 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94385e5-e94f-4c9c-987f-197525c7aff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:19.056209 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-d94385e5-e94f-4c9c-987f-197525c7aff6 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:44:19.057406 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-d94385e5-e94f-4c9c-987f-197525c7aff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:44:19.111003 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:19.127206 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 532/1092] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:44:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:44:19.135006 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa57c73-58c0-48c3-85df-e3c38c94d364 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:19.170233 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1708f022-c0e9-4fcf-be0f-553068ce4e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:19.170868 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708f022-c0e9-4fcf-be0f-553068ce4e65 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:19.171146 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708f022-c0e9-4fcf-be0f-553068ce4e65 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:19.171417 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708f022-c0e9-4fcf-be0f-553068ce4e65 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:19.178325 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1708f022-c0e9-4fcf-be0f-553068ce4e65 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:19.179749 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1708f022-c0e9-4fcf-be0f-553068ce4e65 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:19.191419 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-1708f022-c0e9-4fcf-be0f-553068ce4e65 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 15:44:19.191419 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:44:19.191419 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:44:19.191419 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:44:19.191419 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:44:19.191419 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:44:19.191419 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:44:19.191419 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:44:19.191419 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:44:19.191419 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:44:19.191419 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:44:19.191419 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:44:19.191419 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:44:19.191419 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:44:19.191419 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:44:19.191419 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:44:19.192536 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:44:19.192536 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:44:19.192536 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:44:19.192536 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:44:19.192536 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:44:19.192536 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:44:19.192536 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:44:19.192536 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:44:19.192536 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:44:19.192536 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:44:19.192536 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:44:19.192536 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:44:19.192536 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:44:19.192536 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:44:19.192536 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:44:19.192536 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:44:19.192536 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:44:19.192536 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:44:19.193638 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:44:19.193638 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:44:19.193638 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:44:19.193638 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:44:19.193638 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:44:19.193638 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:44:19.193638 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:44:19.193638 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:44:19.193638 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 15:44:19.193638 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:44:19.193638 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 561/1093] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Sep 7 15:44:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:44:19.198328 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94385e5-e94f-4c9c-987f-197525c7aff6 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:19.290710 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:19.300243 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94385e5-e94f-4c9c-987f-197525c7aff6 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:19.335129 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c9d7e-378d-4a10-83da-f915a824278f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:19.335728 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c9d7e-378d-4a10-83da-f915a824278f None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:19.336008 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c9d7e-378d-4a10-83da-f915a824278f None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:19.336281 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c9d7e-378d-4a10-83da-f915a824278f None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:19.336998 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7c9d7e-378d-4a10-83da-f915a824278f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:44:19.337301 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7c9d7e-378d-4a10-83da-f915a824278f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:19.338755 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7c9d7e-378d-4a10-83da-f915a824278f None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:19.356317 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 533/1094] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Sep 7 15:44:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:44:19.362414 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1708f022-c0e9-4fcf-be0f-553068ce4e65 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:19.399018 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c9d7e-378d-4a10-83da-f915a824278f None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:19.462638 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1708f022-c0e9-4fcf-be0f-553068ce4e65 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:19.496837 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa826f2c-d9b8-4510-9602-492015a4c035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:19.497434 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa826f2c-d9b8-4510-9602-492015a4c035 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:19.497715 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa826f2c-d9b8-4510-9602-492015a4c035 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:19.497989 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa826f2c-d9b8-4510-9602-492015a4c035 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:19.498537 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c9d7e-378d-4a10-83da-f915a824278f None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:19.506342 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:19.532944 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7173cb-519f-46c9-9b9b-c0a1ef5e7235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:19.533576 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7173cb-519f-46c9-9b9b-c0a1ef5e7235 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:19.533853 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7173cb-519f-46c9-9b9b-c0a1ef5e7235 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:19.534124 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7173cb-519f-46c9-9b9b-c0a1ef5e7235 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:19.544718 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7173cb-519f-46c9-9b9b-c0a1ef5e7235 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:44:19.549503 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-3d7173cb-519f-46c9-9b9b-c0a1ef5e7235 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:44:19.549503 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:44:19.549503 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:44:19.549503 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:44:19.549503 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:44:19.549503 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:44:19.549503 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:44:19.549503 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:44:19.549503 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:44:19.549503 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:44:19.549503 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:44:19.549503 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:44:19.549503 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:44:19.549503 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:44:19.549503 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:44:19.549503 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:44:19.550602 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:44:19.550602 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:44:19.550602 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:44:19.550602 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:44:19.550602 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:44:19.550602 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:44:19.550602 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:44:19.550602 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:44:19.550602 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:44:19.550602 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:44:19.550602 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:44:19.550602 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:44:19.550602 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:44:19.550602 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:44:19.550602 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:44:19.550602 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:44:19.551458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:44:19.551458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:44:19.551458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:44:19.551458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:44:19.551458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:44:19.551458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:44:19.551458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:44:19.551458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:44:19.551458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:44:19.551458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:44:19.551458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:44:19.551458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:44:19.551458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 534/1095] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 7 15:44:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:44:19.556551 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7173cb-519f-46c9-9b9b-c0a1ef5e7235 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:19.565808 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa826f2c-d9b8-4510-9602-492015a4c035 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:19.567291 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa826f2c-d9b8-4510-9602-492015a4c035 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:19.569942 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:19.659964 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7173cb-519f-46c9-9b9b-c0a1ef5e7235 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:19.670984 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 562/1096] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:44:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 07 15:44:19.676741 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa826f2c-d9b8-4510-9602-492015a4c035 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:19.696480 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b7cb2c-f4dc-41bf-971d-4cd3028d1d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:19.697092 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7cb2c-f4dc-41bf-971d-4cd3028d1d35 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:19.697372 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7cb2c-f4dc-41bf-971d-4cd3028d1d35 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:19.697644 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7cb2c-f4dc-41bf-971d-4cd3028d1d35 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:19.698484 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b7cb2c-f4dc-41bf-971d-4cd3028d1d35 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:44:19.699008 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b7cb2c-f4dc-41bf-971d-4cd3028d1d35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:19.700380 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b7cb2c-f4dc-41bf-971d-4cd3028d1d35 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:19.708426 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 535/1097] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:44:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:44:19.714928 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b7cb2c-f4dc-41bf-971d-4cd3028d1d35 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:19.717099 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:19.780122 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa826f2c-d9b8-4510-9602-492015a4c035 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:19.784835 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:19.814502 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b7cb2c-f4dc-41bf-971d-4cd3028d1d35 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:19.814670 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf91a3-3c06-415a-a37c-8dfff0cbfb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:19.815262 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf91a3-3c06-415a-a37c-8dfff0cbfb89 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:19.815543 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf91a3-3c06-415a-a37c-8dfff0cbfb89 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:19.815820 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf91a3-3c06-415a-a37c-8dfff0cbfb89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:19.826669 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdf91a3-3c06-415a-a37c-8dfff0cbfb89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:19.828128 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdf91a3-3c06-415a-a37c-8dfff0cbfb89 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:19.844599 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-5bdf91a3-3c06-415a-a37c-8dfff0cbfb89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:44:19.844599 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:44:19.844599 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:44:19.844599 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:44:19.844599 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:44:19.844599 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:44:19.844599 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:44:19.844599 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:44:19.844599 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:44:19.844599 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:44:19.844599 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:44:19.844599 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:44:19.844599 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:44:19.844599 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:44:19.844599 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:44:19.844599 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:44:19.845689 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:44:19.845689 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:44:19.845689 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:44:19.845689 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:44:19.845689 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:44:19.845689 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:44:19.845689 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:44:19.845689 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:44:19.845689 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:44:19.845689 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:44:19.845689 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:44:19.845689 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:44:19.845689 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:44:19.845689 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:44:19.845689 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:44:19.845689 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:44:19.845689 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:44:19.851410 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:44:19.851410 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:44:19.851410 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:44:19.851410 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 563/1098] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:44:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:44:19.851639 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb8463-e464-4152-a58b-969eccb07f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:19.851639 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb8463-e464-4152-a58b-969eccb07f5b None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:19.851639 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb8463-e464-4152-a58b-969eccb07f5b None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:19.851639 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb8463-e464-4152-a58b-969eccb07f5b None admin] PATH_INFO: `/v3/users/ff5f9970f5884e459fcea85c6b835ed2` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:19.851934 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf91a3-3c06-415a-a37c-8dfff0cbfb89 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:19.852012 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb8463-e464-4152-a58b-969eccb07f5b None admin] RBAC: Authorizing `identity:get_user(user_id=ff5f9970f5884e459fcea85c6b835ed2)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:19.852791 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb8463-e464-4152-a58b-969eccb07f5b None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:19.858977 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 536/1099] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 7 15:44:19 2022] GET /identity/v3/users/ff5f9970f5884e459fcea85c6b835ed2 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:44:19.860740 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb8463-e464-4152-a58b-969eccb07f5b None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:19.942465 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:19.953384 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf91a3-3c06-415a-a37c-8dfff0cbfb89 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:19.964842 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb8463-e464-4152-a58b-969eccb07f5b None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:19.987570 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48caa2d9-423f-4778-a8bf-dde1bcdd3e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:19.988174 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48caa2d9-423f-4778-a8bf-dde1bcdd3e80 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:19.988455 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48caa2d9-423f-4778-a8bf-dde1bcdd3e80 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:19.988727 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48caa2d9-423f-4778-a8bf-dde1bcdd3e80 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:19.989362 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48caa2d9-423f-4778-a8bf-dde1bcdd3e80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:44:19.989669 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48caa2d9-423f-4778-a8bf-dde1bcdd3e80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:19.991064 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48caa2d9-423f-4778-a8bf-dde1bcdd3e80 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:19.999380 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a905003-9d91-41f5-bb94-c4f372e28bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:19.999981 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a905003-9d91-41f5-bb94-c4f372e28bef None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:20.000263 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a905003-9d91-41f5-bb94-c4f372e28bef None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:20.000539 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a905003-9d91-41f5-bb94-c4f372e28bef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:20.003593 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 564/1100] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:44:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:44:20.009477 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48caa2d9-423f-4778-a8bf-dde1bcdd3e80 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:20.011851 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:20.072071 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a905003-9d91-41f5-bb94-c4f372e28bef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:20.073480 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a905003-9d91-41f5-bb94-c4f372e28bef None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:20.110964 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48caa2d9-423f-4778-a8bf-dde1bcdd3e80 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:20.144438 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a13a7f-5ac2-44d3-917b-37088d74892d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:20.145086 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a13a7f-5ac2-44d3-917b-37088d74892d None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:20.145341 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a13a7f-5ac2-44d3-917b-37088d74892d None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:20.145613 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a13a7f-5ac2-44d3-917b-37088d74892d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:20.153402 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a13a7f-5ac2-44d3-917b-37088d74892d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:20.154885 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a13a7f-5ac2-44d3-917b-37088d74892d None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:20.166138 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-17a13a7f-5ac2-44d3-917b-37088d74892d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:44:20.166138 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:44:20.166138 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:44:20.166138 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:44:20.166138 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:44:20.166138 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:44:20.166138 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:44:20.166138 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:44:20.166138 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:44:20.166138 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:44:20.166138 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:44:20.166138 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:44:20.166138 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:44:20.166138 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:44:20.166138 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:44:20.167833 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:44:20.167833 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:44:20.167833 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:44:20.167833 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:44:20.167833 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:44:20.167833 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:44:20.167833 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:44:20.167833 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:44:20.167833 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:44:20.167833 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:44:20.167833 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:44:20.167833 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:44:20.167833 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:44:20.167833 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:44:20.167833 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:44:20.167833 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:44:20.167833 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:44:20.168742 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:44:20.168742 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:44:20.168742 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:44:20.168742 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:44:20.168742 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:44:20.168742 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:44:20.168742 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:44:20.168742 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:44:20.168742 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 565/1101] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:44:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:44:20.175169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a13a7f-5ac2-44d3-917b-37088d74892d None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:20.182619 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 537/1102] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:44:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 07 15:44:20.184712 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a905003-9d91-41f5-bb94-c4f372e28bef None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:20.187980 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:20.227352 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:20.280499 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a13a7f-5ac2-44d3-917b-37088d74892d None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:20.286141 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a905003-9d91-41f5-bb94-c4f372e28bef None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:20.314159 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06634332-e539-4f2c-b8e9-434daa15b5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:20.314798 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06634332-e539-4f2c-b8e9-434daa15b5c5 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:20.315088 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06634332-e539-4f2c-b8e9-434daa15b5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:20.315368 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06634332-e539-4f2c-b8e9-434daa15b5c5 None admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:20.316052 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06634332-e539-4f2c-b8e9-434daa15b5c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:44:20.316359 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06634332-e539-4f2c-b8e9-434daa15b5c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:20.317793 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06634332-e539-4f2c-b8e9-434daa15b5c5 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:20.319988 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b954a-edd5-48b0-8162-a9b9ded8b8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:20.320613 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b954a-edd5-48b0-8162-a9b9ded8b8eb None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:20.320889 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b954a-edd5-48b0-8162-a9b9ded8b8eb None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:20.321157 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b954a-edd5-48b0-8162-a9b9ded8b8eb None admin] PATH_INFO: `/v3/projects/3d8d975bfe0a4dd5b52faa2adb613abb` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:20.322332 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06b954a-edd5-48b0-8162-a9b9ded8b8eb None admin] RBAC: Authorizing `identity:get_project(project_id=3d8d975bfe0a4dd5b52faa2adb613abb)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:20.324280 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06b954a-edd5-48b0-8162-a9b9ded8b8eb None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:20.325887 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 538/1103] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 7 15:44:20 2022] GET /identity/v3/projects/3d8d975bfe0a4dd5b52faa2adb613abb => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:44:20.331103 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 566/1104] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 7 15:44:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:44:20.332131 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b954a-edd5-48b0-8162-a9b9ded8b8eb None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:20.336608 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06634332-e539-4f2c-b8e9-434daa15b5c5 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:20.406842 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:20.433003 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b954a-edd5-48b0-8162-a9b9ded8b8eb None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:20.439019 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06634332-e539-4f2c-b8e9-434daa15b5c5 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:20.441629 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:20.467760 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9825c-2a62-493d-9e04-3c14bc3ce13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:20.468363 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9825c-2a62-493d-9e04-3c14bc3ce13c None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:20.468642 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9825c-2a62-493d-9e04-3c14bc3ce13c None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:20.468913 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9825c-2a62-493d-9e04-3c14bc3ce13c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:20.469627 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9825c-2a62-493d-9e04-3c14bc3ce13c None admin] RBAC: Adding query filter params (role.id=61605ebf17e643258730e55bf6db15ad, scope.project.id=3d8d975bfe0a4dd5b52faa2adb613abb, user.id=ff5f9970f5884e459fcea85c6b835ed2) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:44:20.469933 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9825c-2a62-493d-9e04-3c14bc3ce13c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:20.471378 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9825c-2a62-493d-9e04-3c14bc3ce13c None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:20.477162 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 539/1105] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 7 15:44:20 2022] GET /identity/v3/role_assignments?user.id=ff5f9970f5884e459fcea85c6b835ed2&scope.project.id=3d8d975bfe0a4dd5b52faa2adb613abb&role.id=61605ebf17e643258730e55bf6db15ad => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:44:20.484276 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b30369-5582-43f3-8984-7a691c086fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:20.484910 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b30369-5582-43f3-8984-7a691c086fdc None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:20.485188 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b30369-5582-43f3-8984-7a691c086fdc None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:20.485459 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b30369-5582-43f3-8984-7a691c086fdc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:20.486219 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b30369-5582-43f3-8984-7a691c086fdc None admin] RBAC: Adding query filter params (role.id=aff163e4c39f4c2f980bc6a6a6ca3d43, scope.project.id=488830167943488f85743236584113d7, user.id=f9b13331a5fd48f5a2521ed1600f9f35) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:44:20.486532 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b30369-5582-43f3-8984-7a691c086fdc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:20.488005 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b30369-5582-43f3-8984-7a691c086fdc None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:20.494728 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 567/1106] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 7 15:44:20 2022] GET /identity/v3/role_assignments?user.id=f9b13331a5fd48f5a2521ed1600f9f35&scope.project.id=488830167943488f85743236584113d7&role.id=aff163e4c39f4c2f980bc6a6a6ca3d43 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:44:22.724589 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d768fa-19f0-4e7f-9373-e4dbf1a600c7 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:22.725145 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d768fa-19f0-4e7f-9373-e4dbf1a600c7 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:22.725145 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d768fa-19f0-4e7f-9373-e4dbf1a600c7 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:22.726508 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 540/1107] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:44:22.732454 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb757e1-9f25-4fdf-898b-fa3ec1973bd1 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:22.732894 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb757e1-9f25-4fdf-898b-fa3ec1973bd1 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:22.733004 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb757e1-9f25-4fdf-898b-fa3ec1973bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:22.752254 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-ebb757e1-9f25-4fdf-898b-fa3ec1973bd1 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:44:22.753428 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-ebb757e1-9f25-4fdf-898b-fa3ec1973bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:44:22.817289 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 568/1108] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:44:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:44:23.084468 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d768fa-19f0-4e7f-9373-e4dbf1a600c7 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:23.184508 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d768fa-19f0-4e7f-9373-e4dbf1a600c7 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:23.217172 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb8c05-1129-4b6e-ab0f-c2bfba497470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:23.217789 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb8c05-1129-4b6e-ab0f-c2bfba497470 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:23.218072 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb8c05-1129-4b6e-ab0f-c2bfba497470 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:23.218379 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb8c05-1129-4b6e-ab0f-c2bfba497470 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:23.219488 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb8c05-1129-4b6e-ab0f-c2bfba497470 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:23.220908 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb8c05-1129-4b6e-ab0f-c2bfba497470 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:23.222475 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 541/1109] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:44:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:44:23.228138 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb757e1-9f25-4fdf-898b-fa3ec1973bd1 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:23.289394 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:23.327112 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb757e1-9f25-4fdf-898b-fa3ec1973bd1 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:23.360378 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb02482-e610-46da-ac06-11228ee397eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:23.360975 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb02482-e610-46da-ac06-11228ee397eb None admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:23.361256 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb02482-e610-46da-ac06-11228ee397eb None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:23.361531 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb02482-e610-46da-ac06-11228ee397eb None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:23.362208 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb02482-e610-46da-ac06-11228ee397eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:23.363640 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb02482-e610-46da-ac06-11228ee397eb None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:23.383939 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 569/1110] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Sep 7 15:44:23 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:44:25.548320 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e4d4d-a2f9-46b4-ac23-5a93548184fa None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:25.548849 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e4d4d-a2f9-46b4-ac23-5a93548184fa None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:25.548849 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e4d4d-a2f9-46b4-ac23-5a93548184fa None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:25.550236 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 542/1111] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:44:25.555335 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33d98d-5d02-4b8f-82cd-b9183dec9d76 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:25.555752 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33d98d-5d02-4b8f-82cd-b9183dec9d76 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:25.555879 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33d98d-5d02-4b8f-82cd-b9183dec9d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:25.574946 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-0b33d98d-5d02-4b8f-82cd-b9183dec9d76 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:44:25.576111 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-0b33d98d-5d02-4b8f-82cd-b9183dec9d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:44:25.639413 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 570/1112] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:44:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:44:25.906844 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e4d4d-a2f9-46b4-ac23-5a93548184fa None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:25.954741 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:26.013242 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e4d4d-a2f9-46b4-ac23-5a93548184fa None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:26.047166 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a904a47-5a58-48ad-b044-0953f214dba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:26.047796 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a904a47-5a58-48ad-b044-0953f214dba7 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:26.048080 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a904a47-5a58-48ad-b044-0953f214dba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:26.048355 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a904a47-5a58-48ad-b044-0953f214dba7 None admin] PATH_INFO: `/v3/roles/ce978876ff724bf3b4101c9fd4d2d842` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:26.049738 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a904a47-5a58-48ad-b044-0953f214dba7 None admin] RBAC: Authorizing `identity:get_role(role_id=ce978876ff724bf3b4101c9fd4d2d842)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:26.051139 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a904a47-5a58-48ad-b044-0953f214dba7 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:26.052459 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 543/1113] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 7 15:44:25 2022] GET /identity/v3/roles/ce978876ff724bf3b4101c9fd4d2d842 => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:44:26.058330 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33d98d-5d02-4b8f-82cd-b9183dec9d76 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:26.107616 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:26.157883 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33d98d-5d02-4b8f-82cd-b9183dec9d76 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:26.190738 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a15fede-0385-465f-b497-ab882ba38916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:26.191360 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15fede-0385-465f-b497-ab882ba38916 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:26.191643 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15fede-0385-465f-b497-ab882ba38916 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:26.191919 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15fede-0385-465f-b497-ab882ba38916 None admin] PATH_INFO: `/v3/users/ab67097680b74b1f98ae3e712c12c8d3` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:26.205133 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a15fede-0385-465f-b497-ab882ba38916 None admin] RBAC: Authorizing `identity:get_user(user_id=ab67097680b74b1f98ae3e712c12c8d3)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:26.206604 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a15fede-0385-465f-b497-ab882ba38916 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:26.208178 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 571/1114] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 7 15:44:26 2022] GET /identity/v3/users/ab67097680b74b1f98ae3e712c12c8d3 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:44:26.213859 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a904a47-5a58-48ad-b044-0953f214dba7 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:26.314001 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a904a47-5a58-48ad-b044-0953f214dba7 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:26.322626 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:26.348520 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566874d5-baed-406a-a30f-66ec0f81c2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:26.349124 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566874d5-baed-406a-a30f-66ec0f81c2b6 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:26.349407 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566874d5-baed-406a-a30f-66ec0f81c2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:26.349684 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566874d5-baed-406a-a30f-66ec0f81c2b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:26.420041 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566874d5-baed-406a-a30f-66ec0f81c2b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:26.421429 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566874d5-baed-406a-a30f-66ec0f81c2b6 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:26.518490 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 544/1115] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:44:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 15:44:26.524435 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a15fede-0385-465f-b497-ab882ba38916 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:26.622890 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a15fede-0385-465f-b497-ab882ba38916 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:26.631823 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:26.656158 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314621a4-0fe1-470e-9f74-c4d456043626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:26.656771 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314621a4-0fe1-470e-9f74-c4d456043626 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:26.657054 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314621a4-0fe1-470e-9f74-c4d456043626 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:26.657323 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314621a4-0fe1-470e-9f74-c4d456043626 None admin] PATH_INFO: `/v3/projects/3d8d975bfe0a4dd5b52faa2adb613abb` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:26.658438 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314621a4-0fe1-470e-9f74-c4d456043626 None admin] RBAC: Authorizing `identity:get_project(project_id=3d8d975bfe0a4dd5b52faa2adb613abb)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:26.659845 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314621a4-0fe1-470e-9f74-c4d456043626 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:26.661427 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 572/1116] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 7 15:44:26 2022] GET /identity/v3/projects/3d8d975bfe0a4dd5b52faa2adb613abb => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:44:26.668269 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566874d5-baed-406a-a30f-66ec0f81c2b6 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:26.679696 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:26.764687 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566874d5-baed-406a-a30f-66ec0f81c2b6 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:26.797266 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85887d1-c7ac-4c42-84f2-83a09df07d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:26.797850 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85887d1-c7ac-4c42-84f2-83a09df07d49 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:26.798126 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85887d1-c7ac-4c42-84f2-83a09df07d49 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:26.798421 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85887d1-c7ac-4c42-84f2-83a09df07d49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:26.799123 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85887d1-c7ac-4c42-84f2-83a09df07d49 None admin] RBAC: Adding query filter params (role.id=ce978876ff724bf3b4101c9fd4d2d842, scope.project.id=3d8d975bfe0a4dd5b52faa2adb613abb, user.id=ab67097680b74b1f98ae3e712c12c8d3) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:44:26.799426 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85887d1-c7ac-4c42-84f2-83a09df07d49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:26.800825 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85887d1-c7ac-4c42-84f2-83a09df07d49 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:26.805958 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 545/1117] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 7 15:44:26 2022] GET /identity/v3/role_assignments?user.id=ab67097680b74b1f98ae3e712c12c8d3&scope.project.id=3d8d975bfe0a4dd5b52faa2adb613abb&role.id=ce978876ff724bf3b4101c9fd4d2d842 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:44:28.905511 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113f63b-390f-4dd2-b9c4-7412255892c5 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:28.906076 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113f63b-390f-4dd2-b9c4-7412255892c5 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:28.906076 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113f63b-390f-4dd2-b9c4-7412255892c5 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:28.907428 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 573/1118] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:44:28.912668 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e345c-0535-4310-b8f6-47e47508d908 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:28.913074 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e345c-0535-4310-b8f6-47e47508d908 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:28.913229 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e345c-0535-4310-b8f6-47e47508d908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:28.931586 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-cd3e345c-0535-4310-b8f6-47e47508d908 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:44:28.933474 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-cd3e345c-0535-4310-b8f6-47e47508d908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:44:28.998851 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 546/1119] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:44:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:44:29.268153 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1113f63b-390f-4dd2-b9c4-7412255892c5 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:29.369637 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1113f63b-390f-4dd2-b9c4-7412255892c5 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:29.403924 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33021a6f-1b9c-4cc8-a0ea-23d84e3acc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:29.404537 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33021a6f-1b9c-4cc8-a0ea-23d84e3acc9a None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:29.404812 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33021a6f-1b9c-4cc8-a0ea-23d84e3acc9a None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:29.405084 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33021a6f-1b9c-4cc8-a0ea-23d84e3acc9a None admin] PATH_INFO: `/v3/roles/ce978876ff724bf3b4101c9fd4d2d842` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:29.406467 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33021a6f-1b9c-4cc8-a0ea-23d84e3acc9a None admin] RBAC: Authorizing `identity:get_role(role_id=ce978876ff724bf3b4101c9fd4d2d842)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:29.407817 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33021a6f-1b9c-4cc8-a0ea-23d84e3acc9a None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:29.409087 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 574/1120] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 7 15:44:29 2022] GET /identity/v3/roles/ce978876ff724bf3b4101c9fd4d2d842 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:44:29.414911 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e345c-0535-4310-b8f6-47e47508d908 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:29.417119 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:29.512885 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e345c-0535-4310-b8f6-47e47508d908 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:29.546310 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748362f7-0931-4d19-840d-952a4bc56fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:29.546865 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748362f7-0931-4d19-840d-952a4bc56fb5 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:29.547148 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748362f7-0931-4d19-840d-952a4bc56fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:29.547423 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748362f7-0931-4d19-840d-952a4bc56fb5 None admin] PATH_INFO: `/v3/users/ab67097680b74b1f98ae3e712c12c8d3` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:29.548537 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748362f7-0931-4d19-840d-952a4bc56fb5 None admin] RBAC: Authorizing `identity:get_user(user_id=ab67097680b74b1f98ae3e712c12c8d3)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:29.549962 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748362f7-0931-4d19-840d-952a4bc56fb5 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:29.551559 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 547/1121] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 7 15:44:29 2022] GET /identity/v3/users/ab67097680b74b1f98ae3e712c12c8d3 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:44:29.557163 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33021a6f-1b9c-4cc8-a0ea-23d84e3acc9a None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:29.601937 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:29.654439 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33021a6f-1b9c-4cc8-a0ea-23d84e3acc9a None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:29.687215 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cafe35-8022-40f3-843e-2022b1e53075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:29.687836 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cafe35-8022-40f3-843e-2022b1e53075 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:29.688111 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cafe35-8022-40f3-843e-2022b1e53075 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:29.688381 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cafe35-8022-40f3-843e-2022b1e53075 None admin] PATH_INFO: `/v3/projects/3d8d975bfe0a4dd5b52faa2adb613abb` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:29.689473 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cafe35-8022-40f3-843e-2022b1e53075 None admin] RBAC: Authorizing `identity:get_project(project_id=3d8d975bfe0a4dd5b52faa2adb613abb)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:29.690913 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cafe35-8022-40f3-843e-2022b1e53075 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:29.692496 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 575/1122] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 7 15:44:29 2022] GET /identity/v3/projects/3d8d975bfe0a4dd5b52faa2adb613abb => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:44:29.699280 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748362f7-0931-4d19-840d-952a4bc56fb5 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:29.768314 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:29.799498 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748362f7-0931-4d19-840d-952a4bc56fb5 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:29.832538 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1f926b-1583-4077-bd35-da9db1c0a4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:29.833186 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f926b-1583-4077-bd35-da9db1c0a4a0 None admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:29.833471 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f926b-1583-4077-bd35-da9db1c0a4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:29.833752 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f926b-1583-4077-bd35-da9db1c0a4a0 None admin] PATH_INFO: `/v3/projects/3d8d975bfe0a4dd5b52faa2adb613abb/users/ab67097680b74b1f98ae3e712c12c8d3/roles/ce978876ff724bf3b4101c9fd4d2d842` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:29.835887 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1f926b-1583-4077-bd35-da9db1c0a4a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=3d8d975bfe0a4dd5b52faa2adb613abb, user_id=ab67097680b74b1f98ae3e712c12c8d3, role_id=ce978876ff724bf3b4101c9fd4d2d842)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:29.837320 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1f926b-1583-4077-bd35-da9db1c0a4a0 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:29.849782 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 548/1123] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 7 15:44:29 2022] PUT /identity/v3/projects/3d8d975bfe0a4dd5b52faa2adb613abb/users/ab67097680b74b1f98ae3e712c12c8d3/roles/ce978876ff724bf3b4101c9fd4d2d842 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:44:31.973310 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6b599-f47c-4b7a-bf4e-1fd402a4cddd None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:31.973841 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6b599-f47c-4b7a-bf4e-1fd402a4cddd None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:31.973841 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6b599-f47c-4b7a-bf4e-1fd402a4cddd None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:31.975200 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 576/1124] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:44:31.981076 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87758c2-a3f3-4453-8604-6c015522911d None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:31.981490 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87758c2-a3f3-4453-8604-6c015522911d None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:31.981629 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87758c2-a3f3-4453-8604-6c015522911d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:32.000882 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-e87758c2-a3f3-4453-8604-6c015522911d None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:44:32.002054 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-e87758c2-a3f3-4453-8604-6c015522911d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:44:32.069717 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 549/1125] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:44:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:44:32.342644 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6b599-f47c-4b7a-bf4e-1fd402a4cddd None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:32.441501 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6b599-f47c-4b7a-bf4e-1fd402a4cddd None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:32.454382 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:32.475306 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca4bb1c-74e0-49ab-a2d7-194b0d767f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:32.475923 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4bb1c-74e0-49ab-a2d7-194b0d767f65 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:32.476200 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4bb1c-74e0-49ab-a2d7-194b0d767f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:32.476470 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4bb1c-74e0-49ab-a2d7-194b0d767f65 None admin] PATH_INFO: `/v3/roles/ce978876ff724bf3b4101c9fd4d2d842` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:32.477831 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca4bb1c-74e0-49ab-a2d7-194b0d767f65 None admin] RBAC: Authorizing `identity:get_role(role_id=ce978876ff724bf3b4101c9fd4d2d842)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:32.479291 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca4bb1c-74e0-49ab-a2d7-194b0d767f65 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:32.481391 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 577/1126] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 7 15:44:32 2022] GET /identity/v3/roles/ce978876ff724bf3b4101c9fd4d2d842 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:44:32.487446 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87758c2-a3f3-4453-8604-6c015522911d None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:32.549656 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:32.598551 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87758c2-a3f3-4453-8604-6c015522911d None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:32.643401 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212de805-065d-4b48-884c-7fc424276a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:32.644300 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212de805-065d-4b48-884c-7fc424276a13 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:32.644728 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212de805-065d-4b48-884c-7fc424276a13 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:32.645137 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212de805-065d-4b48-884c-7fc424276a13 None admin] PATH_INFO: `/v3/users/ab67097680b74b1f98ae3e712c12c8d3` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:32.646782 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212de805-065d-4b48-884c-7fc424276a13 None admin] RBAC: Authorizing `identity:get_user(user_id=ab67097680b74b1f98ae3e712c12c8d3)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:32.649032 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212de805-065d-4b48-884c-7fc424276a13 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:32.651257 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 550/1127] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 7 15:44:32 2022] GET /identity/v3/users/ab67097680b74b1f98ae3e712c12c8d3 => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:44:32.659008 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca4bb1c-74e0-49ab-a2d7-194b0d767f65 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:32.761534 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca4bb1c-74e0-49ab-a2d7-194b0d767f65 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:32.794589 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a0014-a450-4114-938c-ee2712f17137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:32.795186 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a0014-a450-4114-938c-ee2712f17137 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:32.795465 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a0014-a450-4114-938c-ee2712f17137 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:32.795741 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a0014-a450-4114-938c-ee2712f17137 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:32.842748 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:32.862207 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a0014-a450-4114-938c-ee2712f17137 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:32.863607 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a0014-a450-4114-938c-ee2712f17137 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:32.980501 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 578/1128] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:44:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 15:44:32.986737 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212de805-065d-4b48-884c-7fc424276a13 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:33.084177 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212de805-065d-4b48-884c-7fc424276a13 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:33.110348 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:33.118437 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce59b628-1efb-49d8-a2a2-bec0017e0796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:33.119005 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59b628-1efb-49d8-a2a2-bec0017e0796 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:33.119287 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59b628-1efb-49d8-a2a2-bec0017e0796 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:33.119562 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59b628-1efb-49d8-a2a2-bec0017e0796 None admin] PATH_INFO: `/v3/projects/3d8d975bfe0a4dd5b52faa2adb613abb` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:33.120925 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce59b628-1efb-49d8-a2a2-bec0017e0796 None admin] RBAC: Authorizing `identity:get_project(project_id=3d8d975bfe0a4dd5b52faa2adb613abb)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:33.122369 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce59b628-1efb-49d8-a2a2-bec0017e0796 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:33.123981 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 551/1129] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 7 15:44:32 2022] GET /identity/v3/projects/3d8d975bfe0a4dd5b52faa2adb613abb => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:44:33.130027 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a0014-a450-4114-938c-ee2712f17137 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:33.207426 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:33.226578 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a0014-a450-4114-938c-ee2712f17137 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:33.260021 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f002545-d458-4d31-a13d-a8dac6804e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:33.261114 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f002545-d458-4d31-a13d-a8dac6804e0f None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:33.261427 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f002545-d458-4d31-a13d-a8dac6804e0f None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:33.261700 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f002545-d458-4d31-a13d-a8dac6804e0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:33.262428 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f002545-d458-4d31-a13d-a8dac6804e0f None admin] RBAC: Adding query filter params (role.id=ce978876ff724bf3b4101c9fd4d2d842, scope.project.id=3d8d975bfe0a4dd5b52faa2adb613abb, user.id=ab67097680b74b1f98ae3e712c12c8d3) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:44:33.262735 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f002545-d458-4d31-a13d-a8dac6804e0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:33.264137 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f002545-d458-4d31-a13d-a8dac6804e0f None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:33.269663 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 579/1130] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 7 15:44:33 2022] GET /identity/v3/role_assignments?user.id=ab67097680b74b1f98ae3e712c12c8d3&scope.project.id=3d8d975bfe0a4dd5b52faa2adb613abb&role.id=ce978876ff724bf3b4101c9fd4d2d842 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:44:35.451272 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd696bae-0148-4870-88f5-6c0af5b97d79 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:35.451782 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd696bae-0148-4870-88f5-6c0af5b97d79 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:35.451897 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd696bae-0148-4870-88f5-6c0af5b97d79 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:35.453154 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 552/1131] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:44:35.458423 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b78f95-b945-48b0-8f1a-8dafbe5d86a9 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:35.458817 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b78f95-b945-48b0-8f1a-8dafbe5d86a9 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:35.459008 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b78f95-b945-48b0-8f1a-8dafbe5d86a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:35.478023 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-e4b78f95-b945-48b0-8f1a-8dafbe5d86a9 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:44:35.479240 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-e4b78f95-b945-48b0-8f1a-8dafbe5d86a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:44:35.544558 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 580/1132] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:44:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:44:35.847487 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd696bae-0148-4870-88f5-6c0af5b97d79 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:35.946795 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd696bae-0148-4870-88f5-6c0af5b97d79 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:35.980194 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640020a5-380c-4e5c-b9d1-e50e7f9a6891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:35.980808 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640020a5-380c-4e5c-b9d1-e50e7f9a6891 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:35.981085 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640020a5-380c-4e5c-b9d1-e50e7f9a6891 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:35.981356 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640020a5-380c-4e5c-b9d1-e50e7f9a6891 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:35.982474 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640020a5-380c-4e5c-b9d1-e50e7f9a6891 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:35.984278 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640020a5-380c-4e5c-b9d1-e50e7f9a6891 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:35.985824 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 553/1133] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:44:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:44:35.991725 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b78f95-b945-48b0-8f1a-8dafbe5d86a9 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:36.064556 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:36.089263 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b78f95-b945-48b0-8f1a-8dafbe5d86a9 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:36.122535 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63852ead-6af1-4563-9b05-b3937defbe4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:36.123083 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63852ead-6af1-4563-9b05-b3937defbe4a None admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:36.123360 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63852ead-6af1-4563-9b05-b3937defbe4a None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:36.123628 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63852ead-6af1-4563-9b05-b3937defbe4a None admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:36.124269 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63852ead-6af1-4563-9b05-b3937defbe4a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:36.125689 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63852ead-6af1-4563-9b05-b3937defbe4a None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:36.153106 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 581/1134] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Sep 7 15:44:35 2022] POST /identity/v3/projects => generated 311 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:44:38.320777 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b124b9-d42a-4cfb-89e5-3a60f7adb69e None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:38.321290 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b124b9-d42a-4cfb-89e5-3a60f7adb69e None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:38.321290 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b124b9-d42a-4cfb-89e5-3a60f7adb69e None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:38.322592 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 554/1135] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:44:38.328072 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27560e0-503d-4533-9aa4-8b1392ab89b0 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:38.328516 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27560e0-503d-4533-9aa4-8b1392ab89b0 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:38.328610 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27560e0-503d-4533-9aa4-8b1392ab89b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:38.347142 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-f27560e0-503d-4533-9aa4-8b1392ab89b0 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:44:38.348332 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-f27560e0-503d-4533-9aa4-8b1392ab89b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:44:38.413744 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 582/1136] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:44:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:44:38.681510 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b124b9-d42a-4cfb-89e5-3a60f7adb69e None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:38.743287 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:38.782723 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b124b9-d42a-4cfb-89e5-3a60f7adb69e None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:38.814898 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25e78a-8efd-48a5-8282-f55512caa2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:38.815511 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25e78a-8efd-48a5-8282-f55512caa2cb None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:38.815792 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25e78a-8efd-48a5-8282-f55512caa2cb None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:38.816063 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25e78a-8efd-48a5-8282-f55512caa2cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:38.817164 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f25e78a-8efd-48a5-8282-f55512caa2cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:38.818612 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f25e78a-8efd-48a5-8282-f55512caa2cb None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:38.820147 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 555/1137] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:44:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:44:38.826619 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27560e0-503d-4533-9aa4-8b1392ab89b0 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:38.880373 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:38.922882 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27560e0-503d-4533-9aa4-8b1392ab89b0 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:38.956411 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b11789-0157-4ef2-81d4-57000d3f720f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:38.956951 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b11789-0157-4ef2-81d4-57000d3f720f None admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:38.957232 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b11789-0157-4ef2-81d4-57000d3f720f None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:38.957505 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b11789-0157-4ef2-81d4-57000d3f720f None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:38.958145 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b11789-0157-4ef2-81d4-57000d3f720f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:38.959593 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b11789-0157-4ef2-81d4-57000d3f720f None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:38.979678 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 583/1138] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Sep 7 15:44:38 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:44:41.165959 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2c4d6-0c22-478b-9425-6dbbfc03b2a4 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:41.166526 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2c4d6-0c22-478b-9425-6dbbfc03b2a4 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:41.166526 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2c4d6-0c22-478b-9425-6dbbfc03b2a4 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:41.168573 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 556/1139] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:44:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:44:41.173878 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45f7c3-a010-4424-98ca-3f1a5563e0a3 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:41.174307 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45f7c3-a010-4424-98ca-3f1a5563e0a3 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:41.174472 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45f7c3-a010-4424-98ca-3f1a5563e0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:41.192547 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-2f45f7c3-a010-4424-98ca-3f1a5563e0a3 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:44:41.193729 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-2f45f7c3-a010-4424-98ca-3f1a5563e0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:44:41.259090 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 584/1140] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:44:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:44:41.534700 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d2c4d6-0c22-478b-9425-6dbbfc03b2a4 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:41.634148 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d2c4d6-0c22-478b-9425-6dbbfc03b2a4 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:41.663962 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:41.669108 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97200abe-133e-449e-8bad-e6b4b7e9fed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:41.669721 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97200abe-133e-449e-8bad-e6b4b7e9fed9 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:41.669999 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97200abe-133e-449e-8bad-e6b4b7e9fed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:41.670300 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97200abe-133e-449e-8bad-e6b4b7e9fed9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:41.680103 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97200abe-133e-449e-8bad-e6b4b7e9fed9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:44:41.684998 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-97200abe-133e-449e-8bad-e6b4b7e9fed9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:44:41.684998 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:44:41.684998 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:44:41.684998 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:44:41.684998 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:44:41.684998 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:44:41.684998 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:44:41.684998 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:44:41.684998 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:44:41.684998 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:44:41.684998 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:44:41.684998 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:44:41.684998 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:44:41.684998 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:44:41.684998 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:44:41.684998 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:44:41.686153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:44:41.686153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:44:41.686153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:44:41.686153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:44:41.686153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:44:41.686153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:44:41.686153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:44:41.686153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:44:41.686153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:44:41.686153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:44:41.686153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:44:41.686153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:44:41.686153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:44:41.686153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:44:41.686153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:44:41.686153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:44:41.687035 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:44:41.687035 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:44:41.687035 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:44:41.687035 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:44:41.687035 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:44:41.687035 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:44:41.687035 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:44:41.687035 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:44:41.687035 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:44:41.687035 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:44:41.687035 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:44:41.687035 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:44:41.687035 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 557/1141] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 7 15:44:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:44:41.692123 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f45f7c3-a010-4424-98ca-3f1a5563e0a3 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:41.735950 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:41.792205 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f45f7c3-a010-4424-98ca-3f1a5563e0a3 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:41.826029 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee49148-a47e-435d-8e2d-bc095f4ad797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:41.826659 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee49148-a47e-435d-8e2d-bc095f4ad797 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:41.826945 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee49148-a47e-435d-8e2d-bc095f4ad797 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:41.827216 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee49148-a47e-435d-8e2d-bc095f4ad797 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:41.827869 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee49148-a47e-435d-8e2d-bc095f4ad797 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:44:41.828170 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee49148-a47e-435d-8e2d-bc095f4ad797 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:41.829529 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee49148-a47e-435d-8e2d-bc095f4ad797 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:41.837326 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 585/1142] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:44:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:44:41.844348 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97200abe-133e-449e-8bad-e6b4b7e9fed9 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:41.945993 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97200abe-133e-449e-8bad-e6b4b7e9fed9 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:41.978878 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044e6cf-0539-4809-b753-43be6b335a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:41.980293 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044e6cf-0539-4809-b753-43be6b335a18 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:41.980570 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044e6cf-0539-4809-b753-43be6b335a18 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:41.980843 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044e6cf-0539-4809-b753-43be6b335a18 None admin] PATH_INFO: `/v3/users/f93056a43db74893b1bf260e45df59f4` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:41.993609 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1044e6cf-0539-4809-b753-43be6b335a18 None admin] RBAC: Authorizing `identity:get_user(user_id=f93056a43db74893b1bf260e45df59f4)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:41.995065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1044e6cf-0539-4809-b753-43be6b335a18 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:41.996631 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 558/1143] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 7 15:44:41 2022] GET /identity/v3/users/f93056a43db74893b1bf260e45df59f4 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:44:42.002350 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee49148-a47e-435d-8e2d-bc095f4ad797 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:42.100755 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee49148-a47e-435d-8e2d-bc095f4ad797 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:42.102978 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:42.133982 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb2e564-399a-478c-974a-c912a230b444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:42.134614 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2e564-399a-478c-974a-c912a230b444 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:42.134898 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2e564-399a-478c-974a-c912a230b444 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:42.135174 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2e564-399a-478c-974a-c912a230b444 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:42.200536 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb2e564-399a-478c-974a-c912a230b444 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:42.201976 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb2e564-399a-478c-974a-c912a230b444 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:42.298410 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 586/1144] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:44:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 15:44:42.304347 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044e6cf-0539-4809-b753-43be6b335a18 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:42.353908 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:42.402986 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044e6cf-0539-4809-b753-43be6b335a18 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:42.435451 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b9167-a2f0-43ee-b17e-82119b917e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:42.436065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b9167-a2f0-43ee-b17e-82119b917e97 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:42.436349 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b9167-a2f0-43ee-b17e-82119b917e97 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:42.436627 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b9167-a2f0-43ee-b17e-82119b917e97 None admin] PATH_INFO: `/v3/projects/3f9e39ccf6af46b09fe56e649bf415c5` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:42.437738 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b9167-a2f0-43ee-b17e-82119b917e97 None admin] RBAC: Authorizing `identity:get_project(project_id=3f9e39ccf6af46b09fe56e649bf415c5)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:42.439185 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b9167-a2f0-43ee-b17e-82119b917e97 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:42.440781 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 559/1145] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 7 15:44:42 2022] GET /identity/v3/projects/3f9e39ccf6af46b09fe56e649bf415c5 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:44:42.446819 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb2e564-399a-478c-974a-c912a230b444 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:42.450399 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:42.543586 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb2e564-399a-478c-974a-c912a230b444 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:42.576438 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc5339-9bd9-4f23-a16c-4871b0d3f19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:42.577029 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc5339-9bd9-4f23-a16c-4871b0d3f19c None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:42.577307 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc5339-9bd9-4f23-a16c-4871b0d3f19c None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:42.577578 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc5339-9bd9-4f23-a16c-4871b0d3f19c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:42.578311 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc5339-9bd9-4f23-a16c-4871b0d3f19c None admin] RBAC: Adding query filter params (role.id=61605ebf17e643258730e55bf6db15ad, scope.project.id=3f9e39ccf6af46b09fe56e649bf415c5, user.id=f93056a43db74893b1bf260e45df59f4) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:44:42.578618 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc5339-9bd9-4f23-a16c-4871b0d3f19c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:42.580035 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc5339-9bd9-4f23-a16c-4871b0d3f19c None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:42.585140 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 587/1146] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 7 15:44:42 2022] GET /identity/v3/role_assignments?user.id=f93056a43db74893b1bf260e45df59f4&scope.project.id=3f9e39ccf6af46b09fe56e649bf415c5&role.id=61605ebf17e643258730e55bf6db15ad => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:44:44.714440 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d023c69-ff24-421c-8656-61c84594ba9f None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:44.714998 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d023c69-ff24-421c-8656-61c84594ba9f None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:44.714998 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d023c69-ff24-421c-8656-61c84594ba9f None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:44.716315 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 560/1147] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:44:44.721577 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d9216-e852-4604-940a-d4dc809f7add None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:44.721981 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d9216-e852-4604-940a-d4dc809f7add None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:44.722132 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d9216-e852-4604-940a-d4dc809f7add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:44.740992 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-084d9216-e852-4604-940a-d4dc809f7add None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:44:44.742197 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-084d9216-e852-4604-940a-d4dc809f7add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:44:44.802699 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:44.809017 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 588/1148] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:44:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:44:45.079391 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d023c69-ff24-421c-8656-61c84594ba9f None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:45.178155 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d023c69-ff24-421c-8656-61c84594ba9f None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:45.194480 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:45.210803 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c09b4fe-a72a-415f-b39f-84cdfad14693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:45.211414 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09b4fe-a72a-415f-b39f-84cdfad14693 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:45.211691 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09b4fe-a72a-415f-b39f-84cdfad14693 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:45.211969 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09b4fe-a72a-415f-b39f-84cdfad14693 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:45.222239 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c09b4fe-a72a-415f-b39f-84cdfad14693 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:44:45.226960 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-2c09b4fe-a72a-415f-b39f-84cdfad14693 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:44:45.226960 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:44:45.226960 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:44:45.226960 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:44:45.226960 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:44:45.226960 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:44:45.226960 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:44:45.226960 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:44:45.226960 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:44:45.226960 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:44:45.226960 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:44:45.226960 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:44:45.226960 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:44:45.226960 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:44:45.226960 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:44:45.226960 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:44:45.228065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:44:45.228065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:44:45.228065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:44:45.228065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:44:45.228065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:44:45.228065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:44:45.228065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:44:45.228065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:44:45.228065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:44:45.228065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:44:45.228065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:44:45.228065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:44:45.228065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:44:45.228065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:44:45.228065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:44:45.228065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:44:45.229834 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:44:45.229834 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:44:45.229834 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:44:45.229834 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:44:45.229834 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:44:45.229834 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:44:45.229834 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:44:45.229834 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:44:45.229834 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:44:45.229834 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:44:45.229834 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:44:45.229834 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:44:45.229834 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 561/1149] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 7 15:44:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:44:45.234819 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d9216-e852-4604-940a-d4dc809f7add None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:45.329899 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d9216-e852-4604-940a-d4dc809f7add None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:45.363287 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56536202-b6f2-48d8-9841-87df3b60846c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:45.363883 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56536202-b6f2-48d8-9841-87df3b60846c None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:45.364164 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56536202-b6f2-48d8-9841-87df3b60846c None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:45.364435 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56536202-b6f2-48d8-9841-87df3b60846c None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:45.365091 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56536202-b6f2-48d8-9841-87df3b60846c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:44:45.365393 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56536202-b6f2-48d8-9841-87df3b60846c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:45.366781 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56536202-b6f2-48d8-9841-87df3b60846c None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:45.375086 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 589/1150] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:44:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:44:45.380771 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c09b4fe-a72a-415f-b39f-84cdfad14693 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:45.478160 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c09b4fe-a72a-415f-b39f-84cdfad14693 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:45.511386 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5cc56c-8203-4fb8-a97a-1fa5a97bf23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:45.511989 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cc56c-8203-4fb8-a97a-1fa5a97bf23e None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:45.512272 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cc56c-8203-4fb8-a97a-1fa5a97bf23e None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:45.512546 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cc56c-8203-4fb8-a97a-1fa5a97bf23e None admin] PATH_INFO: `/v3/users/f93056a43db74893b1bf260e45df59f4` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:45.513653 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5cc56c-8203-4fb8-a97a-1fa5a97bf23e None admin] RBAC: Authorizing `identity:get_user(user_id=f93056a43db74893b1bf260e45df59f4)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:45.515101 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5cc56c-8203-4fb8-a97a-1fa5a97bf23e None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:45.516637 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 562/1151] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 7 15:44:45 2022] GET /identity/v3/users/f93056a43db74893b1bf260e45df59f4 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:44:45.522273 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56536202-b6f2-48d8-9841-87df3b60846c None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:45.580364 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:45.621245 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56536202-b6f2-48d8-9841-87df3b60846c None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:45.653663 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e6c46c-acd8-44ff-a97c-f13340cdd222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:45.654304 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6c46c-acd8-44ff-a97c-f13340cdd222 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:45.654583 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6c46c-acd8-44ff-a97c-f13340cdd222 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:45.654853 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6c46c-acd8-44ff-a97c-f13340cdd222 None admin] PATH_INFO: `/v3/projects/3f9e39ccf6af46b09fe56e649bf415c5` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:45.655956 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e6c46c-acd8-44ff-a97c-f13340cdd222 None admin] RBAC: Authorizing `identity:get_project(project_id=3f9e39ccf6af46b09fe56e649bf415c5)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:45.657364 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e6c46c-acd8-44ff-a97c-f13340cdd222 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:45.659154 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 590/1152] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 7 15:44:45 2022] GET /identity/v3/projects/3f9e39ccf6af46b09fe56e649bf415c5 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:44:45.664829 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5cc56c-8203-4fb8-a97a-1fa5a97bf23e None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:45.710888 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:45.763635 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5cc56c-8203-4fb8-a97a-1fa5a97bf23e None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:45.795156 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc25534-1eeb-4795-ae7b-81f96cfb7fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:45.795791 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc25534-1eeb-4795-ae7b-81f96cfb7fb0 None admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:45.796069 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc25534-1eeb-4795-ae7b-81f96cfb7fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:45.796336 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc25534-1eeb-4795-ae7b-81f96cfb7fb0 None admin] PATH_INFO: `/v3/projects/3f9e39ccf6af46b09fe56e649bf415c5/users/f93056a43db74893b1bf260e45df59f4/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:45.798210 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc25534-1eeb-4795-ae7b-81f96cfb7fb0 None admin] RBAC: Authorizing `identity:create_grant(project_id=3f9e39ccf6af46b09fe56e649bf415c5, user_id=f93056a43db74893b1bf260e45df59f4, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:45.799619 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc25534-1eeb-4795-ae7b-81f96cfb7fb0 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:45.813319 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 563/1153] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 7 15:44:45 2022] PUT /identity/v3/projects/3f9e39ccf6af46b09fe56e649bf415c5/users/f93056a43db74893b1bf260e45df59f4/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:44:47.919331 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637748d-9ec0-4e0d-b7aa-e7a4a1798df5 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:47.919913 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637748d-9ec0-4e0d-b7aa-e7a4a1798df5 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:47.919913 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637748d-9ec0-4e0d-b7aa-e7a4a1798df5 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:47.921177 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 591/1154] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:44:47.926463 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863779c-65e2-41ad-8b16-42617081ddec None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:47.926890 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863779c-65e2-41ad-8b16-42617081ddec None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:47.927018 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863779c-65e2-41ad-8b16-42617081ddec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:47.944909 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-e863779c-65e2-41ad-8b16-42617081ddec None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:44:47.946073 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-e863779c-65e2-41ad-8b16-42617081ddec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:44:48.011396 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 564/1155] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:44:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:44:48.278898 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3637748d-9ec0-4e0d-b7aa-e7a4a1798df5 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:48.377704 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3637748d-9ec0-4e0d-b7aa-e7a4a1798df5 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:48.404420 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:48.412254 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99257bb8-3dfb-481a-a1cf-111dc0ea913b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:48.412878 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99257bb8-3dfb-481a-a1cf-111dc0ea913b None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:48.413157 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99257bb8-3dfb-481a-a1cf-111dc0ea913b None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:48.413433 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99257bb8-3dfb-481a-a1cf-111dc0ea913b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:48.424405 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99257bb8-3dfb-481a-a1cf-111dc0ea913b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:44:48.429257 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-99257bb8-3dfb-481a-a1cf-111dc0ea913b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:44:48.429257 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:44:48.429257 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:44:48.429257 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:44:48.429257 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:44:48.429257 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:44:48.429257 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:44:48.429257 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:44:48.429257 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:44:48.429257 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:44:48.429257 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:44:48.429257 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:44:48.429257 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:44:48.429257 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:44:48.429257 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:44:48.429257 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:44:48.430450 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:44:48.430450 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:44:48.430450 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:44:48.430450 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:44:48.430450 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:44:48.430450 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:44:48.430450 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:44:48.430450 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:44:48.430450 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:44:48.430450 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:44:48.430450 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:44:48.430450 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:44:48.430450 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:44:48.430450 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:44:48.430450 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:44:48.430450 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:44:48.431733 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:44:48.431733 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:44:48.431733 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:44:48.431733 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:44:48.431733 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:44:48.431733 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:44:48.431733 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:44:48.431733 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:44:48.431733 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:44:48.431733 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:44:48.431733 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:44:48.431733 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:44:48.431733 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 592/1156] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 7 15:44:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:44:48.437028 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e863779c-65e2-41ad-8b16-42617081ddec None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:48.470873 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:48.534851 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e863779c-65e2-41ad-8b16-42617081ddec None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:48.568407 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa9e4e0-4e09-4d49-bcfe-16c892e143b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:48.569012 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9e4e0-4e09-4d49-bcfe-16c892e143b1 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:48.569294 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9e4e0-4e09-4d49-bcfe-16c892e143b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:48.569570 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9e4e0-4e09-4d49-bcfe-16c892e143b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:48.570254 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa9e4e0-4e09-4d49-bcfe-16c892e143b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:44:48.570564 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa9e4e0-4e09-4d49-bcfe-16c892e143b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:48.571933 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa9e4e0-4e09-4d49-bcfe-16c892e143b1 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:48.579757 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 565/1157] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:44:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:44:48.586333 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99257bb8-3dfb-481a-a1cf-111dc0ea913b None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:48.683223 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99257bb8-3dfb-481a-a1cf-111dc0ea913b None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:48.716043 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325f128-9045-4bca-a913-a6530662c124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:48.716656 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325f128-9045-4bca-a913-a6530662c124 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:48.716935 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325f128-9045-4bca-a913-a6530662c124 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:48.717210 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325f128-9045-4bca-a913-a6530662c124 None admin] PATH_INFO: `/v3/users/f93056a43db74893b1bf260e45df59f4` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:48.718352 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c325f128-9045-4bca-a913-a6530662c124 None admin] RBAC: Authorizing `identity:get_user(user_id=f93056a43db74893b1bf260e45df59f4)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:48.719770 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c325f128-9045-4bca-a913-a6530662c124 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:48.721296 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 593/1158] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 7 15:44:48 2022] GET /identity/v3/users/f93056a43db74893b1bf260e45df59f4 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:44:48.727115 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa9e4e0-4e09-4d49-bcfe-16c892e143b1 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:48.819799 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:48.824020 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa9e4e0-4e09-4d49-bcfe-16c892e143b1 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:48.857888 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6fba98-1a3d-4058-a646-824ff120adb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:48.858749 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fba98-1a3d-4058-a646-824ff120adb0 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:48.859064 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fba98-1a3d-4058-a646-824ff120adb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:48.859334 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fba98-1a3d-4058-a646-824ff120adb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:48.923445 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6fba98-1a3d-4058-a646-824ff120adb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:48.924872 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6fba98-1a3d-4058-a646-824ff120adb0 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:49.014842 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:49.019618 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 566/1159] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:44:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 15:44:49.025293 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325f128-9045-4bca-a913-a6530662c124 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:49.081252 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:49.124287 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325f128-9045-4bca-a913-a6530662c124 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:49.158527 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656cf59d-1bf5-43e5-9ae9-d575e393eb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:49.159153 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656cf59d-1bf5-43e5-9ae9-d575e393eb84 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:49.159432 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656cf59d-1bf5-43e5-9ae9-d575e393eb84 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:49.159704 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656cf59d-1bf5-43e5-9ae9-d575e393eb84 None admin] PATH_INFO: `/v3/projects/3f9e39ccf6af46b09fe56e649bf415c5` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:49.160811 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656cf59d-1bf5-43e5-9ae9-d575e393eb84 None admin] RBAC: Authorizing `identity:get_project(project_id=3f9e39ccf6af46b09fe56e649bf415c5)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:49.162257 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656cf59d-1bf5-43e5-9ae9-d575e393eb84 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:49.163858 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 594/1160] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 7 15:44:49 2022] GET /identity/v3/projects/3f9e39ccf6af46b09fe56e649bf415c5 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:44:49.170045 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6fba98-1a3d-4058-a646-824ff120adb0 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:49.264918 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6fba98-1a3d-4058-a646-824ff120adb0 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:49.298016 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c696ff-babc-4f0e-970f-37fa5ab8c6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:49.298634 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c696ff-babc-4f0e-970f-37fa5ab8c6fb None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:49.298911 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c696ff-babc-4f0e-970f-37fa5ab8c6fb None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:49.299177 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c696ff-babc-4f0e-970f-37fa5ab8c6fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:49.299870 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c696ff-babc-4f0e-970f-37fa5ab8c6fb None admin] RBAC: Adding query filter params (role.id=61605ebf17e643258730e55bf6db15ad, scope.project.id=3f9e39ccf6af46b09fe56e649bf415c5, user.id=f93056a43db74893b1bf260e45df59f4) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:44:49.300169 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c696ff-babc-4f0e-970f-37fa5ab8c6fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:49.301557 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c696ff-babc-4f0e-970f-37fa5ab8c6fb None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:49.307081 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 567/1161] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 7 15:44:49 2022] GET /identity/v3/role_assignments?user.id=f93056a43db74893b1bf260e45df59f4&scope.project.id=3f9e39ccf6af46b09fe56e649bf415c5&role.id=61605ebf17e643258730e55bf6db15ad => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:44:51.458319 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae18a9-1ecd-481e-8f97-4b65c8db72d6 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:51.458873 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae18a9-1ecd-481e-8f97-4b65c8db72d6 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:51.458873 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae18a9-1ecd-481e-8f97-4b65c8db72d6 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:51.460188 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 595/1162] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:44:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:44:51.465522 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d480d72-7354-4cf7-8eb6-1644ff893198 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:51.465944 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d480d72-7354-4cf7-8eb6-1644ff893198 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:51.466078 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d480d72-7354-4cf7-8eb6-1644ff893198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:51.484709 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-2d480d72-7354-4cf7-8eb6-1644ff893198 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:44:51.485876 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-2d480d72-7354-4cf7-8eb6-1644ff893198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:44:51.539576 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:51.550806 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 568/1163] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:44:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:44:51.817439 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae18a9-1ecd-481e-8f97-4b65c8db72d6 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:51.917570 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae18a9-1ecd-481e-8f97-4b65c8db72d6 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:51.940722 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:51.952070 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f1edec-8f40-497a-8ead-cc2a6445e4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:51.952663 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1edec-8f40-497a-8ead-cc2a6445e4b1 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:51.952940 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1edec-8f40-497a-8ead-cc2a6445e4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:51.953211 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1edec-8f40-497a-8ead-cc2a6445e4b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:52.018133 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f1edec-8f40-497a-8ead-cc2a6445e4b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:52.019590 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f1edec-8f40-497a-8ead-cc2a6445e4b1 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:52.116177 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 596/1164] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:44:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 15:44:52.122708 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d480d72-7354-4cf7-8eb6-1644ff893198 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:52.219779 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d480d72-7354-4cf7-8eb6-1644ff893198 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:52.254903 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410f607-a038-42af-a438-558b79a61878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:52.255523 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410f607-a038-42af-a438-558b79a61878 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:52.255807 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410f607-a038-42af-a438-558b79a61878 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:52.256085 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410f607-a038-42af-a438-558b79a61878 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:52.262966 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7410f607-a038-42af-a438-558b79a61878 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:52.264401 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7410f607-a038-42af-a438-558b79a61878 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:52.275611 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-7410f607-a038-42af-a438-558b79a61878 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 07 15:44:52.275611 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:44:52.275611 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 07 15:44:52.275611 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 07 15:44:52.275611 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:44:52.275611 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:44:52.275611 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:44:52.275611 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:44:52.275611 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 07 15:44:52.275611 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:44:52.275611 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:44:52.275611 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:44:52.275611 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:44:52.275611 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:44:52.275611 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:44:52.275611 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:44:52.275611 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:44:52.276804 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:44:52.276804 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:44:52.276804 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:44:52.276804 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:44:52.276804 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:44:52.276804 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:44:52.276804 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:44:52.276804 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:44:52.276804 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:44:52.276804 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:44:52.276804 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:44:52.276804 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:44:52.276804 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:44:52.276804 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:44:52.276804 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:44:52.276804 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:44:52.282665 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:44:52.282665 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:44:52.282665 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:44:52.282665 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:44:52.282665 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:44:52.282665 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:44:52.282665 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:44:52.282665 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:44:52.282665 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:44:52.282665 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:44:52.282665 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 07 15:44:52.282665 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:44:52.282665 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 07 15:44:52.282665 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:44:52.282665 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 569/1165] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Sep 7 15:44:52 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:44:52.283686 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f1edec-8f40-497a-8ead-cc2a6445e4b1 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:52.307732 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:52.379841 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f1edec-8f40-497a-8ead-cc2a6445e4b1 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:52.412688 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a0d0c5-dff5-4f0b-b07a-dea930de7d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:52.413278 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0d0c5-dff5-4f0b-b07a-dea930de7d8c None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:52.413553 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0d0c5-dff5-4f0b-b07a-dea930de7d8c None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:52.413820 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0d0c5-dff5-4f0b-b07a-dea930de7d8c None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:52.414470 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a0d0c5-dff5-4f0b-b07a-dea930de7d8c None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:44:52.414769 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a0d0c5-dff5-4f0b-b07a-dea930de7d8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:52.416106 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a0d0c5-dff5-4f0b-b07a-dea930de7d8c None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:52.423288 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 597/1166] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Sep 7 15:44:52 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:44:54.520850 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb36c3f-c673-4704-bff0-4066dc337bd3 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:54.521372 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb36c3f-c673-4704-bff0-4066dc337bd3 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:54.521484 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb36c3f-c673-4704-bff0-4066dc337bd3 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:54.522763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 570/1167] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:44:54.528414 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817c353-cc0a-4022-9c23-a14bba7b999d None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:54.528827 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817c353-cc0a-4022-9c23-a14bba7b999d None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:54.528960 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817c353-cc0a-4022-9c23-a14bba7b999d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:54.546976 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-7817c353-cc0a-4022-9c23-a14bba7b999d None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:44:54.548159 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-7817c353-cc0a-4022-9c23-a14bba7b999d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:44:54.613107 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 598/1168] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:44:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:44:54.884950 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb36c3f-c673-4704-bff0-4066dc337bd3 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:54.938781 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:54.986280 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb36c3f-c673-4704-bff0-4066dc337bd3 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:55.019001 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ffa09-71c8-4c5b-ab82-83e8c04822a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:55.019597 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ffa09-71c8-4c5b-ab82-83e8c04822a3 None admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:55.019874 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ffa09-71c8-4c5b-ab82-83e8c04822a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:55.020143 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ffa09-71c8-4c5b-ab82-83e8c04822a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:55.020797 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ffa09-71c8-4c5b-ab82-83e8c04822a3 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:55.022146 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ffa09-71c8-4c5b-ab82-83e8c04822a3 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:55.040244 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 571/1169] 10.222.0.16 () {60 vars in 1138 bytes} [Wed Sep 7 15:44:54 2022] POST /identity/v3/domains => generated 267 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:44:57.214380 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917e818-5ce2-42d9-a1e9-af3c308bb449 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:57.214953 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917e818-5ce2-42d9-a1e9-af3c308bb449 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:57.214953 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917e818-5ce2-42d9-a1e9-af3c308bb449 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:57.216267 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 599/1170] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:44:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:44:57.221517 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d6e85-046c-4ef6-953e-fac4b8ce9f0b None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:57.221939 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d6e85-046c-4ef6-953e-fac4b8ce9f0b None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:57.222073 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d6e85-046c-4ef6-953e-fac4b8ce9f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:57.240050 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-746d6e85-046c-4ef6-953e-fac4b8ce9f0b None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:44:57.241231 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-746d6e85-046c-4ef6-953e-fac4b8ce9f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:44:57.306846 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 572/1171] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:44:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:44:57.583733 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917e818-5ce2-42d9-a1e9-af3c308bb449 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:57.602864 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:57.685095 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917e818-5ce2-42d9-a1e9-af3c308bb449 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:57.717967 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e3cb3f-65ae-46f8-b11c-6b9e19d0b1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:57.718616 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3cb3f-65ae-46f8-b11c-6b9e19d0b1bf None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:57.718895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3cb3f-65ae-46f8-b11c-6b9e19d0b1bf None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:57.719168 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3cb3f-65ae-46f8-b11c-6b9e19d0b1bf None admin] PATH_INFO: `/v3/domains/e871b9a765c64d609b2ca6986c7f5ed5` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:57.729413 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e3cb3f-65ae-46f8-b11c-6b9e19d0b1bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=e871b9a765c64d609b2ca6986c7f5ed5)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:57.730884 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e3cb3f-65ae-46f8-b11c-6b9e19d0b1bf None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:57.732434 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 600/1172] 10.222.0.16 () {56 vars in 1183 bytes} [Wed Sep 7 15:44:57 2022] GET /identity/v3/domains/e871b9a765c64d609b2ca6986c7f5ed5 => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:44:57.738461 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d6e85-046c-4ef6-953e-fac4b8ce9f0b None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:44:57.780529 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:44:57.841016 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d6e85-046c-4ef6-953e-fac4b8ce9f0b None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:44:57.874671 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c7bc53-60db-4990-82ec-4de8cb130ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:44:57.875266 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7bc53-60db-4990-82ec-4de8cb130ba6 None admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:44:57.875545 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7bc53-60db-4990-82ec-4de8cb130ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:44:57.875815 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7bc53-60db-4990-82ec-4de8cb130ba6 None admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:44:57.876460 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c7bc53-60db-4990-82ec-4de8cb130ba6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:44:57.877910 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c7bc53-60db-4990-82ec-4de8cb130ba6 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:44:57.905525 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 573/1173] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Sep 7 15:44:57 2022] POST /identity/v3/projects => generated 361 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:45:00.064849 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f5dca-aed0-4b51-a99d-f2960fe074c4 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:45:00.065300 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f5dca-aed0-4b51-a99d-f2960fe074c4 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:45:00.065399 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f5dca-aed0-4b51-a99d-f2960fe074c4 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:45:00.066747 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 601/1174] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:45:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:45:00.071823 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f2558-f2d9-4843-b94c-949c2807871e None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:45:00.072240 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f2558-f2d9-4843-b94c-949c2807871e None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:45:00.072380 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f2558-f2d9-4843-b94c-949c2807871e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:45:00.090968 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-ca6f2558-f2d9-4843-b94c-949c2807871e None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:45:00.092180 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-ca6f2558-f2d9-4843-b94c-949c2807871e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:45:00.157285 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 574/1175] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:45:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:45:00.426351 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f5dca-aed0-4b51-a99d-f2960fe074c4 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:45:00.504147 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:45:00.525605 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f5dca-aed0-4b51-a99d-f2960fe074c4 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:45:00.558347 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae7de62-4d50-464f-9c72-65eb0e7641d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:45:00.558967 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7de62-4d50-464f-9c72-65eb0e7641d0 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:45:00.559245 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7de62-4d50-464f-9c72-65eb0e7641d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:45:00.559519 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7de62-4d50-464f-9c72-65eb0e7641d0 None admin] PATH_INFO: `/v3/domains/e871b9a765c64d609b2ca6986c7f5ed5` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:45:00.560617 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae7de62-4d50-464f-9c72-65eb0e7641d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=e871b9a765c64d609b2ca6986c7f5ed5)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:45:00.562033 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae7de62-4d50-464f-9c72-65eb0e7641d0 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:45:00.563595 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 602/1176] 10.222.0.16 () {56 vars in 1183 bytes} [Wed Sep 7 15:45:00 2022] GET /identity/v3/domains/e871b9a765c64d609b2ca6986c7f5ed5 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:45:00.569224 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f2558-f2d9-4843-b94c-949c2807871e None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:45:00.592738 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:45:00.665585 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f2558-f2d9-4843-b94c-949c2807871e None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:45:00.698507 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ddea93-24ae-449d-9e32-7be935641a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:45:00.699088 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ddea93-24ae-449d-9e32-7be935641a55 None admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:45:00.699368 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ddea93-24ae-449d-9e32-7be935641a55 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:45:00.699640 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ddea93-24ae-449d-9e32-7be935641a55 None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:45:00.700269 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ddea93-24ae-449d-9e32-7be935641a55 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:45:00.701680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ddea93-24ae-449d-9e32-7be935641a55 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:45:00.722333 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 575/1177] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Sep 7 15:45:00 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:45:02.869275 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc973b9d-af45-4772-8589-fd53c2e532ff None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:45:02.870377 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc973b9d-af45-4772-8589-fd53c2e532ff None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:45:02.870575 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc973b9d-af45-4772-8589-fd53c2e532ff None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:45:02.872035 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 603/1178] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:45:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:45:02.877485 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa551d-27fe-4f5d-8092-84375427f3d5 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:45:02.877876 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa551d-27fe-4f5d-8092-84375427f3d5 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:45:02.878045 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa551d-27fe-4f5d-8092-84375427f3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:45:02.896909 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-67fa551d-27fe-4f5d-8092-84375427f3d5 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:45:02.898096 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-67fa551d-27fe-4f5d-8092-84375427f3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:45:02.964330 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 576/1179] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:45:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:45:03.230946 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc973b9d-af45-4772-8589-fd53c2e532ff None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:45:03.333599 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc973b9d-af45-4772-8589-fd53c2e532ff None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:45:03.367022 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962384c1-c1e3-4e23-aa11-9acd7ffe64f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:45:03.367640 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962384c1-c1e3-4e23-aa11-9acd7ffe64f8 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:45:03.367919 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962384c1-c1e3-4e23-aa11-9acd7ffe64f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:45:03.368189 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962384c1-c1e3-4e23-aa11-9acd7ffe64f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:45:03.380423 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962384c1-c1e3-4e23-aa11-9acd7ffe64f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:45:03.386007 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-962384c1-c1e3-4e23-aa11-9acd7ffe64f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:45:03.386007 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:45:03.386007 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:45:03.386007 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:45:03.386007 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:45:03.386007 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:45:03.386007 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:45:03.386007 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:45:03.386007 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:45:03.386007 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:45:03.386007 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:45:03.386007 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:45:03.386007 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:45:03.386007 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:45:03.386007 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:45:03.386007 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:45:03.387213 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:45:03.387213 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:45:03.387213 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:45:03.387213 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:45:03.387213 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:45:03.387213 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:45:03.387213 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:45:03.387213 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:45:03.387213 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:45:03.387213 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:45:03.387213 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:45:03.387213 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:45:03.387213 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:45:03.387213 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:45:03.387213 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:45:03.387213 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:45:03.388305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:45:03.388305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:45:03.388305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:45:03.388305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:45:03.388305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:45:03.388305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:45:03.388305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:45:03.388305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:45:03.388305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:45:03.388305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:45:03.388305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:45:03.388305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:45:03.388305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 604/1180] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 7 15:45:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:45:03.393217 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa551d-27fe-4f5d-8092-84375427f3d5 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:45:03.405286 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:45:03.493540 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa551d-27fe-4f5d-8092-84375427f3d5 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:45:03.526992 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223befc-c943-4ed2-9cdd-3a96249d7505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:45:03.527589 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223befc-c943-4ed2-9cdd-3a96249d7505 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:45:03.527867 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223befc-c943-4ed2-9cdd-3a96249d7505 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:45:03.528140 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223befc-c943-4ed2-9cdd-3a96249d7505 None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:45:03.528795 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223befc-c943-4ed2-9cdd-3a96249d7505 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:45:03.529094 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223befc-c943-4ed2-9cdd-3a96249d7505 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:45:03.530479 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223befc-c943-4ed2-9cdd-3a96249d7505 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:45:03.538289 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 577/1181] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:45:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:45:03.545221 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962384c1-c1e3-4e23-aa11-9acd7ffe64f8 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:45:03.554436 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:45:03.643913 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962384c1-c1e3-4e23-aa11-9acd7ffe64f8 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:45:03.676941 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2aaf3-b6ca-4d8a-8791-c0ee540b8597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:45:03.677563 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2aaf3-b6ca-4d8a-8791-c0ee540b8597 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:45:03.677845 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2aaf3-b6ca-4d8a-8791-c0ee540b8597 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:45:03.678121 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2aaf3-b6ca-4d8a-8791-c0ee540b8597 None admin] PATH_INFO: `/v3/users/5a233ae8018c4fa184df485582cdece9` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:45:03.691026 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d2aaf3-b6ca-4d8a-8791-c0ee540b8597 None admin] RBAC: Authorizing `identity:get_user(user_id=5a233ae8018c4fa184df485582cdece9)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:45:03.692456 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d2aaf3-b6ca-4d8a-8791-c0ee540b8597 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:45:03.694019 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 605/1182] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 7 15:45:03 2022] GET /identity/v3/users/5a233ae8018c4fa184df485582cdece9 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:45:03.700254 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223befc-c943-4ed2-9cdd-3a96249d7505 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:45:03.768905 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:45:03.798643 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223befc-c943-4ed2-9cdd-3a96249d7505 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:45:03.835954 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e38319-b3b4-4900-b56c-7ea2fd0e4712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:45:03.836580 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e38319-b3b4-4900-b56c-7ea2fd0e4712 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:45:03.836864 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e38319-b3b4-4900-b56c-7ea2fd0e4712 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:45:03.837141 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e38319-b3b4-4900-b56c-7ea2fd0e4712 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:45:03.904858 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e38319-b3b4-4900-b56c-7ea2fd0e4712 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:45:03.906348 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e38319-b3b4-4900-b56c-7ea2fd0e4712 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:45:03.972417 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:45:04.002130 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 578/1183] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:45:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 15:45:04.008212 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2aaf3-b6ca-4d8a-8791-c0ee540b8597 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:45:04.070051 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:45:04.107232 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2aaf3-b6ca-4d8a-8791-c0ee540b8597 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:45:04.140593 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a6a40-7861-4b3a-b231-838c086413a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:45:04.141208 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a6a40-7861-4b3a-b231-838c086413a3 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:45:04.141484 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a6a40-7861-4b3a-b231-838c086413a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:45:04.141753 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a6a40-7861-4b3a-b231-838c086413a3 None admin] PATH_INFO: `/v3/projects/cb0f9a1c23b844e8b279dad20172d239` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:45:04.142853 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8a6a40-7861-4b3a-b231-838c086413a3 None admin] RBAC: Authorizing `identity:get_project(project_id=cb0f9a1c23b844e8b279dad20172d239)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:45:04.144272 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8a6a40-7861-4b3a-b231-838c086413a3 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:45:04.145843 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 606/1184] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 7 15:45:04 2022] GET /identity/v3/projects/cb0f9a1c23b844e8b279dad20172d239 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:45:04.152494 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e38319-b3b4-4900-b56c-7ea2fd0e4712 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:45:04.247067 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e38319-b3b4-4900-b56c-7ea2fd0e4712 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:45:04.280366 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ff894-7acd-4002-89b0-86af794bc55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:45:04.280953 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ff894-7acd-4002-89b0-86af794bc55b None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:45:04.281233 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ff894-7acd-4002-89b0-86af794bc55b None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:45:04.281506 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ff894-7acd-4002-89b0-86af794bc55b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:45:04.282237 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847ff894-7acd-4002-89b0-86af794bc55b None admin] RBAC: Adding query filter params (role.id=61605ebf17e643258730e55bf6db15ad, scope.project.id=cb0f9a1c23b844e8b279dad20172d239, user.id=5a233ae8018c4fa184df485582cdece9) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:45:04.282547 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847ff894-7acd-4002-89b0-86af794bc55b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:45:04.283957 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847ff894-7acd-4002-89b0-86af794bc55b None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:45:04.289186 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 579/1185] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 7 15:45:04 2022] GET /identity/v3/role_assignments?user.id=5a233ae8018c4fa184df485582cdece9&scope.project.id=cb0f9a1c23b844e8b279dad20172d239&role.id=61605ebf17e643258730e55bf6db15ad => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:45:06.385674 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8b04c-32bf-4ca6-b977-2f0a9cabbb51 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:45:06.386211 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8b04c-32bf-4ca6-b977-2f0a9cabbb51 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:45:06.386455 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8b04c-32bf-4ca6-b977-2f0a9cabbb51 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:45:06.387793 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 607/1186] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:45:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:45:06.392858 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4688aa-e900-41c9-854d-92f8b3bd0e57 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:45:06.393258 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4688aa-e900-41c9-854d-92f8b3bd0e57 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:45:06.393418 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4688aa-e900-41c9-854d-92f8b3bd0e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:45:06.411970 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-1f4688aa-e900-41c9-854d-92f8b3bd0e57 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:45:06.413142 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-1f4688aa-e900-41c9-854d-92f8b3bd0e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:45:06.441355 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:45:06.479604 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 580/1187] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:45:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:45:06.747506 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8b04c-32bf-4ca6-b977-2f0a9cabbb51 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:45:06.849957 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8b04c-32bf-4ca6-b977-2f0a9cabbb51 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:45:06.879692 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:45:06.884889 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d069ae-f2c0-4baa-a0d3-2c7b317b6153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:45:06.886418 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d069ae-f2c0-4baa-a0d3-2c7b317b6153 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:45:06.886701 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d069ae-f2c0-4baa-a0d3-2c7b317b6153 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:45:06.886980 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d069ae-f2c0-4baa-a0d3-2c7b317b6153 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:45:06.896882 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d069ae-f2c0-4baa-a0d3-2c7b317b6153 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:45:06.902047 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-c8d069ae-f2c0-4baa-a0d3-2c7b317b6153 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:45:06.902047 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:45:06.902047 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:45:06.902047 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:45:06.902047 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:45:06.902047 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:45:06.902047 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:45:06.902047 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:45:06.902047 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:45:06.902047 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:45:06.902047 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:45:06.902047 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:45:06.902047 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:45:06.902047 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:45:06.902047 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:45:06.902047 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:45:06.903153 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:45:06.903153 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:45:06.903153 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:45:06.903153 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:45:06.903153 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:45:06.903153 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:45:06.903153 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:45:06.903153 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:45:06.903153 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:45:06.903153 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:45:06.903153 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:45:06.903153 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:45:06.903153 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:45:06.903153 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:45:06.903153 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:45:06.903153 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:45:06.904362 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:45:06.904362 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:45:06.904362 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:45:06.904362 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:45:06.904362 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:45:06.904362 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:45:06.904362 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:45:06.904362 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:45:06.904362 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:45:06.904362 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:45:06.904362 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:45:06.904362 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:45:06.904362 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 608/1188] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 7 15:45:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:45:06.909265 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4688aa-e900-41c9-854d-92f8b3bd0e57 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:45:07.005846 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4688aa-e900-41c9-854d-92f8b3bd0e57 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:45:07.040118 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6683d-5505-4cff-b99a-f5b301f2ea5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:45:07.040732 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6683d-5505-4cff-b99a-f5b301f2ea5e None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:45:07.041017 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6683d-5505-4cff-b99a-f5b301f2ea5e None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:45:07.041802 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6683d-5505-4cff-b99a-f5b301f2ea5e None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:45:07.042763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba6683d-5505-4cff-b99a-f5b301f2ea5e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:45:07.043072 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba6683d-5505-4cff-b99a-f5b301f2ea5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:45:07.044449 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba6683d-5505-4cff-b99a-f5b301f2ea5e None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:45:07.052568 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 581/1189] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:45:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:45:07.059506 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d069ae-f2c0-4baa-a0d3-2c7b317b6153 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:45:07.156612 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d069ae-f2c0-4baa-a0d3-2c7b317b6153 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:45:07.190375 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e47a1-66aa-44e8-be14-9070cd15621a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:45:07.190991 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e47a1-66aa-44e8-be14-9070cd15621a None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:45:07.191268 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e47a1-66aa-44e8-be14-9070cd15621a None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:45:07.191538 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e47a1-66aa-44e8-be14-9070cd15621a None admin] PATH_INFO: `/v3/users/5a233ae8018c4fa184df485582cdece9` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:45:07.192637 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e47a1-66aa-44e8-be14-9070cd15621a None admin] RBAC: Authorizing `identity:get_user(user_id=5a233ae8018c4fa184df485582cdece9)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:45:07.194064 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e47a1-66aa-44e8-be14-9070cd15621a None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:45:07.195634 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 609/1190] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 7 15:45:07 2022] GET /identity/v3/users/5a233ae8018c4fa184df485582cdece9 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:45:07.201469 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6683d-5505-4cff-b99a-f5b301f2ea5e None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:45:07.229695 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:45:07.298463 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6683d-5505-4cff-b99a-f5b301f2ea5e None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:45:07.330368 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afeaa56-61a9-4cf8-8e7a-f74a54076a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:45:07.330981 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afeaa56-61a9-4cf8-8e7a-f74a54076a23 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:45:07.331260 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afeaa56-61a9-4cf8-8e7a-f74a54076a23 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:45:07.331531 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afeaa56-61a9-4cf8-8e7a-f74a54076a23 None admin] PATH_INFO: `/v3/projects/cb0f9a1c23b844e8b279dad20172d239` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:45:07.332615 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afeaa56-61a9-4cf8-8e7a-f74a54076a23 None admin] RBAC: Authorizing `identity:get_project(project_id=cb0f9a1c23b844e8b279dad20172d239)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:45:07.334032 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afeaa56-61a9-4cf8-8e7a-f74a54076a23 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:45:07.335644 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 582/1191] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 7 15:45:07 2022] GET /identity/v3/projects/cb0f9a1c23b844e8b279dad20172d239 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:45:07.341796 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e47a1-66aa-44e8-be14-9070cd15621a None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:45:07.401295 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:45:07.449097 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e47a1-66aa-44e8-be14-9070cd15621a None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:45:07.491116 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc7c2c-66ce-49a8-bd3f-71f6baeb43e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:45:07.491759 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc7c2c-66ce-49a8-bd3f-71f6baeb43e3 None admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:45:07.492045 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc7c2c-66ce-49a8-bd3f-71f6baeb43e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:45:07.492320 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc7c2c-66ce-49a8-bd3f-71f6baeb43e3 None admin] PATH_INFO: `/v3/projects/cb0f9a1c23b844e8b279dad20172d239/users/5a233ae8018c4fa184df485582cdece9/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:45:07.494238 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc7c2c-66ce-49a8-bd3f-71f6baeb43e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=cb0f9a1c23b844e8b279dad20172d239, user_id=5a233ae8018c4fa184df485582cdece9, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:45:07.495659 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc7c2c-66ce-49a8-bd3f-71f6baeb43e3 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:45:07.508058 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 610/1192] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 7 15:45:07 2022] PUT /identity/v3/projects/cb0f9a1c23b844e8b279dad20172d239/users/5a233ae8018c4fa184df485582cdece9/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:45:09.634876 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1c4aa-9bc3-4d32-9af8-0db5e0bbe942 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:45:09.635471 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1c4aa-9bc3-4d32-9af8-0db5e0bbe942 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:45:09.635471 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1c4aa-9bc3-4d32-9af8-0db5e0bbe942 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:45:09.636766 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 583/1193] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:45:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:45:09.642042 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216ed72-0717-48cc-8bc1-67a49ce4ba99 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:45:09.642493 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216ed72-0717-48cc-8bc1-67a49ce4ba99 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:45:09.642626 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216ed72-0717-48cc-8bc1-67a49ce4ba99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:45:09.660972 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-8216ed72-0717-48cc-8bc1-67a49ce4ba99 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:45:09.662145 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-8216ed72-0717-48cc-8bc1-67a49ce4ba99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:45:09.726304 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 611/1194] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:45:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:45:09.999969 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab1c4aa-9bc3-4d32-9af8-0db5e0bbe942 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:45:10.124817 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:45:10.134066 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab1c4aa-9bc3-4d32-9af8-0db5e0bbe942 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:45:10.171909 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb863b-5c0e-4fd3-9d8a-ed00459c764c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:45:10.172531 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb863b-5c0e-4fd3-9d8a-ed00459c764c None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:45:10.172813 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb863b-5c0e-4fd3-9d8a-ed00459c764c None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:45:10.173089 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb863b-5c0e-4fd3-9d8a-ed00459c764c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:45:10.183493 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbb863b-5c0e-4fd3-9d8a-ed00459c764c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:45:10.188909 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-cbbb863b-5c0e-4fd3-9d8a-ed00459c764c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:45:10.188909 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:45:10.188909 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:45:10.188909 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:45:10.188909 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:45:10.188909 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:45:10.188909 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:45:10.188909 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:45:10.188909 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:45:10.188909 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:45:10.188909 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:45:10.188909 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:45:10.188909 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:45:10.188909 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:45:10.188909 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:45:10.188909 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:45:10.190022 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:45:10.190022 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:45:10.190022 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:45:10.190022 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:45:10.190022 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:45:10.190022 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:45:10.190022 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:45:10.190022 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:45:10.190022 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:45:10.190022 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:45:10.190022 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:45:10.190022 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:45:10.190022 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:45:10.190022 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:45:10.190022 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:45:10.190022 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:45:10.191187 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:45:10.191187 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:45:10.191187 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:45:10.191187 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:45:10.191187 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:45:10.191187 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:45:10.191187 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:45:10.191187 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:45:10.191187 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:45:10.191187 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:45:10.191187 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:45:10.191187 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:45:10.191187 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 584/1195] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 7 15:45:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:45:10.197039 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216ed72-0717-48cc-8bc1-67a49ce4ba99 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:45:10.256693 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:45:10.314201 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216ed72-0717-48cc-8bc1-67a49ce4ba99 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:45:10.350118 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56972f47-ed13-4c65-8adb-1294ea2a84e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:45:10.350769 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56972f47-ed13-4c65-8adb-1294ea2a84e6 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:45:10.351186 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56972f47-ed13-4c65-8adb-1294ea2a84e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:45:10.351681 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56972f47-ed13-4c65-8adb-1294ea2a84e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:45:10.352730 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56972f47-ed13-4c65-8adb-1294ea2a84e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:45:10.353042 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56972f47-ed13-4c65-8adb-1294ea2a84e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:45:10.355214 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56972f47-ed13-4c65-8adb-1294ea2a84e6 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:45:10.363675 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 612/1196] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:45:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:45:10.370628 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb863b-5c0e-4fd3-9d8a-ed00459c764c None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:45:10.483550 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb863b-5c0e-4fd3-9d8a-ed00459c764c None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:45:10.521661 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41307e25-0e67-4f69-a802-14889a187b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:45:10.522292 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41307e25-0e67-4f69-a802-14889a187b61 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:45:10.522768 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41307e25-0e67-4f69-a802-14889a187b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:45:10.523271 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41307e25-0e67-4f69-a802-14889a187b61 None admin] PATH_INFO: `/v3/users/5a233ae8018c4fa184df485582cdece9` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:45:10.524858 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41307e25-0e67-4f69-a802-14889a187b61 None admin] RBAC: Authorizing `identity:get_user(user_id=5a233ae8018c4fa184df485582cdece9)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:45:10.527489 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41307e25-0e67-4f69-a802-14889a187b61 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:45:10.529653 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 585/1197] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Sep 7 15:45:10 2022] GET /identity/v3/users/5a233ae8018c4fa184df485582cdece9 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:45:10.535623 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56972f47-ed13-4c65-8adb-1294ea2a84e6 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:45:10.642197 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56972f47-ed13-4c65-8adb-1294ea2a84e6 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:45:10.655606 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:45:10.678512 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6fbea1-d507-444b-83ef-dd8b5ac4d63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:45:10.679122 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6fbea1-d507-444b-83ef-dd8b5ac4d63f None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:45:10.679403 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6fbea1-d507-444b-83ef-dd8b5ac4d63f None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:45:10.679678 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6fbea1-d507-444b-83ef-dd8b5ac4d63f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:45:10.752158 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6fbea1-d507-444b-83ef-dd8b5ac4d63f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:45:10.753616 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6fbea1-d507-444b-83ef-dd8b5ac4d63f None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:45:10.858130 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 613/1198] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:45:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 15:45:10.864271 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41307e25-0e67-4f69-a802-14889a187b61 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:45:10.890650 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:45:10.976248 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41307e25-0e67-4f69-a802-14889a187b61 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:45:11.010270 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4958f1f-8fb8-4f08-b5ad-d988f8812c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:45:11.010883 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4958f1f-8fb8-4f08-b5ad-d988f8812c35 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:45:11.011162 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4958f1f-8fb8-4f08-b5ad-d988f8812c35 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:45:11.011430 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4958f1f-8fb8-4f08-b5ad-d988f8812c35 None admin] PATH_INFO: `/v3/projects/cb0f9a1c23b844e8b279dad20172d239` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:45:11.012530 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4958f1f-8fb8-4f08-b5ad-d988f8812c35 None admin] RBAC: Authorizing `identity:get_project(project_id=cb0f9a1c23b844e8b279dad20172d239)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:45:11.013945 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4958f1f-8fb8-4f08-b5ad-d988f8812c35 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:45:11.015576 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 586/1199] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Sep 7 15:45:10 2022] GET /identity/v3/projects/cb0f9a1c23b844e8b279dad20172d239 => generated 361 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:45:11.021692 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6fbea1-d507-444b-83ef-dd8b5ac4d63f None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:45:11.037858 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:45:11.123232 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6fbea1-d507-444b-83ef-dd8b5ac4d63f None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:45:11.156777 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0934ba8-5b27-4365-aa3d-6988c75da88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:45:11.157376 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0934ba8-5b27-4365-aa3d-6988c75da88d None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:45:11.157655 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0934ba8-5b27-4365-aa3d-6988c75da88d None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:45:11.157926 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0934ba8-5b27-4365-aa3d-6988c75da88d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:45:11.158875 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0934ba8-5b27-4365-aa3d-6988c75da88d None admin] RBAC: Adding query filter params (role.id=61605ebf17e643258730e55bf6db15ad, scope.project.id=cb0f9a1c23b844e8b279dad20172d239, user.id=5a233ae8018c4fa184df485582cdece9) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:45:11.159183 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0934ba8-5b27-4365-aa3d-6988c75da88d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:45:11.160624 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0934ba8-5b27-4365-aa3d-6988c75da88d None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:45:11.167542 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 614/1200] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 7 15:45:11 2022] GET /identity/v3/role_assignments?user.id=5a233ae8018c4fa184df485582cdece9&scope.project.id=cb0f9a1c23b844e8b279dad20172d239&role.id=61605ebf17e643258730e55bf6db15ad => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:45:21.006111 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=54 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:45:21.164011 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=62 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:06.834246 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43442272-d507-4c55-a132-aac3951e14da None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:06.834246 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43442272-d507-4c55-a132-aac3951e14da None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:06.834246 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43442272-d507-4c55-a132-aac3951e14da None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:06.835414 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 587/1201] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:46:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:46:06.841771 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97446b81-0631-4391-ab12-83962d5345aa None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:06.842379 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97446b81-0631-4391-ab12-83962d5345aa None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:06.842379 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97446b81-0631-4391-ab12-83962d5345aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:06.865474 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-97446b81-0631-4391-ab12-83962d5345aa None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:46:06.866702 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-97446b81-0631-4391-ab12-83962d5345aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:46:06.978399 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 615/1202] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:46:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:46:07.258870 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43442272-d507-4c55-a132-aac3951e14da None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:07.405781 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43442272-d507-4c55-a132-aac3951e14da None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:07.451673 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5440bd-396d-42ef-a4f8-ba89ac28c8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:07.452344 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5440bd-396d-42ef-a4f8-ba89ac28c8ec None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:07.452681 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5440bd-396d-42ef-a4f8-ba89ac28c8ec None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:07.452992 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5440bd-396d-42ef-a4f8-ba89ac28c8ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:07.466310 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5440bd-396d-42ef-a4f8-ba89ac28c8ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:07.467758 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5440bd-396d-42ef-a4f8-ba89ac28c8ec None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:07.486469 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-db5440bd-396d-42ef-a4f8-ba89ac28c8ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:46:07.486469 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:46:07.486469 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:46:07.486469 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:46:07.486469 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:46:07.486469 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:46:07.486469 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:46:07.486469 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:46:07.486469 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:46:07.486469 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:46:07.486469 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:46:07.486469 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:46:07.486469 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:46:07.486469 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:46:07.486469 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:46:07.486469 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:46:07.488009 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:46:07.488009 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:46:07.488009 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:46:07.488009 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:46:07.488009 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:46:07.488009 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:46:07.488009 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:46:07.488009 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:46:07.488009 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:46:07.488009 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:46:07.488009 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:46:07.488009 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:46:07.488009 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:46:07.488009 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:46:07.488009 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:46:07.488009 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:46:07.488009 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:46:07.489313 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:46:07.489313 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:46:07.489313 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:46:07.495871 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 588/1203] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:46:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:46:07.496032 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97446b81-0631-4391-ab12-83962d5345aa None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:07.628226 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97446b81-0631-4391-ab12-83962d5345aa None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:07.662020 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:07.670280 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17585afe-513a-42ac-bb03-cc0db46425d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:07.670953 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17585afe-513a-42ac-bb03-cc0db46425d0 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:07.671389 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17585afe-513a-42ac-bb03-cc0db46425d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:07.671745 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17585afe-513a-42ac-bb03-cc0db46425d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:07.672531 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17585afe-513a-42ac-bb03-cc0db46425d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:46:07.672950 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17585afe-513a-42ac-bb03-cc0db46425d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:07.674945 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17585afe-513a-42ac-bb03-cc0db46425d0 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:07.689327 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 616/1204] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:46:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:46:07.695080 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5440bd-396d-42ef-a4f8-ba89ac28c8ec None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:07.767971 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:07.828983 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5440bd-396d-42ef-a4f8-ba89ac28c8ec None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:07.875048 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd3df6-ed28-497b-82d7-c62e2207ded7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:07.875815 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd3df6-ed28-497b-82d7-c62e2207ded7 None admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:07.875934 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd3df6-ed28-497b-82d7-c62e2207ded7 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:07.876232 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd3df6-ed28-497b-82d7-c62e2207ded7 None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:07.876864 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bd3df6-ed28-497b-82d7-c62e2207ded7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:07.878416 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bd3df6-ed28-497b-82d7-c62e2207ded7 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:07.905747 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 589/1205] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Sep 7 15:46:07 2022] POST /identity/v3/users => generated 251 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:46:10.222229 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d8221-e954-4d0c-b713-f9af67390545 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:10.222779 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d8221-e954-4d0c-b713-f9af67390545 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:10.222893 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d8221-e954-4d0c-b713-f9af67390545 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:10.224284 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 617/1206] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:46:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:46:10.230525 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff97fa-fde7-4226-be73-e89e7d6d4e5c None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:10.230976 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff97fa-fde7-4226-be73-e89e7d6d4e5c None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:10.231081 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff97fa-fde7-4226-be73-e89e7d6d4e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:10.253651 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-54ff97fa-fde7-4226-be73-e89e7d6d4e5c None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:46:10.254893 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-54ff97fa-fde7-4226-be73-e89e7d6d4e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:46:10.342257 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 590/1207] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:46:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:46:10.607945 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d8221-e954-4d0c-b713-f9af67390545 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:10.728633 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d8221-e954-4d0c-b713-f9af67390545 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:10.772099 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9001039b-2f27-418a-8fec-d7a7bc03f212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:10.773692 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001039b-2f27-418a-8fec-d7a7bc03f212 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:10.775047 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001039b-2f27-418a-8fec-d7a7bc03f212 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:10.775047 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001039b-2f27-418a-8fec-d7a7bc03f212 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:10.787314 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9001039b-2f27-418a-8fec-d7a7bc03f212 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:46:10.793202 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-9001039b-2f27-418a-8fec-d7a7bc03f212 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:46:10.793202 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:46:10.793202 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:46:10.793202 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:46:10.793202 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:46:10.793202 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:46:10.793202 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:46:10.793202 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:46:10.793202 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:46:10.793202 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:46:10.793202 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:46:10.793202 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:46:10.793202 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:46:10.793202 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:46:10.793202 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:46:10.793202 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:46:10.794520 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:46:10.794520 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:46:10.794520 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:46:10.794520 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:46:10.794520 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:46:10.794520 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:46:10.794520 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:46:10.794520 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:46:10.794520 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:46:10.794520 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:46:10.794520 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:46:10.794520 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:46:10.794520 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:46:10.794520 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:46:10.794520 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:46:10.794520 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:46:10.795503 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:46:10.795503 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:46:10.795503 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:46:10.795503 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:46:10.795503 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:46:10.795503 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:46:10.795503 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:46:10.795503 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:46:10.795503 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:46:10.795503 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:46:10.795503 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:46:10.795503 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:46:10.795503 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 618/1208] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 7 15:46:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:46:10.800746 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff97fa-fde7-4226-be73-e89e7d6d4e5c None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:10.849578 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:10.913962 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff97fa-fde7-4226-be73-e89e7d6d4e5c None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:10.952493 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e5d491-bea6-4465-95d7-4c212b2f42eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:10.953144 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5d491-bea6-4465-95d7-4c212b2f42eb None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:10.953428 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5d491-bea6-4465-95d7-4c212b2f42eb None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:10.953771 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5d491-bea6-4465-95d7-4c212b2f42eb None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:10.954580 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e5d491-bea6-4465-95d7-4c212b2f42eb None admin] RBAC: Adding query filter params (name=service) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:46:10.954888 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e5d491-bea6-4465-95d7-4c212b2f42eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:10.956960 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e5d491-bea6-4465-95d7-4c212b2f42eb None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:10.969454 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 591/1209] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 7 15:46:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:46:10.975517 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9001039b-2f27-418a-8fec-d7a7bc03f212 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:11.042757 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:11.102689 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9001039b-2f27-418a-8fec-d7a7bc03f212 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:11.148150 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27566e12-0fb8-4b30-b15e-72861fa842f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:11.149526 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27566e12-0fb8-4b30-b15e-72861fa842f8 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:11.149863 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27566e12-0fb8-4b30-b15e-72861fa842f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:11.150231 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27566e12-0fb8-4b30-b15e-72861fa842f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:11.162905 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27566e12-0fb8-4b30-b15e-72861fa842f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:11.166044 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27566e12-0fb8-4b30-b15e-72861fa842f8 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:11.182791 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-27566e12-0fb8-4b30-b15e-72861fa842f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:46:11.182791 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:46:11.182791 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:46:11.182791 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:46:11.182791 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:46:11.182791 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:46:11.182791 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:46:11.182791 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:46:11.182791 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:46:11.182791 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:46:11.182791 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:46:11.182791 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:46:11.182791 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:46:11.182791 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:46:11.182791 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:46:11.182791 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:46:11.183828 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:46:11.183828 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:46:11.183828 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:46:11.183828 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:46:11.183828 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:46:11.183828 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:46:11.183828 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:46:11.183828 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:46:11.183828 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:46:11.183828 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:46:11.183828 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:46:11.183828 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:46:11.183828 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:46:11.183828 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:46:11.183828 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:46:11.183828 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:46:11.183828 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:46:11.184748 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:46:11.184748 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:46:11.184748 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:46:11.184748 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 619/1210] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:46:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:46:11.189830 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e5d491-bea6-4465-95d7-4c212b2f42eb None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:11.298871 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:11.301839 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e5d491-bea6-4465-95d7-4c212b2f42eb None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:11.342140 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7733e7-aa6d-4b24-abee-2f57d185d623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:11.342792 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7733e7-aa6d-4b24-abee-2f57d185d623 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:11.343088 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7733e7-aa6d-4b24-abee-2f57d185d623 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:11.343347 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7733e7-aa6d-4b24-abee-2f57d185d623 None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:11.343978 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7733e7-aa6d-4b24-abee-2f57d185d623 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:46:11.344280 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7733e7-aa6d-4b24-abee-2f57d185d623 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:11.345638 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7733e7-aa6d-4b24-abee-2f57d185d623 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:11.358239 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 592/1211] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:46:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:46:11.364261 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27566e12-0fb8-4b30-b15e-72861fa842f8 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:11.475060 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27566e12-0fb8-4b30-b15e-72861fa842f8 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:11.476724 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:11.513241 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80903a56-0196-4a10-b20c-a9e3e69e22d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:11.514298 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80903a56-0196-4a10-b20c-a9e3e69e22d6 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:11.514779 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80903a56-0196-4a10-b20c-a9e3e69e22d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:11.515265 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80903a56-0196-4a10-b20c-a9e3e69e22d6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:11.523652 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80903a56-0196-4a10-b20c-a9e3e69e22d6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:11.525904 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80903a56-0196-4a10-b20c-a9e3e69e22d6 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:11.538895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-80903a56-0196-4a10-b20c-a9e3e69e22d6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 07 15:46:11.538895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:46:11.538895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:46:11.538895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:46:11.538895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:46:11.538895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:46:11.538895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:46:11.538895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:46:11.538895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:46:11.538895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:46:11.538895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:46:11.538895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:46:11.538895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:46:11.538895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:46:11.538895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:46:11.538895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:46:11.540415 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:46:11.540415 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:46:11.540415 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:46:11.540415 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:46:11.540415 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:46:11.540415 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:46:11.540415 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:46:11.540415 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:46:11.540415 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:46:11.540415 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:46:11.540415 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:46:11.540415 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:46:11.540415 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:46:11.540415 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:46:11.540415 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:46:11.540415 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:46:11.540415 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:46:11.540415 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:46:11.541375 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:46:11.541375 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:46:11.541375 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:46:11.541375 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:46:11.541375 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:46:11.541375 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:46:11.541375 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:46:11.541375 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:46:11.541375 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 07 15:46:11.541375 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:46:11.543874 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 620/1212] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:46:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:46:11.549492 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7733e7-aa6d-4b24-abee-2f57d185d623 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:11.666416 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7733e7-aa6d-4b24-abee-2f57d185d623 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:11.706878 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8b0f7-1683-43ea-9078-c405d2876283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:11.707546 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8b0f7-1683-43ea-9078-c405d2876283 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:11.707866 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8b0f7-1683-43ea-9078-c405d2876283 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:11.708212 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8b0f7-1683-43ea-9078-c405d2876283 None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:11.709176 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a8b0f7-1683-43ea-9078-c405d2876283 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:46:11.709557 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a8b0f7-1683-43ea-9078-c405d2876283 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:11.711504 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a8b0f7-1683-43ea-9078-c405d2876283 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:11.737297 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 593/1213] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Sep 7 15:46:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:46:11.738437 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80903a56-0196-4a10-b20c-a9e3e69e22d6 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:11.854420 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80903a56-0196-4a10-b20c-a9e3e69e22d6 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:11.891071 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5629578-9cf7-4133-853b-1982304ae2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:11.891924 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5629578-9cf7-4133-853b-1982304ae2bf None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:11.892347 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5629578-9cf7-4133-853b-1982304ae2bf None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:11.892803 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5629578-9cf7-4133-853b-1982304ae2bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:11.935599 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:11.982928 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5629578-9cf7-4133-853b-1982304ae2bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:11.985199 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5629578-9cf7-4133-853b-1982304ae2bf None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:12.137901 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 621/1214] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:46:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 07 15:46:12.143903 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8b0f7-1683-43ea-9078-c405d2876283 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:12.165630 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:12.266688 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8b0f7-1683-43ea-9078-c405d2876283 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:12.305730 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0093a37-52ec-4a5e-9057-da844242cd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:12.306373 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0093a37-52ec-4a5e-9057-da844242cd7d None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:12.306603 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0093a37-52ec-4a5e-9057-da844242cd7d None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:12.306850 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0093a37-52ec-4a5e-9057-da844242cd7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:12.318328 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0093a37-52ec-4a5e-9057-da844242cd7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:12.319809 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0093a37-52ec-4a5e-9057-da844242cd7d None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:12.339551 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-f0093a37-52ec-4a5e-9057-da844242cd7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:46:12.339551 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:46:12.339551 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:46:12.339551 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:46:12.339551 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:46:12.339551 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:46:12.339551 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:46:12.339551 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:46:12.339551 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:46:12.339551 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:46:12.339551 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:46:12.339551 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:46:12.339551 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:46:12.339551 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:46:12.339551 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:46:12.339551 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:46:12.340566 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:46:12.340566 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:46:12.340566 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:46:12.340566 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:46:12.340566 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:46:12.340566 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:46:12.340566 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:46:12.340566 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:46:12.340566 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:46:12.340566 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:46:12.340566 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:46:12.340566 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:46:12.340566 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:46:12.340566 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:46:12.340566 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:46:12.340566 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:46:12.340566 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:46:12.341499 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:46:12.341499 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:46:12.341499 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:46:12.347469 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 594/1215] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:46:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:46:12.349338 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5629578-9cf7-4133-853b-1982304ae2bf None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:12.441052 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:12.496401 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5629578-9cf7-4133-853b-1982304ae2bf None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:12.540696 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8e753-71b7-4c98-a6fe-3445957d7307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:12.541397 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8e753-71b7-4c98-a6fe-3445957d7307 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:12.541683 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8e753-71b7-4c98-a6fe-3445957d7307 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:12.541955 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8e753-71b7-4c98-a6fe-3445957d7307 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:12.542644 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8e753-71b7-4c98-a6fe-3445957d7307 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:46:12.542949 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8e753-71b7-4c98-a6fe-3445957d7307 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:12.544345 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8e753-71b7-4c98-a6fe-3445957d7307 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:12.557739 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 622/1216] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:46:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:46:12.564051 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0093a37-52ec-4a5e-9057-da844242cd7d None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:12.661165 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:12.709479 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0093a37-52ec-4a5e-9057-da844242cd7d None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:12.763876 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a3fee-a361-465d-89d2-715159b31b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:12.764756 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a3fee-a361-465d-89d2-715159b31b9a None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:12.765112 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a3fee-a361-465d-89d2-715159b31b9a None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:12.765507 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a3fee-a361-465d-89d2-715159b31b9a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:12.773375 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6a3fee-a361-465d-89d2-715159b31b9a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:12.777068 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6a3fee-a361-465d-89d2-715159b31b9a None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:12.798871 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-cc6a3fee-a361-465d-89d2-715159b31b9a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:46:12.798871 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:46:12.798871 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:46:12.798871 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:46:12.798871 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:46:12.798871 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:46:12.798871 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:46:12.798871 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:46:12.798871 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:46:12.798871 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:46:12.798871 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:46:12.798871 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:46:12.798871 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:46:12.798871 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:46:12.798871 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:46:12.800249 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:46:12.800249 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:46:12.800249 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:46:12.800249 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:46:12.800249 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:46:12.800249 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:46:12.800249 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:46:12.800249 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:46:12.800249 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:46:12.800249 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:46:12.800249 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:46:12.800249 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:46:12.800249 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:46:12.800249 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:46:12.800249 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:46:12.800249 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:46:12.800249 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:46:12.801158 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:46:12.801158 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:46:12.801158 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:46:12.801158 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:46:12.801158 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:46:12.801158 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:46:12.801158 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:46:12.801158 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:46:12.801158 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 595/1217] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:46:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:46:12.808853 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8e753-71b7-4c98-a6fe-3445957d7307 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:12.951279 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8e753-71b7-4c98-a6fe-3445957d7307 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:12.981329 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:12.999978 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eea134-e487-4b62-9444-c43d907a75d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:13.000623 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eea134-e487-4b62-9444-c43d907a75d4 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:13.000901 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eea134-e487-4b62-9444-c43d907a75d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:13.001170 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eea134-e487-4b62-9444-c43d907a75d4 None admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:13.002439 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eea134-e487-4b62-9444-c43d907a75d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:46:13.002976 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eea134-e487-4b62-9444-c43d907a75d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:13.005502 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eea134-e487-4b62-9444-c43d907a75d4 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:13.022884 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 623/1218] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 7 15:46:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:46:13.031460 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a3fee-a361-465d-89d2-715159b31b9a None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:13.157331 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a3fee-a361-465d-89d2-715159b31b9a None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:13.191279 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:13.196192 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea1f03-6824-4956-9753-5f7e69a04de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:13.197012 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea1f03-6824-4956-9753-5f7e69a04de3 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:13.197358 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea1f03-6824-4956-9753-5f7e69a04de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:13.197633 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea1f03-6824-4956-9753-5f7e69a04de3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:13.198388 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea1f03-6824-4956-9753-5f7e69a04de3 None admin] RBAC: Adding query filter params (role.id=a420b17212b94988beb75affe974355b, scope.project.id=488830167943488f85743236584113d7, user.id=66c270b488024605af84e52d874474e9) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:46:13.198696 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea1f03-6824-4956-9753-5f7e69a04de3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:13.200123 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea1f03-6824-4956-9753-5f7e69a04de3 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:13.218656 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 596/1219] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 7 15:46:13 2022] GET /identity/v3/role_assignments?user.id=66c270b488024605af84e52d874474e9&scope.project.id=488830167943488f85743236584113d7&role.id=a420b17212b94988beb75affe974355b => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:46:15.461748 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427453c-f8ed-4b92-8c41-44cfb94fc063 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:15.462427 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427453c-f8ed-4b92-8c41-44cfb94fc063 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:15.462533 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427453c-f8ed-4b92-8c41-44cfb94fc063 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:15.464053 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 624/1220] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:46:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:46:15.470556 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235cebe7-d3ef-45c7-a6fa-93fe72a60da2 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:15.470998 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235cebe7-d3ef-45c7-a6fa-93fe72a60da2 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:15.471252 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235cebe7-d3ef-45c7-a6fa-93fe72a60da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:15.493348 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-235cebe7-d3ef-45c7-a6fa-93fe72a60da2 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:46:15.494753 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-235cebe7-d3ef-45c7-a6fa-93fe72a60da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:46:15.573502 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 597/1221] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:46:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:46:15.856057 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1427453c-f8ed-4b92-8c41-44cfb94fc063 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:15.970783 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1427453c-f8ed-4b92-8c41-44cfb94fc063 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:16.008971 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a5a6ef-2088-41ee-bd00-b81bd5da8ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:16.009599 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5a6ef-2088-41ee-bd00-b81bd5da8ff6 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:16.009886 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5a6ef-2088-41ee-bd00-b81bd5da8ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:16.010138 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5a6ef-2088-41ee-bd00-b81bd5da8ff6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:16.021383 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a5a6ef-2088-41ee-bd00-b81bd5da8ff6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:46:16.027518 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-92a5a6ef-2088-41ee-bd00-b81bd5da8ff6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:46:16.027518 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:46:16.027518 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:46:16.027518 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:46:16.027518 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:46:16.027518 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:46:16.027518 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:46:16.027518 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:46:16.027518 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:46:16.027518 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:46:16.027518 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:46:16.027518 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:46:16.027518 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:46:16.027518 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:46:16.027518 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:46:16.027518 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:46:16.028727 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:46:16.028727 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:46:16.028727 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:46:16.028727 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:46:16.028727 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:46:16.028727 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:46:16.028727 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:46:16.028727 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:46:16.028727 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:46:16.028727 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:46:16.028727 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:46:16.028727 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:46:16.028727 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:46:16.028727 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:46:16.028727 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:46:16.028727 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:46:16.029748 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:46:16.029748 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:46:16.029748 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:46:16.029748 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:46:16.029748 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:46:16.029748 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:46:16.029748 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:46:16.029748 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:46:16.029748 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:46:16.029748 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:46:16.029748 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:46:16.029748 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:46:16.029748 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 625/1222] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 7 15:46:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:46:16.034922 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235cebe7-d3ef-45c7-a6fa-93fe72a60da2 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:16.144872 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235cebe7-d3ef-45c7-a6fa-93fe72a60da2 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:16.169201 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:16.181029 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e42008-1ff9-4506-8247-3c938350b82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:16.181638 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e42008-1ff9-4506-8247-3c938350b82d None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:16.181922 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e42008-1ff9-4506-8247-3c938350b82d None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:16.182227 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e42008-1ff9-4506-8247-3c938350b82d None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:16.182898 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e42008-1ff9-4506-8247-3c938350b82d None admin] RBAC: Adding query filter params (name=service) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:46:16.183206 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e42008-1ff9-4506-8247-3c938350b82d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:16.184572 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e42008-1ff9-4506-8247-3c938350b82d None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:16.195402 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 598/1223] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 7 15:46:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:46:16.201285 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a5a6ef-2088-41ee-bd00-b81bd5da8ff6 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:16.248867 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:16.309831 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a5a6ef-2088-41ee-bd00-b81bd5da8ff6 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:16.346665 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59e55e-ab06-472c-aa98-d8c026fb7d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:16.347387 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59e55e-ab06-472c-aa98-d8c026fb7d57 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:16.347669 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59e55e-ab06-472c-aa98-d8c026fb7d57 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:16.347946 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59e55e-ab06-472c-aa98-d8c026fb7d57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:16.359405 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b59e55e-ab06-472c-aa98-d8c026fb7d57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:16.360921 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b59e55e-ab06-472c-aa98-d8c026fb7d57 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:16.380115 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-5b59e55e-ab06-472c-aa98-d8c026fb7d57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:46:16.380115 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:46:16.380115 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:46:16.380115 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:46:16.380115 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:46:16.380115 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:46:16.380115 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:46:16.380115 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:46:16.380115 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:46:16.380115 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:46:16.380115 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:46:16.380115 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:46:16.380115 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:46:16.380115 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:46:16.380115 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:46:16.380115 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:46:16.381156 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:46:16.381156 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:46:16.381156 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:46:16.381156 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:46:16.381156 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:46:16.381156 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:46:16.381156 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:46:16.381156 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:46:16.381156 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:46:16.381156 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:46:16.381156 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:46:16.381156 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:46:16.381156 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:46:16.381156 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:46:16.381156 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:46:16.381156 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:46:16.381156 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:46:16.382210 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:46:16.382210 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:46:16.382210 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:46:16.382210 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 626/1224] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:46:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:46:16.388357 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e42008-1ff9-4506-8247-3c938350b82d None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:16.507680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e42008-1ff9-4506-8247-3c938350b82d None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:16.542813 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c17bafc-7ab8-4aef-995d-ad4870e65f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:16.543394 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17bafc-7ab8-4aef-995d-ad4870e65f52 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:16.543673 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17bafc-7ab8-4aef-995d-ad4870e65f52 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:16.543953 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17bafc-7ab8-4aef-995d-ad4870e65f52 None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:16.544594 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c17bafc-7ab8-4aef-995d-ad4870e65f52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:46:16.544900 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c17bafc-7ab8-4aef-995d-ad4870e65f52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:16.546303 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c17bafc-7ab8-4aef-995d-ad4870e65f52 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:16.561963 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 599/1225] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:46:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:46:16.567551 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59e55e-ab06-472c-aa98-d8c026fb7d57 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:16.674910 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:16.682785 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59e55e-ab06-472c-aa98-d8c026fb7d57 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:16.720987 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8193ed0-1c43-45a2-9c57-0c539ace17ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:16.721673 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8193ed0-1c43-45a2-9c57-0c539ace17ba None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:16.722043 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8193ed0-1c43-45a2-9c57-0c539ace17ba None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:16.722348 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8193ed0-1c43-45a2-9c57-0c539ace17ba None admin] PATH_INFO: `/v3/users/placement` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:16.730984 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8193ed0-1c43-45a2-9c57-0c539ace17ba None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:16.732651 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8193ed0-1c43-45a2-9c57-0c539ace17ba None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:16.745191 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-b8193ed0-1c43-45a2-9c57-0c539ace17ba None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 07 15:46:16.745191 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:46:16.745191 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:46:16.745191 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:46:16.745191 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:46:16.745191 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:46:16.745191 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:46:16.745191 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:46:16.745191 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:46:16.745191 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:46:16.745191 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:46:16.745191 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:46:16.745191 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:46:16.745191 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:46:16.745191 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:46:16.745191 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:46:16.746375 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:46:16.746375 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:46:16.746375 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:46:16.746375 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:46:16.746375 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:46:16.746375 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:46:16.746375 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:46:16.746375 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:46:16.746375 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:46:16.746375 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:46:16.746375 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:46:16.746375 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:46:16.746375 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:46:16.746375 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:46:16.746375 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:46:16.746375 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:46:16.746375 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:46:16.746375 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:46:16.747333 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:46:16.747333 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:46:16.747333 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:46:16.747333 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:46:16.747333 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:46:16.747333 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:46:16.747333 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:46:16.747333 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:46:16.747333 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 07 15:46:16.747333 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:46:16.747333 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 627/1226] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:46:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:46:16.752301 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c17bafc-7ab8-4aef-995d-ad4870e65f52 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:16.809433 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:16.868405 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c17bafc-7ab8-4aef-995d-ad4870e65f52 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:16.905221 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951547f-b9b8-4d6f-899a-2c71e9f36a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:16.905838 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951547f-b9b8-4d6f-899a-2c71e9f36a5c None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:16.906119 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951547f-b9b8-4d6f-899a-2c71e9f36a5c None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:16.906423 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951547f-b9b8-4d6f-899a-2c71e9f36a5c None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:16.907150 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8951547f-b9b8-4d6f-899a-2c71e9f36a5c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:46:16.907454 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8951547f-b9b8-4d6f-899a-2c71e9f36a5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:16.908880 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8951547f-b9b8-4d6f-899a-2c71e9f36a5c None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:16.934229 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 600/1227] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Sep 7 15:46:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:46:16.937903 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8193ed0-1c43-45a2-9c57-0c539ace17ba None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:17.055867 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8193ed0-1c43-45a2-9c57-0c539ace17ba None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:17.101282 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb886e-811c-4453-b77e-48ca242bf556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:17.102245 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb886e-811c-4453-b77e-48ca242bf556 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:17.102660 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb886e-811c-4453-b77e-48ca242bf556 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:17.102924 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb886e-811c-4453-b77e-48ca242bf556 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:17.116457 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eb886e-811c-4453-b77e-48ca242bf556 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:17.119121 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eb886e-811c-4453-b77e-48ca242bf556 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:17.136650 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-15eb886e-811c-4453-b77e-48ca242bf556 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:46:17.136650 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:46:17.136650 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:46:17.136650 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:46:17.136650 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:46:17.136650 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:46:17.136650 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:46:17.136650 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:46:17.136650 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:46:17.136650 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:46:17.136650 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:46:17.136650 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:46:17.136650 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:46:17.136650 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:46:17.136650 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:46:17.136650 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:46:17.138517 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:46:17.138517 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:46:17.138517 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:46:17.138517 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:46:17.138517 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:46:17.138517 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:46:17.138517 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:46:17.138517 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:46:17.138517 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:46:17.138517 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:46:17.138517 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:46:17.138517 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:46:17.138517 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:46:17.138517 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:46:17.138517 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:46:17.138517 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:46:17.138517 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:46:17.140608 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:46:17.140608 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:46:17.140608 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:46:17.140608 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 628/1228] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:46:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:46:17.144789 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951547f-b9b8-4d6f-899a-2c71e9f36a5c None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:17.264838 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951547f-b9b8-4d6f-899a-2c71e9f36a5c None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:17.267200 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:17.302840 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7046d162-4012-4b1d-902b-583bd16bb572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:17.303449 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7046d162-4012-4b1d-902b-583bd16bb572 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:17.303811 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7046d162-4012-4b1d-902b-583bd16bb572 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:17.304085 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7046d162-4012-4b1d-902b-583bd16bb572 None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:17.304792 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7046d162-4012-4b1d-902b-583bd16bb572 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:46:17.305308 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7046d162-4012-4b1d-902b-583bd16bb572 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:17.306813 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7046d162-4012-4b1d-902b-583bd16bb572 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:17.320470 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 601/1229] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:46:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:46:17.326535 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb886e-811c-4453-b77e-48ca242bf556 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:17.337482 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:17.458860 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb886e-811c-4453-b77e-48ca242bf556 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:17.496234 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6686f38-a514-4c26-8b49-b66a76e00cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:17.496789 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6686f38-a514-4c26-8b49-b66a76e00cc0 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:17.497068 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6686f38-a514-4c26-8b49-b66a76e00cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:17.497345 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6686f38-a514-4c26-8b49-b66a76e00cc0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:17.504162 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6686f38-a514-4c26-8b49-b66a76e00cc0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:17.505599 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6686f38-a514-4c26-8b49-b66a76e00cc0 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:17.517446 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-a6686f38-a514-4c26-8b49-b66a76e00cc0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:46:17.517446 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:46:17.517446 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:46:17.517446 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:46:17.517446 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:46:17.517446 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:46:17.517446 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:46:17.517446 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:46:17.517446 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:46:17.517446 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:46:17.517446 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:46:17.517446 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:46:17.517446 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:46:17.517446 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:46:17.517446 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:46:17.518648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:46:17.518648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:46:17.518648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:46:17.518648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:46:17.518648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:46:17.518648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:46:17.518648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:46:17.518648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:46:17.518648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:46:17.518648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:46:17.518648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:46:17.518648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:46:17.518648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:46:17.518648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:46:17.518648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:46:17.518648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:46:17.518648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:46:17.519582 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:46:17.519582 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:46:17.519582 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:46:17.519582 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:46:17.519582 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:46:17.519582 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:46:17.519582 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:46:17.519582 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:46:17.522461 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 629/1230] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:46:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:46:17.525383 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7046d162-4012-4b1d-902b-583bd16bb572 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:17.643893 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7046d162-4012-4b1d-902b-583bd16bb572 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:17.682329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374364c-abfe-4377-80a4-948d1d6d9c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:17.682939 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374364c-abfe-4377-80a4-948d1d6d9c67 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:17.683216 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374364c-abfe-4377-80a4-948d1d6d9c67 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:17.683487 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374364c-abfe-4377-80a4-948d1d6d9c67 None admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:17.684175 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a374364c-abfe-4377-80a4-948d1d6d9c67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:46:17.684485 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a374364c-abfe-4377-80a4-948d1d6d9c67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:17.685904 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a374364c-abfe-4377-80a4-948d1d6d9c67 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:17.698566 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 602/1231] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 7 15:46:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:46:17.704568 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6686f38-a514-4c26-8b49-b66a76e00cc0 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:17.772803 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:17.809703 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6686f38-a514-4c26-8b49-b66a76e00cc0 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:17.843965 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d4de4d-d63a-4930-aff4-ea4304c07d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:17.844621 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4de4d-d63a-4930-aff4-ea4304c07d6d None admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:17.844897 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4de4d-d63a-4930-aff4-ea4304c07d6d None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:17.845168 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4de4d-d63a-4930-aff4-ea4304c07d6d None admin] PATH_INFO: `/v3/projects/488830167943488f85743236584113d7/users/66c270b488024605af84e52d874474e9/roles/a420b17212b94988beb75affe974355b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:17.861157 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d4de4d-d63a-4930-aff4-ea4304c07d6d None admin] RBAC: Authorizing `identity:create_grant(project_id=488830167943488f85743236584113d7, user_id=66c270b488024605af84e52d874474e9, role_id=a420b17212b94988beb75affe974355b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:17.862627 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d4de4d-d63a-4930-aff4-ea4304c07d6d None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:17.876934 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 630/1232] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 7 15:46:17 2022] PUT /identity/v3/projects/488830167943488f85743236584113d7/users/66c270b488024605af84e52d874474e9/roles/a420b17212b94988beb75affe974355b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:46:20.118884 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb6fad-f6a3-4b48-8bbb-7e3664f2009f None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:20.119406 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb6fad-f6a3-4b48-8bbb-7e3664f2009f None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:20.119520 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb6fad-f6a3-4b48-8bbb-7e3664f2009f None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:20.120781 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 603/1233] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:46:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:46:20.125981 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa5a49-30a1-4ec1-8fc6-f270baa399fb None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:20.126396 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa5a49-30a1-4ec1-8fc6-f270baa399fb None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:20.126557 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa5a49-30a1-4ec1-8fc6-f270baa399fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:20.145442 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-4eaa5a49-30a1-4ec1-8fc6-f270baa399fb None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:46:20.146670 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-4eaa5a49-30a1-4ec1-8fc6-f270baa399fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:46:20.214300 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 631/1234] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:46:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:46:20.496176 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb6fad-f6a3-4b48-8bbb-7e3664f2009f None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:20.523191 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:20.613309 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb6fad-f6a3-4b48-8bbb-7e3664f2009f None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:20.655692 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1924e0-4a30-48cc-9197-f0b70c7d44f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:20.656411 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1924e0-4a30-48cc-9197-f0b70c7d44f3 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:20.656697 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1924e0-4a30-48cc-9197-f0b70c7d44f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:20.656997 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1924e0-4a30-48cc-9197-f0b70c7d44f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:20.669752 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1924e0-4a30-48cc-9197-f0b70c7d44f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:46:20.675848 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-eb1924e0-4a30-48cc-9197-f0b70c7d44f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:46:20.675848 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:46:20.675848 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:46:20.675848 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:46:20.675848 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:46:20.675848 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:46:20.675848 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:46:20.675848 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:46:20.675848 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:46:20.675848 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:46:20.675848 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:46:20.675848 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:46:20.675848 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:46:20.675848 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:46:20.675848 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:46:20.675848 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:46:20.676857 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:46:20.676857 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:46:20.676857 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:46:20.676857 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:46:20.676857 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:46:20.676857 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:46:20.676857 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:46:20.676857 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:46:20.676857 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:46:20.676857 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:46:20.676857 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:46:20.676857 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:46:20.676857 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:46:20.676857 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:46:20.676857 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:46:20.676857 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:46:20.677739 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:46:20.677739 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:46:20.677739 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:46:20.677739 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:46:20.677739 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:46:20.677739 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:46:20.677739 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:46:20.677739 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:46:20.677739 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:46:20.677739 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:46:20.677739 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 15:46:20.677739 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:46:20.677739 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 604/1235] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Sep 7 15:46:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:46:20.684250 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa5a49-30a1-4ec1-8fc6-f270baa399fb None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:20.746110 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:20.803888 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa5a49-30a1-4ec1-8fc6-f270baa399fb None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:20.842463 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d88f599-49bc-42d9-a30a-1cef3ab74660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:20.843097 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88f599-49bc-42d9-a30a-1cef3ab74660 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:20.843460 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88f599-49bc-42d9-a30a-1cef3ab74660 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:20.843740 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88f599-49bc-42d9-a30a-1cef3ab74660 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:20.844404 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d88f599-49bc-42d9-a30a-1cef3ab74660 None admin] RBAC: Adding query filter params (name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:46:20.844713 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d88f599-49bc-42d9-a30a-1cef3ab74660 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:20.846197 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d88f599-49bc-42d9-a30a-1cef3ab74660 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:20.855785 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 632/1236] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Sep 7 15:46:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:46:20.861534 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1924e0-4a30-48cc-9197-f0b70c7d44f3 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:20.951855 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:20.970222 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1924e0-4a30-48cc-9197-f0b70c7d44f3 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:21.009388 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cda69f-b52f-442f-8d1f-0e01da3c690e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:21.010064 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cda69f-b52f-442f-8d1f-0e01da3c690e None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:21.010358 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cda69f-b52f-442f-8d1f-0e01da3c690e None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:21.010703 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cda69f-b52f-442f-8d1f-0e01da3c690e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:21.021321 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cda69f-b52f-442f-8d1f-0e01da3c690e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:21.022907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cda69f-b52f-442f-8d1f-0e01da3c690e None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:21.038489 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-86cda69f-b52f-442f-8d1f-0e01da3c690e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:46:21.038489 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:46:21.038489 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:46:21.038489 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:46:21.038489 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:46:21.038489 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:46:21.038489 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:46:21.038489 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:46:21.038489 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:46:21.038489 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:46:21.038489 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:46:21.038489 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:46:21.038489 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:46:21.038489 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:46:21.038489 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:46:21.038489 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:46:21.040232 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:46:21.040232 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:46:21.040232 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:46:21.040232 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:46:21.040232 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:46:21.040232 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:46:21.040232 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:46:21.040232 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:46:21.040232 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:46:21.040232 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:46:21.040232 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:46:21.040232 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:46:21.040232 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:46:21.040232 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:46:21.040232 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:46:21.040232 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:46:21.040232 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:46:21.044092 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:46:21.044092 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:46:21.044092 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:46:21.044092 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 605/1237] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:46:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:46:21.046417 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d88f599-49bc-42d9-a30a-1cef3ab74660 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:21.161973 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d88f599-49bc-42d9-a30a-1cef3ab74660 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:21.172245 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:21.201047 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a6f45-be05-4aab-8d07-c5224f46def2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:21.201644 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a6f45-be05-4aab-8d07-c5224f46def2 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:21.201915 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a6f45-be05-4aab-8d07-c5224f46def2 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:21.202204 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a6f45-be05-4aab-8d07-c5224f46def2 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:21.202853 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340a6f45-be05-4aab-8d07-c5224f46def2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:46:21.203150 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340a6f45-be05-4aab-8d07-c5224f46def2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:21.204568 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340a6f45-be05-4aab-8d07-c5224f46def2 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:21.217473 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 633/1238] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:46:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:46:21.224347 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cda69f-b52f-442f-8d1f-0e01da3c690e None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:21.340248 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cda69f-b52f-442f-8d1f-0e01da3c690e None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:21.382489 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9bf5f-3b84-4ffc-8fc5-952714398fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:21.383783 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9bf5f-3b84-4ffc-8fc5-952714398fb5 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:21.384068 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9bf5f-3b84-4ffc-8fc5-952714398fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:21.384345 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9bf5f-3b84-4ffc-8fc5-952714398fb5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:21.387854 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:21.393518 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd9bf5f-3b84-4ffc-8fc5-952714398fb5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:21.395090 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd9bf5f-3b84-4ffc-8fc5-952714398fb5 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:21.408422 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-acd9bf5f-3b84-4ffc-8fc5-952714398fb5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 07 15:46:21.408422 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:46:21.408422 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:46:21.408422 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:46:21.408422 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:46:21.408422 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:46:21.408422 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:46:21.408422 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:46:21.408422 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:46:21.408422 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:46:21.408422 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:46:21.408422 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:46:21.408422 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:46:21.408422 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:46:21.408422 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:46:21.408422 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:46:21.409653 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:46:21.409653 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:46:21.409653 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:46:21.409653 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:46:21.409653 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:46:21.409653 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:46:21.409653 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:46:21.409653 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:46:21.409653 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:46:21.409653 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:46:21.409653 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:46:21.409653 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:46:21.409653 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:46:21.409653 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:46:21.409653 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:46:21.409653 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:46:21.409653 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:46:21.409653 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:46:21.410893 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:46:21.410893 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:46:21.410893 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:46:21.410893 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:46:21.410893 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:46:21.410893 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:46:21.410893 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:46:21.410893 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:46:21.410893 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 07 15:46:21.410893 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:46:21.410893 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 606/1239] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:46:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:46:21.416420 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a6f45-be05-4aab-8d07-c5224f46def2 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:21.524016 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a6f45-be05-4aab-8d07-c5224f46def2 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:21.562724 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de210ce3-bcb7-429c-8ad7-aebba11f3430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:21.563342 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de210ce3-bcb7-429c-8ad7-aebba11f3430 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:21.563628 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de210ce3-bcb7-429c-8ad7-aebba11f3430 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:21.563898 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de210ce3-bcb7-429c-8ad7-aebba11f3430 None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:21.564621 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de210ce3-bcb7-429c-8ad7-aebba11f3430 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:46:21.564943 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de210ce3-bcb7-429c-8ad7-aebba11f3430 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:21.566411 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de210ce3-bcb7-429c-8ad7-aebba11f3430 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:21.585218 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 634/1240] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Sep 7 15:46:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:46:21.591605 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9bf5f-3b84-4ffc-8fc5-952714398fb5 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:21.698869 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9bf5f-3b84-4ffc-8fc5-952714398fb5 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:21.733076 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaef42c-5c9c-489f-a7dc-541401bf0e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:21.733763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaef42c-5c9c-489f-a7dc-541401bf0e77 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:21.734372 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaef42c-5c9c-489f-a7dc-541401bf0e77 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:21.734617 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaef42c-5c9c-489f-a7dc-541401bf0e77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:21.803990 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:21.812045 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaef42c-5c9c-489f-a7dc-541401bf0e77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:21.813505 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaef42c-5c9c-489f-a7dc-541401bf0e77 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:21.939526 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 607/1241] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:46:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 07 15:46:21.945998 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de210ce3-bcb7-429c-8ad7-aebba11f3430 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:21.978382 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:22.061249 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de210ce3-bcb7-429c-8ad7-aebba11f3430 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:22.098936 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b588c71-13f1-4141-8b91-f61ac05fbb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:22.099630 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b588c71-13f1-4141-8b91-f61ac05fbb63 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:22.100029 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b588c71-13f1-4141-8b91-f61ac05fbb63 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:22.101198 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b588c71-13f1-4141-8b91-f61ac05fbb63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:22.113539 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b588c71-13f1-4141-8b91-f61ac05fbb63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:22.115257 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b588c71-13f1-4141-8b91-f61ac05fbb63 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:22.131288 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-1b588c71-13f1-4141-8b91-f61ac05fbb63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:46:22.131288 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:46:22.131288 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:46:22.131288 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:46:22.131288 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:46:22.131288 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:46:22.131288 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:46:22.131288 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:46:22.131288 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:46:22.131288 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:46:22.131288 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:46:22.131288 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:46:22.131288 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:46:22.131288 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:46:22.131288 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:46:22.131288 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:46:22.133311 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:46:22.133311 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:46:22.133311 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:46:22.133311 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:46:22.133311 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:46:22.133311 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:46:22.133311 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:46:22.133311 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:46:22.133311 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:46:22.133311 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:46:22.133311 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:46:22.133311 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:46:22.133311 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:46:22.133311 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:46:22.133311 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:46:22.133311 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:46:22.133311 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:46:22.134563 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:46:22.134563 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:46:22.134563 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:46:22.134563 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 635/1242] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:46:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:46:22.139558 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaef42c-5c9c-489f-a7dc-541401bf0e77 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:22.243521 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:22.249741 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaef42c-5c9c-489f-a7dc-541401bf0e77 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:22.288770 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f22e4f-cf38-4122-9f57-2a6c73c0a24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:22.289894 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f22e4f-cf38-4122-9f57-2a6c73c0a24e None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:22.290198 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f22e4f-cf38-4122-9f57-2a6c73c0a24e None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:22.290509 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f22e4f-cf38-4122-9f57-2a6c73c0a24e None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:22.291148 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f22e4f-cf38-4122-9f57-2a6c73c0a24e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:46:22.291449 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f22e4f-cf38-4122-9f57-2a6c73c0a24e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:22.292846 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f22e4f-cf38-4122-9f57-2a6c73c0a24e None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:22.305954 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 608/1243] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:46:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:46:22.311859 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b588c71-13f1-4141-8b91-f61ac05fbb63 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:22.400696 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:22.428136 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b588c71-13f1-4141-8b91-f61ac05fbb63 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:22.470102 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb7624c-0b0c-47b2-9c72-6ae1a7f136c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:22.470929 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7624c-0b0c-47b2-9c72-6ae1a7f136c0 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:22.471218 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7624c-0b0c-47b2-9c72-6ae1a7f136c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:22.471523 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7624c-0b0c-47b2-9c72-6ae1a7f136c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:22.480712 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb7624c-0b0c-47b2-9c72-6ae1a7f136c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:22.482491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb7624c-0b0c-47b2-9c72-6ae1a7f136c0 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:22.498305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-8bb7624c-0b0c-47b2-9c72-6ae1a7f136c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:46:22.498305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:46:22.498305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:46:22.498305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:46:22.498305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:46:22.498305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:46:22.498305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:46:22.498305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:46:22.498305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:46:22.498305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:46:22.498305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:46:22.498305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:46:22.498305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:46:22.498305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:46:22.498305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:46:22.499316 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:46:22.499316 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:46:22.499316 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:46:22.499316 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:46:22.499316 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:46:22.499316 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:46:22.499316 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:46:22.499316 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:46:22.499316 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:46:22.499316 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:46:22.499316 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:46:22.499316 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:46:22.499316 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:46:22.499316 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:46:22.499316 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:46:22.499316 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:46:22.499316 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:46:22.500288 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:46:22.500288 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:46:22.500288 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:46:22.500288 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:46:22.500288 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:46:22.500288 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:46:22.500288 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:46:22.500288 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:46:22.500288 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 636/1244] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:46:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:46:22.505901 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f22e4f-cf38-4122-9f57-2a6c73c0a24e None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:22.619257 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f22e4f-cf38-4122-9f57-2a6c73c0a24e None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:22.658529 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17309bc-4fad-4d39-93d9-08acda071167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:22.659137 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17309bc-4fad-4d39-93d9-08acda071167 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:22.659419 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17309bc-4fad-4d39-93d9-08acda071167 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:22.659689 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17309bc-4fad-4d39-93d9-08acda071167 None admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:22.660370 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17309bc-4fad-4d39-93d9-08acda071167 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:46:22.660716 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17309bc-4fad-4d39-93d9-08acda071167 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:22.662464 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17309bc-4fad-4d39-93d9-08acda071167 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:22.676434 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 609/1245] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 7 15:46:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:46:22.683866 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb7624c-0b0c-47b2-9c72-6ae1a7f136c0 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:22.796570 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb7624c-0b0c-47b2-9c72-6ae1a7f136c0 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:22.836923 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264cec2c-c0fb-4c8d-95f2-f51726496f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:22.838042 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264cec2c-c0fb-4c8d-95f2-f51726496f3b None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:22.839351 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264cec2c-c0fb-4c8d-95f2-f51726496f3b None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:22.839351 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264cec2c-c0fb-4c8d-95f2-f51726496f3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:22.840257 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264cec2c-c0fb-4c8d-95f2-f51726496f3b None admin] RBAC: Adding query filter params (role.id=a420b17212b94988beb75affe974355b, scope.project.id=488830167943488f85743236584113d7, user.id=66c270b488024605af84e52d874474e9) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:46:22.840788 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264cec2c-c0fb-4c8d-95f2-f51726496f3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:22.842910 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264cec2c-c0fb-4c8d-95f2-f51726496f3b None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:22.857858 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 637/1246] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 7 15:46:22 2022] GET /identity/v3/role_assignments?user.id=66c270b488024605af84e52d874474e9&scope.project.id=488830167943488f85743236584113d7&role.id=a420b17212b94988beb75affe974355b => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:46:25.453020 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939156f-6b91-483d-8eee-48d64c0f3050 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:25.453749 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939156f-6b91-483d-8eee-48d64c0f3050 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:25.453749 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939156f-6b91-483d-8eee-48d64c0f3050 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:25.454923 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 610/1247] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:46:25.461772 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3c54a-5914-4a68-8958-7633b045bfbb None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:25.462249 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3c54a-5914-4a68-8958-7633b045bfbb None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:25.462382 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3c54a-5914-4a68-8958-7633b045bfbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:25.469242 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:25.483416 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-c2c3c54a-5914-4a68-8958-7633b045bfbb None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:46:25.484884 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-c2c3c54a-5914-4a68-8958-7633b045bfbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:46:25.560963 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 638/1248] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:46:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:46:25.828840 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939156f-6b91-483d-8eee-48d64c0f3050 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:25.847666 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:25.942528 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939156f-6b91-483d-8eee-48d64c0f3050 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:25.984454 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ab374-065a-4916-8527-2dca37a78cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:25.985090 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ab374-065a-4916-8527-2dca37a78cf1 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:25.985369 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ab374-065a-4916-8527-2dca37a78cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:25.985650 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ab374-065a-4916-8527-2dca37a78cf1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:25.996817 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198ab374-065a-4916-8527-2dca37a78cf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:46:26.001563 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-198ab374-065a-4916-8527-2dca37a78cf1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:46:26.001563 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:46:26.001563 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:46:26.001563 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:46:26.001563 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:46:26.001563 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:46:26.001563 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:46:26.001563 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:46:26.001563 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:46:26.001563 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:46:26.001563 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:46:26.001563 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:46:26.001563 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:46:26.001563 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:46:26.001563 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:46:26.001563 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:46:26.002667 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:46:26.002667 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:46:26.002667 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:46:26.002667 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:46:26.002667 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:46:26.002667 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:46:26.002667 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:46:26.002667 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:46:26.002667 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:46:26.002667 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:46:26.002667 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:46:26.002667 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:46:26.002667 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:46:26.002667 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:46:26.002667 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:46:26.002667 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:46:26.003527 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:46:26.003527 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:46:26.003527 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:46:26.003527 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:46:26.003527 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:46:26.003527 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:46:26.003527 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:46:26.003527 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:46:26.003527 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:46:26.003527 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:46:26.003527 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:46:26.003527 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:46:26.003527 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 611/1249] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 7 15:46:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:46:26.008891 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3c54a-5914-4a68-8958-7633b045bfbb None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:26.122001 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3c54a-5914-4a68-8958-7633b045bfbb None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:26.158708 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:26.165186 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2402b33-0142-4c47-93ca-d0e0cf50327b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:26.165811 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2402b33-0142-4c47-93ca-d0e0cf50327b None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:26.166116 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2402b33-0142-4c47-93ca-d0e0cf50327b None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:26.166419 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2402b33-0142-4c47-93ca-d0e0cf50327b None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:26.167095 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2402b33-0142-4c47-93ca-d0e0cf50327b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:46:26.167398 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2402b33-0142-4c47-93ca-d0e0cf50327b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:26.168822 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2402b33-0142-4c47-93ca-d0e0cf50327b None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:26.178284 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 639/1250] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:46:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:46:26.185162 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ab374-065a-4916-8527-2dca37a78cf1 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:26.267851 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:26.293200 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ab374-065a-4916-8527-2dca37a78cf1 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:26.330906 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e2070-f21a-4796-9828-8c441a473a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:26.331553 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e2070-f21a-4796-9828-8c441a473a37 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:26.331834 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e2070-f21a-4796-9828-8c441a473a37 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:26.332105 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e2070-f21a-4796-9828-8c441a473a37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:26.343949 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e2070-f21a-4796-9828-8c441a473a37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:26.345425 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e2070-f21a-4796-9828-8c441a473a37 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:26.361593 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-734e2070-f21a-4796-9828-8c441a473a37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:46:26.361593 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:46:26.361593 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:46:26.361593 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:46:26.361593 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:46:26.361593 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:46:26.361593 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:46:26.361593 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:46:26.361593 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:46:26.361593 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:46:26.361593 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:46:26.361593 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:46:26.361593 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:46:26.361593 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:46:26.361593 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:46:26.361593 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:46:26.362841 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:46:26.362841 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:46:26.362841 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:46:26.362841 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:46:26.362841 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:46:26.362841 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:46:26.362841 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:46:26.362841 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:46:26.362841 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:46:26.362841 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:46:26.362841 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:46:26.362841 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:46:26.362841 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:46:26.362841 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:46:26.362841 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:46:26.362841 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:46:26.362841 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:46:26.363756 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:46:26.363756 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:46:26.363756 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:46:26.363756 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 612/1251] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:46:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:46:26.369731 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2402b33-0142-4c47-93ca-d0e0cf50327b None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:26.486771 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2402b33-0142-4c47-93ca-d0e0cf50327b None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:26.522877 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ae97e-35b1-4356-81ef-d3e45e878ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:26.523530 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ae97e-35b1-4356-81ef-d3e45e878ee3 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:26.523847 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ae97e-35b1-4356-81ef-d3e45e878ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:26.524125 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ae97e-35b1-4356-81ef-d3e45e878ee3 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:26.524773 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906ae97e-35b1-4356-81ef-d3e45e878ee3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:46:26.525077 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906ae97e-35b1-4356-81ef-d3e45e878ee3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:26.526481 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906ae97e-35b1-4356-81ef-d3e45e878ee3 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:26.540015 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 640/1252] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:46:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:46:26.545766 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e2070-f21a-4796-9828-8c441a473a37 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:26.650265 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e2070-f21a-4796-9828-8c441a473a37 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:26.676909 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:26.685820 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6573e2c0-e143-4279-9f09-712bdaabaf16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:26.686498 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573e2c0-e143-4279-9f09-712bdaabaf16 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:26.686782 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573e2c0-e143-4279-9f09-712bdaabaf16 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:26.687055 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573e2c0-e143-4279-9f09-712bdaabaf16 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:26.695390 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6573e2c0-e143-4279-9f09-712bdaabaf16 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:26.696975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6573e2c0-e143-4279-9f09-712bdaabaf16 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:26.708434 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-6573e2c0-e143-4279-9f09-712bdaabaf16 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 07 15:46:26.708434 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:46:26.708434 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:46:26.708434 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:46:26.708434 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:46:26.708434 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:46:26.708434 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:46:26.708434 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:46:26.708434 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:46:26.708434 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:46:26.708434 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:46:26.708434 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:46:26.708434 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:46:26.708434 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:46:26.708434 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:46:26.708434 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:46:26.709614 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:46:26.709614 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:46:26.709614 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:46:26.709614 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:46:26.709614 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:46:26.709614 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:46:26.709614 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:46:26.709614 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:46:26.709614 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:46:26.709614 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:46:26.709614 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:46:26.709614 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:46:26.709614 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:46:26.709614 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:46:26.709614 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:46:26.709614 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:46:26.709614 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:46:26.709614 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:46:26.710979 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:46:26.710979 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:46:26.710979 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:46:26.710979 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:46:26.710979 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:46:26.710979 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:46:26.710979 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:46:26.710979 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:46:26.710979 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 07 15:46:26.710979 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:46:26.710979 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 613/1253] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:46:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:46:26.716105 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ae97e-35b1-4356-81ef-d3e45e878ee3 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:26.776410 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:26.821249 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ae97e-35b1-4356-81ef-d3e45e878ee3 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:26.855024 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b512bc78-7200-4909-8e38-db3625540a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:26.855628 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b512bc78-7200-4909-8e38-db3625540a13 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:26.855910 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b512bc78-7200-4909-8e38-db3625540a13 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:26.856186 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b512bc78-7200-4909-8e38-db3625540a13 None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:26.856906 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b512bc78-7200-4909-8e38-db3625540a13 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:46:26.857219 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b512bc78-7200-4909-8e38-db3625540a13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:26.858665 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b512bc78-7200-4909-8e38-db3625540a13 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:26.876077 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 641/1254] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Sep 7 15:46:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:46:26.881806 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6573e2c0-e143-4279-9f09-712bdaabaf16 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:26.979953 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6573e2c0-e143-4279-9f09-712bdaabaf16 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:27.015125 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170d1b7-e2ad-44f6-8584-e92d084f1b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:27.015731 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170d1b7-e2ad-44f6-8584-e92d084f1b32 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:27.016011 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170d1b7-e2ad-44f6-8584-e92d084f1b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:27.016289 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170d1b7-e2ad-44f6-8584-e92d084f1b32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:27.080572 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:27.092885 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9170d1b7-e2ad-44f6-8584-e92d084f1b32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:27.094366 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9170d1b7-e2ad-44f6-8584-e92d084f1b32 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:27.189065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 614/1255] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:46:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 15:46:27.194986 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b512bc78-7200-4909-8e38-db3625540a13 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:27.294842 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b512bc78-7200-4909-8e38-db3625540a13 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:27.308250 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:27.329314 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6942f4f9-efcd-48f9-a23b-bf777c9e2c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:27.329936 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942f4f9-efcd-48f9-a23b-bf777c9e2c85 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:27.330247 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942f4f9-efcd-48f9-a23b-bf777c9e2c85 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:27.330531 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942f4f9-efcd-48f9-a23b-bf777c9e2c85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:27.340619 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6942f4f9-efcd-48f9-a23b-bf777c9e2c85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:27.342051 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6942f4f9-efcd-48f9-a23b-bf777c9e2c85 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:27.357271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-6942f4f9-efcd-48f9-a23b-bf777c9e2c85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:46:27.357271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:46:27.357271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:46:27.357271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:46:27.357271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:46:27.357271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:46:27.357271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:46:27.357271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:46:27.357271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:46:27.357271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:46:27.357271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:46:27.357271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:46:27.357271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:46:27.357271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:46:27.357271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:46:27.357271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:46:27.358378 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:46:27.358378 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:46:27.358378 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:46:27.358378 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:46:27.358378 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:46:27.358378 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:46:27.358378 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:46:27.358378 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:46:27.358378 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:46:27.358378 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:46:27.358378 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:46:27.358378 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:46:27.358378 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:46:27.358378 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:46:27.358378 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:46:27.358378 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:46:27.358378 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:46:27.359580 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:46:27.359580 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:46:27.359580 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:46:27.359580 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 642/1256] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:46:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:46:27.364795 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170d1b7-e2ad-44f6-8584-e92d084f1b32 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:27.460719 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:27.472338 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170d1b7-e2ad-44f6-8584-e92d084f1b32 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:27.505492 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ebb3a-6d51-4a3c-b456-887f7a861a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:27.506084 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ebb3a-6d51-4a3c-b456-887f7a861a6b None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:27.506389 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ebb3a-6d51-4a3c-b456-887f7a861a6b None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:27.506660 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ebb3a-6d51-4a3c-b456-887f7a861a6b None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:27.507291 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ebb3a-6d51-4a3c-b456-887f7a861a6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:46:27.507619 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ebb3a-6d51-4a3c-b456-887f7a861a6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:27.509029 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ebb3a-6d51-4a3c-b456-887f7a861a6b None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:27.519741 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 615/1257] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:46:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:46:27.525594 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6942f4f9-efcd-48f9-a23b-bf777c9e2c85 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:27.624246 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6942f4f9-efcd-48f9-a23b-bf777c9e2c85 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:27.657128 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c1becf-cb9e-452c-a9b7-a9d603df5fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:27.657738 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1becf-cb9e-452c-a9b7-a9d603df5fb9 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:27.658019 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1becf-cb9e-452c-a9b7-a9d603df5fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:27.658321 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1becf-cb9e-452c-a9b7-a9d603df5fb9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:27.665431 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c1becf-cb9e-452c-a9b7-a9d603df5fb9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:27.666881 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c1becf-cb9e-452c-a9b7-a9d603df5fb9 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:27.677875 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-60c1becf-cb9e-452c-a9b7-a9d603df5fb9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:46:27.677875 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:46:27.677875 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:46:27.677875 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:46:27.677875 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:46:27.677875 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:46:27.677875 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:46:27.677875 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:46:27.677875 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:46:27.677875 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:46:27.677875 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:46:27.677875 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:46:27.677875 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:46:27.677875 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:46:27.677875 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:46:27.678931 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:46:27.678931 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:46:27.678931 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:46:27.678931 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:46:27.678931 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:46:27.678931 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:46:27.678931 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:46:27.678931 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:46:27.678931 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:46:27.678931 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:46:27.678931 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:46:27.678931 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:46:27.678931 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:46:27.678931 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:46:27.678931 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:46:27.678931 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:46:27.678931 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:46:27.680027 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:46:27.680027 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:46:27.680027 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:46:27.680027 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:46:27.680027 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:46:27.680027 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:46:27.680027 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:46:27.680027 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:46:27.680027 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 643/1258] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:46:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:46:27.684980 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ebb3a-6d51-4a3c-b456-887f7a861a6b None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:27.781594 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ebb3a-6d51-4a3c-b456-887f7a861a6b None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:27.813651 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109afac2-c760-475c-b434-8c37b8bcdd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:27.814271 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109afac2-c760-475c-b434-8c37b8bcdd7d None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:27.814539 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109afac2-c760-475c-b434-8c37b8bcdd7d None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:27.814808 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109afac2-c760-475c-b434-8c37b8bcdd7d None admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:27.815481 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109afac2-c760-475c-b434-8c37b8bcdd7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:46:27.815782 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109afac2-c760-475c-b434-8c37b8bcdd7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:27.817182 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109afac2-c760-475c-b434-8c37b8bcdd7d None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:27.828863 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 616/1259] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 7 15:46:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:46:27.834837 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c1becf-cb9e-452c-a9b7-a9d603df5fb9 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:27.861323 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:27.934807 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c1becf-cb9e-452c-a9b7-a9d603df5fb9 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:27.968013 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c814db-c3e3-4dad-a895-88b9e1c575f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:27.968604 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c814db-c3e3-4dad-a895-88b9e1c575f8 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:27.968883 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c814db-c3e3-4dad-a895-88b9e1c575f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:27.969156 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c814db-c3e3-4dad-a895-88b9e1c575f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:27.969864 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c814db-c3e3-4dad-a895-88b9e1c575f8 None admin] RBAC: Adding query filter params (role.id=61605ebf17e643258730e55bf6db15ad, scope.project.id=488830167943488f85743236584113d7, user.id=66c270b488024605af84e52d874474e9) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:46:27.970170 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c814db-c3e3-4dad-a895-88b9e1c575f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:27.971609 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c814db-c3e3-4dad-a895-88b9e1c575f8 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:27.977397 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 644/1260] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 7 15:46:27 2022] GET /identity/v3/role_assignments?user.id=66c270b488024605af84e52d874474e9&scope.project.id=488830167943488f85743236584113d7&role.id=61605ebf17e643258730e55bf6db15ad => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:46:30.106810 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170de3b-58b3-4292-afdc-467df4e90426 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:30.107357 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170de3b-58b3-4292-afdc-467df4e90426 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:30.107357 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170de3b-58b3-4292-afdc-467df4e90426 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:30.108682 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 617/1261] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:46:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:46:30.113903 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d17c9-bc24-47f7-951d-7e96b85ed854 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:30.114315 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d17c9-bc24-47f7-951d-7e96b85ed854 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:30.114490 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d17c9-bc24-47f7-951d-7e96b85ed854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:30.132379 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-468d17c9-bc24-47f7-951d-7e96b85ed854 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:46:30.133751 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-468d17c9-bc24-47f7-951d-7e96b85ed854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:46:30.198536 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 645/1262] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:46:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:46:30.486882 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170de3b-58b3-4292-afdc-467df4e90426 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:30.498314 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:30.589364 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170de3b-58b3-4292-afdc-467df4e90426 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:30.623359 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1604e27-f4b9-4666-92d7-cc03242052cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:30.623976 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1604e27-f4b9-4666-92d7-cc03242052cf None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:30.624262 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1604e27-f4b9-4666-92d7-cc03242052cf None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:30.624537 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1604e27-f4b9-4666-92d7-cc03242052cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:30.634982 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1604e27-f4b9-4666-92d7-cc03242052cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:46:30.639742 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-c1604e27-f4b9-4666-92d7-cc03242052cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:46:30.639742 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:46:30.639742 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:46:30.639742 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:46:30.639742 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:46:30.639742 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:46:30.639742 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:46:30.639742 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:46:30.639742 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:46:30.639742 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:46:30.639742 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:46:30.639742 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:46:30.639742 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:46:30.639742 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:46:30.639742 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:46:30.639742 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:46:30.640886 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:46:30.640886 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:46:30.640886 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:46:30.640886 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:46:30.640886 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:46:30.640886 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:46:30.640886 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:46:30.640886 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:46:30.640886 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:46:30.640886 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:46:30.640886 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:46:30.640886 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:46:30.640886 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:46:30.640886 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:46:30.640886 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:46:30.640886 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:46:30.641980 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:46:30.641980 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:46:30.641980 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:46:30.641980 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:46:30.641980 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:46:30.641980 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:46:30.641980 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:46:30.641980 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:46:30.641980 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:46:30.641980 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:46:30.641980 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:46:30.641980 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:46:30.641980 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 618/1263] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 7 15:46:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:46:30.646950 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d17c9-bc24-47f7-951d-7e96b85ed854 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:30.664901 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:30.744567 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d17c9-bc24-47f7-951d-7e96b85ed854 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:30.777266 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f74bcd-b5d6-4a11-90b5-873722f1d4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:30.777860 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f74bcd-b5d6-4a11-90b5-873722f1d4e4 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:30.778138 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f74bcd-b5d6-4a11-90b5-873722f1d4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:30.778440 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f74bcd-b5d6-4a11-90b5-873722f1d4e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:30.779090 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f74bcd-b5d6-4a11-90b5-873722f1d4e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:46:30.779391 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f74bcd-b5d6-4a11-90b5-873722f1d4e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:30.780742 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f74bcd-b5d6-4a11-90b5-873722f1d4e4 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:30.788553 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 646/1264] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:46:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:46:30.794401 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1604e27-f4b9-4666-92d7-cc03242052cf None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:30.860161 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:30.894093 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1604e27-f4b9-4666-92d7-cc03242052cf None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:30.927188 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6396211-3e99-4551-9113-4181f46ce4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:30.927811 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6396211-3e99-4551-9113-4181f46ce4b6 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:30.928091 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6396211-3e99-4551-9113-4181f46ce4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:30.928369 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6396211-3e99-4551-9113-4181f46ce4b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:30.938737 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6396211-3e99-4551-9113-4181f46ce4b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:30.940173 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6396211-3e99-4551-9113-4181f46ce4b6 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:30.955234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-c6396211-3e99-4551-9113-4181f46ce4b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:46:30.955234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:46:30.955234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:46:30.955234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:46:30.955234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:46:30.955234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:46:30.955234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:46:30.955234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:46:30.955234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:46:30.955234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:46:30.955234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:46:30.955234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:46:30.955234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:46:30.955234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:46:30.955234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:46:30.955234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:46:30.956348 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:46:30.956348 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:46:30.956348 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:46:30.956348 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:46:30.956348 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:46:30.956348 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:46:30.956348 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:46:30.956348 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:46:30.956348 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:46:30.956348 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:46:30.956348 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:46:30.956348 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:46:30.956348 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:46:30.956348 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:46:30.956348 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:46:30.956348 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:46:30.956348 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:46:30.957523 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:46:30.957523 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:46:30.957523 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:46:30.957523 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 619/1265] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:46:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:46:30.961975 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f74bcd-b5d6-4a11-90b5-873722f1d4e4 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:31.043184 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:31.062164 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f74bcd-b5d6-4a11-90b5-873722f1d4e4 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:31.095541 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4bcee-bb9e-474e-bcd0-25c41295932e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:31.096138 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4bcee-bb9e-474e-bcd0-25c41295932e None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:31.096414 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4bcee-bb9e-474e-bcd0-25c41295932e None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:31.096682 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4bcee-bb9e-474e-bcd0-25c41295932e None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:31.097311 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac4bcee-bb9e-474e-bcd0-25c41295932e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:46:31.097613 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac4bcee-bb9e-474e-bcd0-25c41295932e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:31.098991 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac4bcee-bb9e-474e-bcd0-25c41295932e None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:31.110543 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 647/1266] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:46:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:46:31.116337 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6396211-3e99-4551-9113-4181f46ce4b6 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:31.212596 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6396211-3e99-4551-9113-4181f46ce4b6 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:31.231396 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:31.245475 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be174ef9-6322-48f6-a6c6-c51f0051495d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:31.246089 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be174ef9-6322-48f6-a6c6-c51f0051495d None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:31.246466 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be174ef9-6322-48f6-a6c6-c51f0051495d None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:31.246744 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be174ef9-6322-48f6-a6c6-c51f0051495d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:31.253902 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be174ef9-6322-48f6-a6c6-c51f0051495d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:31.255366 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be174ef9-6322-48f6-a6c6-c51f0051495d None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:31.266905 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-be174ef9-6322-48f6-a6c6-c51f0051495d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 07 15:46:31.266905 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:46:31.266905 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:46:31.266905 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:46:31.266905 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:46:31.266905 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:46:31.266905 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:46:31.266905 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:46:31.266905 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:46:31.266905 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:46:31.266905 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:46:31.266905 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:46:31.266905 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:46:31.266905 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:46:31.266905 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:46:31.266905 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:46:31.268063 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:46:31.268063 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:46:31.268063 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:46:31.268063 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:46:31.268063 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:46:31.268063 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:46:31.268063 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:46:31.268063 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:46:31.268063 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:46:31.268063 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:46:31.268063 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:46:31.268063 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:46:31.268063 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:46:31.268063 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:46:31.268063 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:46:31.268063 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:46:31.268063 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:46:31.268063 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:46:31.269251 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:46:31.269251 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:46:31.269251 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:46:31.269251 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:46:31.269251 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:46:31.269251 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:46:31.269251 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:46:31.269251 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:46:31.269251 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 07 15:46:31.269251 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:46:31.269251 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 620/1267] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:46:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:46:31.274265 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4bcee-bb9e-474e-bcd0-25c41295932e None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:31.371123 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4bcee-bb9e-474e-bcd0-25c41295932e None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:31.406505 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2bb50-1d4d-431b-bfe8-c02d2bf62dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:31.407183 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2bb50-1d4d-431b-bfe8-c02d2bf62dfb None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:31.407468 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2bb50-1d4d-431b-bfe8-c02d2bf62dfb None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:31.407752 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2bb50-1d4d-431b-bfe8-c02d2bf62dfb None admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:31.408500 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c2bb50-1d4d-431b-bfe8-c02d2bf62dfb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:46:31.408821 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c2bb50-1d4d-431b-bfe8-c02d2bf62dfb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:31.410398 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c2bb50-1d4d-431b-bfe8-c02d2bf62dfb None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:31.419205 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:31.428145 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 648/1268] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Sep 7 15:46:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:46:31.434686 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be174ef9-6322-48f6-a6c6-c51f0051495d None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:31.533792 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be174ef9-6322-48f6-a6c6-c51f0051495d None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:31.566716 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191d2d9-c330-4e6f-acf8-5d4133078da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:31.567337 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191d2d9-c330-4e6f-acf8-5d4133078da7 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:31.567621 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191d2d9-c330-4e6f-acf8-5d4133078da7 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:31.567896 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191d2d9-c330-4e6f-acf8-5d4133078da7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:31.578842 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b191d2d9-c330-4e6f-acf8-5d4133078da7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:31.580294 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b191d2d9-c330-4e6f-acf8-5d4133078da7 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:31.594276 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-b191d2d9-c330-4e6f-acf8-5d4133078da7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:46:31.594276 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:46:31.594276 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:46:31.594276 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:46:31.594276 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:46:31.594276 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:46:31.594276 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:46:31.594276 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:46:31.594276 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:46:31.594276 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:46:31.594276 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:46:31.594276 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:46:31.594276 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:46:31.594276 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:46:31.594276 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:46:31.594276 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:46:31.595361 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:46:31.595361 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:46:31.595361 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:46:31.595361 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:46:31.595361 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:46:31.595361 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:46:31.595361 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:46:31.595361 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:46:31.595361 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:46:31.595361 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:46:31.595361 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:46:31.595361 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:46:31.595361 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:46:31.595361 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:46:31.595361 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:46:31.595361 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:46:31.595361 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:46:31.596460 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:46:31.596460 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:46:31.596460 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:46:31.596460 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 621/1269] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:46:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:46:31.601120 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2bb50-1d4d-431b-bfe8-c02d2bf62dfb None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:31.698704 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2bb50-1d4d-431b-bfe8-c02d2bf62dfb None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:31.730663 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff3f457-90a6-4a85-b217-75021f3ce546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:31.731254 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3f457-90a6-4a85-b217-75021f3ce546 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:31.731531 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3f457-90a6-4a85-b217-75021f3ce546 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:31.731800 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3f457-90a6-4a85-b217-75021f3ce546 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:31.732419 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff3f457-90a6-4a85-b217-75021f3ce546 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:46:31.732716 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff3f457-90a6-4a85-b217-75021f3ce546 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:31.734344 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff3f457-90a6-4a85-b217-75021f3ce546 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:31.745611 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 649/1270] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:46:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:46:31.751221 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191d2d9-c330-4e6f-acf8-5d4133078da7 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:31.783938 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:31.854881 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191d2d9-c330-4e6f-acf8-5d4133078da7 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:31.888364 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbbd0c9-1a9c-4e60-b9ac-0ebd9fd2a6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:31.888983 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbd0c9-1a9c-4e60-b9ac-0ebd9fd2a6d2 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:31.889268 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbd0c9-1a9c-4e60-b9ac-0ebd9fd2a6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:31.889543 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbd0c9-1a9c-4e60-b9ac-0ebd9fd2a6d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:31.895983 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbbd0c9-1a9c-4e60-b9ac-0ebd9fd2a6d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:31.897407 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbbd0c9-1a9c-4e60-b9ac-0ebd9fd2a6d2 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:31.908903 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-2dbbd0c9-1a9c-4e60-b9ac-0ebd9fd2a6d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:46:31.908903 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:46:31.908903 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:46:31.908903 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:46:31.908903 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:46:31.908903 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:46:31.908903 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:46:31.908903 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:46:31.908903 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:46:31.908903 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:46:31.908903 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:46:31.908903 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:46:31.908903 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:46:31.908903 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:46:31.908903 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:46:31.909992 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:46:31.909992 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:46:31.909992 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:46:31.909992 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:46:31.909992 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:46:31.909992 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:46:31.909992 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:46:31.909992 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:46:31.909992 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:46:31.909992 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:46:31.909992 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:46:31.909992 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:46:31.909992 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:46:31.909992 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:46:31.909992 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:46:31.909992 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:46:31.909992 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:46:31.911182 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:46:31.911182 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:46:31.911182 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:46:31.911182 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:46:31.911182 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:46:31.911182 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:46:31.911182 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:46:31.911182 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:46:31.911182 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 622/1271] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:46:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:46:31.917111 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff3f457-90a6-4a85-b217-75021f3ce546 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:31.973964 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:32.015786 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff3f457-90a6-4a85-b217-75021f3ce546 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:32.048676 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51903a59-5af9-439f-8aae-6435ce515015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:32.049280 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51903a59-5af9-439f-8aae-6435ce515015 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:32.049560 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51903a59-5af9-439f-8aae-6435ce515015 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:32.049834 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51903a59-5af9-439f-8aae-6435ce515015 None admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:32.050563 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51903a59-5af9-439f-8aae-6435ce515015 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:46:32.050866 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51903a59-5af9-439f-8aae-6435ce515015 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:32.052284 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51903a59-5af9-439f-8aae-6435ce515015 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:32.064632 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 650/1272] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 7 15:46:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:46:32.070702 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbbd0c9-1a9c-4e60-b9ac-0ebd9fd2a6d2 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:32.162062 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:32.171887 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbbd0c9-1a9c-4e60-b9ac-0ebd9fd2a6d2 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:32.204349 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a36b3-62e3-43a3-8290-6e72c1d4a514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:32.205004 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a36b3-62e3-43a3-8290-6e72c1d4a514 None admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:32.205288 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a36b3-62e3-43a3-8290-6e72c1d4a514 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:32.205566 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a36b3-62e3-43a3-8290-6e72c1d4a514 None admin] PATH_INFO: `/v3/projects/488830167943488f85743236584113d7/users/66c270b488024605af84e52d874474e9/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:32.207473 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a36b3-62e3-43a3-8290-6e72c1d4a514 None admin] RBAC: Authorizing `identity:create_grant(project_id=488830167943488f85743236584113d7, user_id=66c270b488024605af84e52d874474e9, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:32.208894 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a36b3-62e3-43a3-8290-6e72c1d4a514 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:32.221321 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 623/1273] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Sep 7 15:46:32 2022] PUT /identity/v3/projects/488830167943488f85743236584113d7/users/66c270b488024605af84e52d874474e9/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:46:34.354590 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3b425-f173-4670-b7bd-ca169e131cc7 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:34.355148 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3b425-f173-4670-b7bd-ca169e131cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:34.355148 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3b425-f173-4670-b7bd-ca169e131cc7 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:34.356373 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 651/1274] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:46:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:46:34.361808 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cac7c7-aa33-4cbe-8a0d-8937246d5464 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:34.362271 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cac7c7-aa33-4cbe-8a0d-8937246d5464 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:34.362392 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cac7c7-aa33-4cbe-8a0d-8937246d5464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:34.381145 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-64cac7c7-aa33-4cbe-8a0d-8937246d5464 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:46:34.383299 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-64cac7c7-aa33-4cbe-8a0d-8937246d5464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:46:34.458849 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 624/1275] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:46:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:46:34.730145 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3b425-f173-4670-b7bd-ca169e131cc7 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:34.829913 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3b425-f173-4670-b7bd-ca169e131cc7 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:34.847539 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:34.864829 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4745f2b5-dcf4-4c5d-9c26-f20a2a7c271e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:34.865444 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745f2b5-dcf4-4c5d-9c26-f20a2a7c271e None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:34.865721 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745f2b5-dcf4-4c5d-9c26-f20a2a7c271e None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:34.865987 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745f2b5-dcf4-4c5d-9c26-f20a2a7c271e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:34.876359 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4745f2b5-dcf4-4c5d-9c26-f20a2a7c271e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 15:46:34.881090 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-4745f2b5-dcf4-4c5d-9c26-f20a2a7c271e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:46:34.881090 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:46:34.881090 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:46:34.881090 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:46:34.881090 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:46:34.881090 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:46:34.881090 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:46:34.881090 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:46:34.881090 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:46:34.881090 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:46:34.881090 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:46:34.881090 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:46:34.881090 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 15:46:34.881090 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 15:46:34.881090 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 15:46:34.881090 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 15:46:34.882167 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 15:46:34.882167 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 15:46:34.882167 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 15:46:34.882167 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 15:46:34.882167 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:46:34.882167 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:46:34.882167 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:46:34.882167 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:46:34.882167 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:46:34.882167 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:46:34.882167 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:46:34.882167 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:46:34.882167 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:46:34.882167 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:46:34.882167 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:46:34.882167 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:46:34.883248 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:46:34.883248 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:46:34.883248 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:46:34.883248 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:46:34.883248 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 15:46:34.883248 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 15:46:34.883248 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 15:46:34.883248 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 15:46:34.883248 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 15:46:34.883248 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 15:46:34.883248 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 15:46:34.883248 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:46:34.883248 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 652/1276] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Sep 7 15:46:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:46:34.888193 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cac7c7-aa33-4cbe-8a0d-8937246d5464 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:34.964962 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:34.983862 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cac7c7-aa33-4cbe-8a0d-8937246d5464 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:35.017070 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d146c-fe4f-44d5-8ca3-3dcb1a7a96ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:35.017663 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d146c-fe4f-44d5-8ca3-3dcb1a7a96ee None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:35.017940 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d146c-fe4f-44d5-8ca3-3dcb1a7a96ee None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:35.018232 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d146c-fe4f-44d5-8ca3-3dcb1a7a96ee None admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:35.018899 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d146c-fe4f-44d5-8ca3-3dcb1a7a96ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:46:35.019200 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d146c-fe4f-44d5-8ca3-3dcb1a7a96ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:35.020540 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d146c-fe4f-44d5-8ca3-3dcb1a7a96ee None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:35.028253 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 625/1277] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Sep 7 15:46:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:46:35.034334 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4745f2b5-dcf4-4c5d-9c26-f20a2a7c271e None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:35.131470 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4745f2b5-dcf4-4c5d-9c26-f20a2a7c271e None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:35.163482 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d71c3-3f23-419d-b11b-f8fb4e54650d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:35.164735 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d71c3-3f23-419d-b11b-f8fb4e54650d None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:35.165009 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d71c3-3f23-419d-b11b-f8fb4e54650d None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:35.165278 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d71c3-3f23-419d-b11b-f8fb4e54650d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:35.175377 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d71c3-3f23-419d-b11b-f8fb4e54650d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:35.176798 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d71c3-3f23-419d-b11b-f8fb4e54650d None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:35.190474 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-df1d71c3-3f23-419d-b11b-f8fb4e54650d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:46:35.190474 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:46:35.190474 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:46:35.190474 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:46:35.190474 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:46:35.190474 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:46:35.190474 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:46:35.190474 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:46:35.190474 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:46:35.190474 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:46:35.190474 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:46:35.190474 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:46:35.190474 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:46:35.190474 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:46:35.190474 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:46:35.190474 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:46:35.191595 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:46:35.191595 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:46:35.191595 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:46:35.191595 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:46:35.191595 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:46:35.191595 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:46:35.191595 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:46:35.191595 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:46:35.191595 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:46:35.191595 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:46:35.191595 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:46:35.191595 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:46:35.191595 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:46:35.191595 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:46:35.191595 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:46:35.191595 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:46:35.191595 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:46:35.192641 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:46:35.192641 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:46:35.192641 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:46:35.192641 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 653/1278] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:46:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 15:46:35.197728 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d146c-fe4f-44d5-8ca3-3dcb1a7a96ee None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:35.294441 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d146c-fe4f-44d5-8ca3-3dcb1a7a96ee None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:35.325876 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f38c1-33dc-4933-9641-0d5b1e477c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:35.326489 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f38c1-33dc-4933-9641-0d5b1e477c37 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:35.326768 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f38c1-33dc-4933-9641-0d5b1e477c37 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:35.327039 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f38c1-33dc-4933-9641-0d5b1e477c37 None admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:35.327666 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f38c1-33dc-4933-9641-0d5b1e477c37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:46:35.327966 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f38c1-33dc-4933-9641-0d5b1e477c37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:35.329324 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f38c1-33dc-4933-9641-0d5b1e477c37 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:35.341047 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 626/1279] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:46:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:46:35.346613 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d71c3-3f23-419d-b11b-f8fb4e54650d None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:35.376900 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:35.446644 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d71c3-3f23-419d-b11b-f8fb4e54650d None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:35.479673 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2436b111-2a74-42be-9cd4-59cb1dbed6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:35.480285 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2436b111-2a74-42be-9cd4-59cb1dbed6f1 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:35.480561 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2436b111-2a74-42be-9cd4-59cb1dbed6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:35.480827 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2436b111-2a74-42be-9cd4-59cb1dbed6f1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:35.488211 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2436b111-2a74-42be-9cd4-59cb1dbed6f1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:35.489633 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2436b111-2a74-42be-9cd4-59cb1dbed6f1 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:35.500443 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-2436b111-2a74-42be-9cd4-59cb1dbed6f1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 07 15:46:35.500443 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:46:35.500443 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:46:35.500443 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:46:35.500443 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:46:35.500443 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:46:35.500443 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:46:35.500443 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:46:35.500443 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:46:35.500443 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:46:35.500443 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:46:35.500443 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:46:35.500443 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 15:46:35.500443 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 15:46:35.500443 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 15:46:35.500443 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 15:46:35.501553 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:46:35.501553 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:46:35.501553 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 15:46:35.501553 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:46:35.501553 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 15:46:35.501553 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 15:46:35.501553 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:46:35.501553 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:46:35.501553 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:46:35.501553 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:46:35.501553 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:46:35.501553 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:46:35.501553 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:46:35.501553 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:46:35.501553 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:46:35.501553 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:46:35.501553 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:46:35.501553 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:46:35.502749 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:46:35.502749 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:46:35.502749 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 15:46:35.502749 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 15:46:35.502749 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 15:46:35.502749 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 15:46:35.502749 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 15:46:35.502749 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 15:46:35.502749 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 07 15:46:35.502749 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:46:35.502749 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 654/1280] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:46:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:46:35.507291 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f38c1-33dc-4933-9641-0d5b1e477c37 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:35.511719 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:35.606082 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f38c1-33dc-4933-9641-0d5b1e477c37 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:35.640046 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd41e8-4242-4da6-8840-f27ec7640200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:35.640641 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd41e8-4242-4da6-8840-f27ec7640200 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:35.640924 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd41e8-4242-4da6-8840-f27ec7640200 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:35.641199 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd41e8-4242-4da6-8840-f27ec7640200 None admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:35.641912 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd41e8-4242-4da6-8840-f27ec7640200 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:46:35.642246 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd41e8-4242-4da6-8840-f27ec7640200 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:35.643670 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd41e8-4242-4da6-8840-f27ec7640200 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:35.660956 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 627/1281] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Sep 7 15:46:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:46:35.666868 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2436b111-2a74-42be-9cd4-59cb1dbed6f1 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:35.758858 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:35.768416 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2436b111-2a74-42be-9cd4-59cb1dbed6f1 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:35.801469 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5985a92a-2674-44da-9a8b-1422a0698843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:35.802070 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985a92a-2674-44da-9a8b-1422a0698843 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:35.802388 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985a92a-2674-44da-9a8b-1422a0698843 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:35.802666 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985a92a-2674-44da-9a8b-1422a0698843 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:35.869146 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5985a92a-2674-44da-9a8b-1422a0698843 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:35.870537 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5985a92a-2674-44da-9a8b-1422a0698843 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:35.956891 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:35.967402 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 655/1282] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Sep 7 15:46:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 15:46:35.973277 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd41e8-4242-4da6-8840-f27ec7640200 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:36.033049 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:36.077240 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd41e8-4242-4da6-8840-f27ec7640200 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:36.112906 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91441ff0-e3d2-4a75-9b4b-f020e62ecc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:36.113533 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91441ff0-e3d2-4a75-9b4b-f020e62ecc72 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:36.113817 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91441ff0-e3d2-4a75-9b4b-f020e62ecc72 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:36.114094 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91441ff0-e3d2-4a75-9b4b-f020e62ecc72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:36.124599 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91441ff0-e3d2-4a75-9b4b-f020e62ecc72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:36.125977 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91441ff0-e3d2-4a75-9b4b-f020e62ecc72 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:36.141033 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-91441ff0-e3d2-4a75-9b4b-f020e62ecc72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:46:36.141033 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:46:36.141033 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:46:36.141033 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:46:36.141033 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:46:36.141033 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:46:36.141033 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:46:36.141033 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:46:36.141033 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:46:36.141033 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:46:36.141033 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:46:36.141033 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:46:36.141033 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 15:46:36.141033 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 15:46:36.141033 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 15:46:36.141033 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 15:46:36.142123 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:46:36.142123 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:46:36.142123 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:46:36.142123 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:46:36.142123 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:46:36.142123 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:46:36.142123 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:46:36.142123 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:46:36.142123 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:46:36.142123 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:46:36.142123 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:46:36.142123 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:46:36.142123 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:46:36.142123 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:46:36.142123 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:46:36.142123 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:46:36.142123 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 15:46:36.143520 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 15:46:36.143520 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 15:46:36.143520 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:46:36.143520 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 628/1283] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:46:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:46:36.147852 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5985a92a-2674-44da-9a8b-1422a0698843 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:36.245917 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5985a92a-2674-44da-9a8b-1422a0698843 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:36.279582 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05451f5c-fd92-49cc-9bdf-0c0bf50039f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:36.280181 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05451f5c-fd92-49cc-9bdf-0c0bf50039f2 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:36.280463 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05451f5c-fd92-49cc-9bdf-0c0bf50039f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:36.280739 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05451f5c-fd92-49cc-9bdf-0c0bf50039f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:36.281371 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05451f5c-fd92-49cc-9bdf-0c0bf50039f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:46:36.281675 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05451f5c-fd92-49cc-9bdf-0c0bf50039f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:36.283060 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05451f5c-fd92-49cc-9bdf-0c0bf50039f2 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:36.294762 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 656/1284] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Sep 7 15:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:46:36.300355 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91441ff0-e3d2-4a75-9b4b-f020e62ecc72 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:36.397904 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91441ff0-e3d2-4a75-9b4b-f020e62ecc72 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:36.411078 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:36.435027 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27470437-9a08-4494-939e-ea7bdccb1c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:36.435648 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27470437-9a08-4494-939e-ea7bdccb1c75 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:36.435933 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27470437-9a08-4494-939e-ea7bdccb1c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:36.436201 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27470437-9a08-4494-939e-ea7bdccb1c75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:36.443151 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27470437-9a08-4494-939e-ea7bdccb1c75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:36.444602 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27470437-9a08-4494-939e-ea7bdccb1c75 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:36.456618 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application [None req-27470437-9a08-4494-939e-ea7bdccb1c75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:46:36.456618 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:46:36.456618 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:46:36.456618 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:46:36.456618 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:46:36.456618 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:46:36.456618 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:46:36.456618 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:46:36.456618 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:46:36.456618 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:46:36.456618 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:46:36.456618 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:46:36.456618 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 15:46:36.456618 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 15:46:36.456618 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 15:46:36.457682 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 15:46:36.457682 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:46:36.457682 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:46:36.457682 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:46:36.457682 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:46:36.457682 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:46:36.457682 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:46:36.457682 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:46:36.457682 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application with Lock( Sep 07 15:46:36.457682 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:46:36.457682 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:46:36.457682 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:46:36.457682 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:46:36.457682 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:46:36.457682 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:46:36.457682 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:46:36.457682 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:46:36.458672 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 15:46:36.458672 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 15:46:36.458672 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 15:46:36.458672 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 15:46:36.458672 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 15:46:36.458672 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 15:46:36.458672 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 15:46:36.458672 dv-cinder-853315-8-smb devstack@keystone.service[81502]: ERROR keystone.server.flask.application Sep 07 15:46:36.458672 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 629/1285] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Sep 7 15:46:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:46:36.463855 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05451f5c-fd92-49cc-9bdf-0c0bf50039f2 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:36.514253 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:36.564936 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05451f5c-fd92-49cc-9bdf-0c0bf50039f2 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:36.597192 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aeac42-1e9f-4a87-92b2-d650d2a0b642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:36.597782 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aeac42-1e9f-4a87-92b2-d650d2a0b642 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:36.598059 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aeac42-1e9f-4a87-92b2-d650d2a0b642 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:36.598356 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aeac42-1e9f-4a87-92b2-d650d2a0b642 None admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:36.599033 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aeac42-1e9f-4a87-92b2-d650d2a0b642 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:46:36.599335 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aeac42-1e9f-4a87-92b2-d650d2a0b642 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:36.600746 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aeac42-1e9f-4a87-92b2-d650d2a0b642 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:36.612991 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 657/1286] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Sep 7 15:46:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:46:36.620033 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27470437-9a08-4494-939e-ea7bdccb1c75 None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:36.716024 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27470437-9a08-4494-939e-ea7bdccb1c75 None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:36.748585 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d4a9d1-cd7d-4824-bf59-c2e53195a9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:36.749181 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4a9d1-cd7d-4824-bf59-c2e53195a9ab None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:36.749457 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4a9d1-cd7d-4824-bf59-c2e53195a9ab None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:36.749728 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4a9d1-cd7d-4824-bf59-c2e53195a9ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:36.750525 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d4a9d1-cd7d-4824-bf59-c2e53195a9ab None admin] RBAC: Adding query filter params (role.id=61605ebf17e643258730e55bf6db15ad, scope.project.id=488830167943488f85743236584113d7, user.id=66c270b488024605af84e52d874474e9) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:46:36.750829 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d4a9d1-cd7d-4824-bf59-c2e53195a9ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:36.752246 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d4a9d1-cd7d-4824-bf59-c2e53195a9ab None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:36.758701 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 630/1287] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Sep 7 15:46:36 2022] GET /identity/v3/role_assignments?user.id=66c270b488024605af84e52d874474e9&scope.project.id=488830167943488f85743236584113d7&role.id=61605ebf17e643258730e55bf6db15ad => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:46:38.909892 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf134d-97d3-45be-b366-5535815f0016 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:38.910488 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf134d-97d3-45be-b366-5535815f0016 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:38.910488 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf134d-97d3-45be-b366-5535815f0016 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:38.911795 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 658/1288] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:46:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:46:38.917286 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea3f77-c50c-4892-aa64-2093135796ef None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:38.917665 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea3f77-c50c-4892-aa64-2093135796ef None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:38.917843 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea3f77-c50c-4892-aa64-2093135796ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:38.936490 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-80ea3f77-c50c-4892-aa64-2093135796ef None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:46:38.937692 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-80ea3f77-c50c-4892-aa64-2093135796ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:46:38.967058 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:39.003845 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 631/1289] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:46:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:46:39.273373 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf134d-97d3-45be-b366-5535815f0016 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:39.377913 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf134d-97d3-45be-b366-5535815f0016 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:39.392927 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:39.421496 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37840d-4574-4b2b-9290-42eae91c82d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:39.422012 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37840d-4574-4b2b-9290-42eae91c82d6 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:39.422326 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37840d-4574-4b2b-9290-42eae91c82d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:39.422605 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37840d-4574-4b2b-9290-42eae91c82d6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:39.423187 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37840d-4574-4b2b-9290-42eae91c82d6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:39.424550 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37840d-4574-4b2b-9290-42eae91c82d6 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:39.434649 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-de37840d-4574-4b2b-9290-42eae91c82d6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 15:46:39.434649 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:46:39.434649 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 15:46:39.434649 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 15:46:39.434649 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 15:46:39.434649 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 15:46:39.434649 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 15:46:39.434649 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:46:39.434649 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 15:46:39.434649 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:46:39.434649 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:46:39.434649 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:46:39.434649 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:46:39.434649 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:46:39.434649 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:46:39.434649 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:46:39.434649 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:46:39.435899 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:46:39.435899 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:46:39.435899 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:46:39.435899 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:46:39.435899 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:46:39.435899 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:46:39.435899 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 15:46:39.435899 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 15:46:39.435899 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 15:46:39.435899 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 15:46:39.435899 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:46:39.435899 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:46:39.435899 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:46:39.435899 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:46:39.435899 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:46:39.435899 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:46:39.436956 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:46:39.436956 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:46:39.436956 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:46:39.436956 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:46:39.436956 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:46:39.436956 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:46:39.436956 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:46:39.436956 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:46:39.436956 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:46:39.436956 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:46:39.436956 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 15:46:39.436956 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:46:39.436956 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 15:46:39.436956 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:46:39.436956 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 659/1290] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Sep 7 15:46:39 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:46:39.442194 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea3f77-c50c-4892-aa64-2093135796ef None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:39.539936 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea3f77-c50c-4892-aa64-2093135796ef None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:39.572624 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1422ab65-9298-4d37-854e-5a4be4aae2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:39.573221 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422ab65-9298-4d37-854e-5a4be4aae2a1 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:39.573502 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422ab65-9298-4d37-854e-5a4be4aae2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:39.573777 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422ab65-9298-4d37-854e-5a4be4aae2a1 None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:39.574432 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1422ab65-9298-4d37-854e-5a4be4aae2a1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:46:39.574737 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1422ab65-9298-4d37-854e-5a4be4aae2a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:39.576114 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1422ab65-9298-4d37-854e-5a4be4aae2a1 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:39.580750 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 632/1291] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Sep 7 15:46:39 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:46:39.586509 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37840d-4574-4b2b-9290-42eae91c82d6 None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:39.684917 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37840d-4574-4b2b-9290-42eae91c82d6 None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:39.718902 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f05fb0-5af3-4089-b98e-970efe098ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:39.719508 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f05fb0-5af3-4089-b98e-970efe098ce6 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:39.719790 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f05fb0-5af3-4089-b98e-970efe098ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:39.720063 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f05fb0-5af3-4089-b98e-970efe098ce6 None admin] PATH_INFO: `/v3/services` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:39.720687 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f05fb0-5af3-4089-b98e-970efe098ce6 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:46:39.720990 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f05fb0-5af3-4089-b98e-970efe098ce6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:39.722383 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f05fb0-5af3-4089-b98e-970efe098ce6 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:39.728187 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 660/1292] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Sep 7 15:46:39 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:46:41.913385 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989c2bb-ba6b-40c8-bf76-9e9bba28b08b None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:41.914025 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989c2bb-ba6b-40c8-bf76-9e9bba28b08b None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:41.914434 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989c2bb-ba6b-40c8-bf76-9e9bba28b08b None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:41.915792 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 633/1293] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:46:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:46:41.921165 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fca068-fb07-42c8-8e60-3937c99063ac None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:41.921577 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fca068-fb07-42c8-8e60-3937c99063ac None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:41.921723 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fca068-fb07-42c8-8e60-3937c99063ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:41.940284 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-e8fca068-fb07-42c8-8e60-3937c99063ac None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:46:41.941465 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-e8fca068-fb07-42c8-8e60-3937c99063ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:46:41.970737 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:42.008566 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 661/1294] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:46:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:46:42.279551 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989c2bb-ba6b-40c8-bf76-9e9bba28b08b None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:42.311705 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:42.384139 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989c2bb-ba6b-40c8-bf76-9e9bba28b08b None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:42.431379 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1456c-f869-49fb-9594-45212508ba2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:42.431993 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1456c-f869-49fb-9594-45212508ba2f None admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:42.432276 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1456c-f869-49fb-9594-45212508ba2f None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:42.432555 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1456c-f869-49fb-9594-45212508ba2f None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:42.433197 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a1456c-f869-49fb-9594-45212508ba2f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:42.434594 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a1456c-f869-49fb-9594-45212508ba2f None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:42.454221 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 634/1295] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Sep 7 15:46:42 2022] POST /identity/v3/services => generated 246 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:46:44.605891 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88e677-e627-4446-8d55-9f6bf65dcc04 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:44.606500 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88e677-e627-4446-8d55-9f6bf65dcc04 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:44.606500 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88e677-e627-4446-8d55-9f6bf65dcc04 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:44.607800 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 662/1296] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:46:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:46:44.613274 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b02a2b-5a5a-4c2c-8ca6-fb09d235429c None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:44.613708 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b02a2b-5a5a-4c2c-8ca6-fb09d235429c None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:44.613826 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b02a2b-5a5a-4c2c-8ca6-fb09d235429c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:44.631859 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-d3b02a2b-5a5a-4c2c-8ca6-fb09d235429c None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:46:44.633652 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-d3b02a2b-5a5a-4c2c-8ca6-fb09d235429c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:46:44.702967 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 635/1297] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:46:44 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:46:44.970682 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88e677-e627-4446-8d55-9f6bf65dcc04 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:45.071068 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88e677-e627-4446-8d55-9f6bf65dcc04 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:45.104090 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8f1f7-b78e-470e-9c2c-e64544cae9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:45.104702 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8f1f7-b78e-470e-9c2c-e64544cae9ed None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:45.104983 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8f1f7-b78e-470e-9c2c-e64544cae9ed None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:45.105254 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8f1f7-b78e-470e-9c2c-e64544cae9ed None admin] PATH_INFO: `/v3/services/placement` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:45.105826 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd8f1f7-b78e-470e-9c2c-e64544cae9ed None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:45.107217 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd8f1f7-b78e-470e-9c2c-e64544cae9ed None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:45.115973 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-cfd8f1f7-b78e-470e-9c2c-e64544cae9ed None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 15:46:45.115973 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:46:45.115973 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 15:46:45.115973 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 15:46:45.115973 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 15:46:45.115973 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 15:46:45.115973 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 15:46:45.115973 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:46:45.115973 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 15:46:45.115973 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:46:45.115973 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:46:45.115973 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:46:45.115973 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:46:45.115973 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:46:45.115973 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:46:45.115973 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:46:45.115973 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:46:45.117489 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:46:45.117489 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:46:45.117489 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:46:45.117489 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:46:45.117489 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:46:45.117489 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:46:45.117489 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 15:46:45.117489 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 15:46:45.117489 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 15:46:45.117489 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 15:46:45.117489 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:46:45.117489 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:46:45.117489 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:46:45.117489 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:46:45.117489 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:46:45.117489 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:46:45.118458 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:46:45.118458 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:46:45.118458 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:46:45.118458 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:46:45.118458 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:46:45.118458 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:46:45.118458 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:46:45.118458 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:46:45.118458 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:46:45.118458 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:46:45.118458 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 15:46:45.118458 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:46:45.118458 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 15:46:45.118458 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:46:45.118458 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 663/1298] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Sep 7 15:46:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:46:45.123672 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b02a2b-5a5a-4c2c-8ca6-fb09d235429c None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:45.141895 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:45.218889 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b02a2b-5a5a-4c2c-8ca6-fb09d235429c None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:45.251554 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483d94e-525d-4cb0-9dea-76fd1d29f3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:45.252089 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483d94e-525d-4cb0-9dea-76fd1d29f3be None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:45.252373 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483d94e-525d-4cb0-9dea-76fd1d29f3be None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:45.252644 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483d94e-525d-4cb0-9dea-76fd1d29f3be None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:45.253260 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b483d94e-525d-4cb0-9dea-76fd1d29f3be None admin] RBAC: Adding query filter params (name=placement) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:46:45.253559 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b483d94e-525d-4cb0-9dea-76fd1d29f3be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:45.254938 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b483d94e-525d-4cb0-9dea-76fd1d29f3be None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:45.259986 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 636/1299] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Sep 7 15:46:45 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:46:45.265950 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8f1f7-b78e-470e-9c2c-e64544cae9ed None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:45.297388 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:45.364881 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8f1f7-b78e-470e-9c2c-e64544cae9ed None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:45.399104 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a54fa4-4d3f-4c2f-87f6-41fe3069dd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:45.399704 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a54fa4-4d3f-4c2f-87f6-41fe3069dd82 None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:45.399978 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a54fa4-4d3f-4c2f-87f6-41fe3069dd82 None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:45.400250 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a54fa4-4d3f-4c2f-87f6-41fe3069dd82 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:45.400944 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a54fa4-4d3f-4c2f-87f6-41fe3069dd82 None admin] RBAC: Adding query filter params (interface=public, service_id=a15f3e4b2bdd412cad13df95cdad3506, region_id=RegionOne) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:46:45.401247 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a54fa4-4d3f-4c2f-87f6-41fe3069dd82 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:45.402655 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a54fa4-4d3f-4c2f-87f6-41fe3069dd82 None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:45.407887 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 664/1300] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Sep 7 15:46:45 2022] GET /identity/v3/endpoints?service_id=a15f3e4b2bdd412cad13df95cdad3506&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:46:45.414381 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483d94e-525d-4cb0-9dea-76fd1d29f3be None admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:45.503732 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:45.522395 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483d94e-525d-4cb0-9dea-76fd1d29f3be None admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:45.556942 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd0252-9548-43bd-913d-915dc9ed6743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:45.557540 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd0252-9548-43bd-913d-915dc9ed6743 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:45.557824 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd0252-9548-43bd-913d-915dc9ed6743 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:45.558100 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd0252-9548-43bd-913d-915dc9ed6743 None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:45.558730 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd0252-9548-43bd-913d-915dc9ed6743 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:45.560093 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd0252-9548-43bd-913d-915dc9ed6743 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:45.566943 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 637/1301] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Sep 7 15:46:45 2022] GET /identity/v3/services => generated 2191 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:46:47.718780 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a521f7-2103-475d-bebd-772750d7ae3e None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:47.719335 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a521f7-2103-475d-bebd-772750d7ae3e None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:47.719335 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a521f7-2103-475d-bebd-772750d7ae3e None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:47.720655 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 665/1302] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:46:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:46:47.726506 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac38abf-d607-44e2-9a2c-c4b16e28071e None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:47.726910 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac38abf-d607-44e2-9a2c-c4b16e28071e None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:47.727061 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac38abf-d607-44e2-9a2c-c4b16e28071e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:47.746381 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-8ac38abf-d607-44e2-9a2c-c4b16e28071e None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:46:47.747576 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-8ac38abf-d607-44e2-9a2c-c4b16e28071e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:46:47.812913 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 638/1303] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:46:47 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 15:46:48.084364 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a521f7-2103-475d-bebd-772750d7ae3e None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:48.178694 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:48.185676 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a521f7-2103-475d-bebd-772750d7ae3e None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:48.218584 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc4e7f-0c0b-4fb6-92cc-59630ced2daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:48.219201 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc4e7f-0c0b-4fb6-92cc-59630ced2daa None admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:48.219481 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc4e7f-0c0b-4fb6-92cc-59630ced2daa None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:48.219756 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc4e7f-0c0b-4fb6-92cc-59630ced2daa None admin] PATH_INFO: `/v3/services/placement` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:48.220328 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc4e7f-0c0b-4fb6-92cc-59630ced2daa None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:48.221683 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc4e7f-0c0b-4fb6-92cc-59630ced2daa None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:48.231062 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application [None req-1cbc4e7f-0c0b-4fb6-92cc-59630ced2daa None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 15:46:48.231062 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:46:48.231062 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 15:46:48.231062 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 15:46:48.231062 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 15:46:48.231062 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 15:46:48.231062 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 15:46:48.231062 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:46:48.231062 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 15:46:48.231062 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:46:48.231062 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 15:46:48.231062 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:46:48.231062 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 15:46:48.231062 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 15:46:48.231062 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 15:46:48.231062 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 15:46:48.231062 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 15:46:48.232205 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 15:46:48.232205 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 15:46:48.232205 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 15:46:48.232205 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 15:46:48.232205 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 15:46:48.232205 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 15:46:48.232205 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 15:46:48.232205 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 15:46:48.232205 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 15:46:48.232205 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 15:46:48.232205 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 15:46:48.232205 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 15:46:48.232205 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 15:46:48.232205 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 15:46:48.232205 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 15:46:48.232205 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 15:46:48.233400 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 15:46:48.233400 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application with Lock( Sep 07 15:46:48.233400 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 15:46:48.233400 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self._enter() Sep 07 15:46:48.233400 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 15:46:48.233400 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 15:46:48.233400 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 15:46:48.233400 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application return self.creator() Sep 07 15:46:48.233400 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 15:46:48.233400 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application created_value = creator( Sep 07 15:46:48.233400 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 15:46:48.233400 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 15:46:48.233400 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 15:46:48.233400 dv-cinder-853315-8-smb devstack@keystone.service[81501]: ERROR keystone.server.flask.application Sep 07 15:46:48.233400 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 666/1304] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Sep 7 15:46:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 15:46:48.238323 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac38abf-d607-44e2-9a2c-c4b16e28071e None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:48.312425 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:48.334986 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac38abf-d607-44e2-9a2c-c4b16e28071e None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:48.368023 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b24f656-3f68-4fe1-9d97-80544d970142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:48.368610 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24f656-3f68-4fe1-9d97-80544d970142 None admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:48.368889 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24f656-3f68-4fe1-9d97-80544d970142 None admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:48.369157 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24f656-3f68-4fe1-9d97-80544d970142 None admin] PATH_INFO: `/v3/services` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:48.369773 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b24f656-3f68-4fe1-9d97-80544d970142 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:46:48.370071 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b24f656-3f68-4fe1-9d97-80544d970142 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:48.371460 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b24f656-3f68-4fe1-9d97-80544d970142 None admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:48.376328 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 639/1305] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Sep 7 15:46:48 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:46:48.382510 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc4e7f-0c0b-4fb6-92cc-59630ced2daa None admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:46:48.481218 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc4e7f-0c0b-4fb6-92cc-59630ced2daa None admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:46:48.514436 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6533fee-fee3-49da-af9e-6d63b5e4665a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:46:48.515029 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6533fee-fee3-49da-af9e-6d63b5e4665a None admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:46:48.515309 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6533fee-fee3-49da-af9e-6d63b5e4665a None admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:46:48.515586 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6533fee-fee3-49da-af9e-6d63b5e4665a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:46:48.516232 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6533fee-fee3-49da-af9e-6d63b5e4665a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:46:48.517587 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6533fee-fee3-49da-af9e-6d63b5e4665a None admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:46:48.536412 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 667/1306] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:46:48 2022] POST /identity/v3/endpoints => generated 331 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:46:58.374286 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=30 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:46:58.532210 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:47:52.302150 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97733c-6f76-401a-b25e-2e7e90f9a390 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:47:52.303517 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97733c-6f76-401a-b25e-2e7e90f9a390 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:47:52.303806 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97733c-6f76-401a-b25e-2e7e90f9a390 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:47:52.305318 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 640/1307] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:47:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:47:52.311240 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa4d9b-584f-4d4f-a943-fc59c5f1ef93 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:47:52.311708 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa4d9b-584f-4d4f-a943-fc59c5f1ef93 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:47:52.311800 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa4d9b-584f-4d4f-a943-fc59c5f1ef93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:47:52.457133 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-f4aa4d9b-584f-4d4f-a943-fc59c5f1ef93 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:47:52.458917 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-f4aa4d9b-584f-4d4f-a943-fc59c5f1ef93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:47:52.616731 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 668/1308] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:47:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:47:52.930713 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7e98e-d4c1-4eae-8a40-0159cb99060e None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:47:52.931362 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7e98e-d4c1-4eae-8a40-0159cb99060e None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:47:52.931873 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7e98e-d4c1-4eae-8a40-0159cb99060e None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:47:52.933767 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 641/1309] 10.222.0.16 () {54 vars in 965 bytes} [Wed Sep 7 15:47:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:47:52.940218 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bbcca8-45cf-4357-8471-319272119f31 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:47:52.940503 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bbcca8-45cf-4357-8471-319272119f31 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:47:52.940779 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bbcca8-45cf-4357-8471-319272119f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:47:53.040990 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-98bbcca8-45cf-4357-8471-319272119f31 None None] MFA Rules not processed for user `3195fa62961c4d64972b88449d013380`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:47:53.042670 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-98bbcca8-45cf-4357-8471-319272119f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:47:53.071332 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:47:53.149591 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7e98e-d4c1-4eae-8a40-0159cb99060e None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:47:53.152566 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-04f7e98e-d4c1-4eae-8a40-0159cb99060e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:47:53.157525 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 669/1310] 10.222.0.16 () {58 vars in 1062 bytes} [Wed Sep 7 15:47:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:47:53.292676 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7e98e-d4c1-4eae-8a40-0159cb99060e None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:47:53.385142 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a7871-2a1d-4abc-8719-95b0e305b22d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:47:53.387071 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a7871-2a1d-4abc-8719-95b0e305b22d service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:47:53.387591 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a7871-2a1d-4abc-8719-95b0e305b22d service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:47:53.388197 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a7871-2a1d-4abc-8719-95b0e305b22d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:47:53.390333 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-014a7871-2a1d-4abc-8719-95b0e305b22d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:47:53.459109 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:47:53.518118 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a7871-2a1d-4abc-8719-95b0e305b22d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:47:53.519600 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a7871-2a1d-4abc-8719-95b0e305b22d service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:47:53.540067 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 642/1311] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:47:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 15:47:56.039751 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6c031-e52e-466e-b342-2f219a347c4b None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:47:56.040250 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6c031-e52e-466e-b342-2f219a347c4b None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:47:56.040349 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6c031-e52e-466e-b342-2f219a347c4b None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:47:56.041710 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 670/1312] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:47:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:47:56.047075 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954eea53-fa23-4c49-b4ee-45dd42d7cd67 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:47:56.047472 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954eea53-fa23-4c49-b4ee-45dd42d7cd67 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:47:56.047636 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954eea53-fa23-4c49-b4ee-45dd42d7cd67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:47:56.120768 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-954eea53-fa23-4c49-b4ee-45dd42d7cd67 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:47:56.122012 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-954eea53-fa23-4c49-b4ee-45dd42d7cd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:47:56.221540 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 643/1313] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:47:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:47:56.502060 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6c031-e52e-466e-b342-2f219a347c4b None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:47:56.503624 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-2ab6c031-e52e-466e-b342-2f219a347c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:47:56.606874 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6c031-e52e-466e-b342-2f219a347c4b None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:47:56.675964 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:47:56.678266 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c7275-6271-436f-ae2d-bc965448a2db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:47:56.678883 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c7275-6271-436f-ae2d-bc965448a2db service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:47:56.679350 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c7275-6271-436f-ae2d-bc965448a2db service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:47:56.679841 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c7275-6271-436f-ae2d-bc965448a2db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:47:56.681660 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-8a7c7275-6271-436f-ae2d-bc965448a2db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:47:56.807472 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7c7275-6271-436f-ae2d-bc965448a2db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:47:56.808821 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7c7275-6271-436f-ae2d-bc965448a2db service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:47:56.827349 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 671/1314] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:47:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:47:59.259126 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f8568-a4b0-4ac9-91dd-f5e1f61942b8 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:47:59.259684 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f8568-a4b0-4ac9-91dd-f5e1f61942b8 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:47:59.259684 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f8568-a4b0-4ac9-91dd-f5e1f61942b8 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:47:59.261000 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 644/1315] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:47:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:47:59.266058 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc7b0f-52ac-4873-b0f5-aebe8785b8ef None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:47:59.266489 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc7b0f-52ac-4873-b0f5-aebe8785b8ef None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:47:59.266637 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc7b0f-52ac-4873-b0f5-aebe8785b8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:47:59.331482 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-f6dc7b0f-52ac-4873-b0f5-aebe8785b8ef None None] MFA Rules not processed for user `00b45084548b49ba9aed5a6091a253ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:47:59.332601 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-f6dc7b0f-52ac-4873-b0f5-aebe8785b8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:47:59.383958 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:47:59.430754 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 672/1316] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:47:59 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:47:59.711630 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f8568-a4b0-4ac9-91dd-f5e1f61942b8 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:47:59.713183 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-4c1f8568-a4b0-4ac9-91dd-f5e1f61942b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:47:59.723067 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:47:59.818380 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f8568-a4b0-4ac9-91dd-f5e1f61942b8 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:47:59.892114 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe306b4-ac79-4ddc-8bf6-13ba0bd59a95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:47:59.892719 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe306b4-ac79-4ddc-8bf6-13ba0bd59a95 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:47:59.893005 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe306b4-ac79-4ddc-8bf6-13ba0bd59a95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:47:59.893280 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe306b4-ac79-4ddc-8bf6-13ba0bd59a95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:47:59.894905 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-efe306b4-ac79-4ddc-8bf6-13ba0bd59a95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:47:59.957673 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:48:00.006154 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe306b4-ac79-4ddc-8bf6-13ba0bd59a95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:48:00.007631 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe306b4-ac79-4ddc-8bf6-13ba0bd59a95 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:48:00.026073 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 645/1317] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:47:59 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:48:02.697856 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d83b71-3629-489d-b1b9-a7208364923e None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:48:02.698490 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d83b71-3629-489d-b1b9-a7208364923e None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:48:02.698490 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d83b71-3629-489d-b1b9-a7208364923e None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:48:02.699744 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 673/1318] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:48:02.705085 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a27b1-ba71-402a-8773-6eb8a24d9285 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:48:02.705526 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a27b1-ba71-402a-8773-6eb8a24d9285 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:48:02.705633 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a27b1-ba71-402a-8773-6eb8a24d9285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:48:02.771189 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-3d9a27b1-ba71-402a-8773-6eb8a24d9285 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:48:02.772391 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-3d9a27b1-ba71-402a-8773-6eb8a24d9285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:48:02.868064 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 646/1319] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:48:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:48:03.156965 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d83b71-3629-489d-b1b9-a7208364923e None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:48:03.158527 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-67d83b71-3629-489d-b1b9-a7208364923e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:48:03.260763 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d83b71-3629-489d-b1b9-a7208364923e None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:48:03.332548 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df840e90-1e1b-4449-b42c-c29aa3304c15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:48:03.333093 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df840e90-1e1b-4449-b42c-c29aa3304c15 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:48:03.333371 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df840e90-1e1b-4449-b42c-c29aa3304c15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:48:03.333645 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df840e90-1e1b-4449-b42c-c29aa3304c15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:48:03.335243 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-df840e90-1e1b-4449-b42c-c29aa3304c15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:48:03.342500 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:48:03.444511 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df840e90-1e1b-4449-b42c-c29aa3304c15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:48:03.445951 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df840e90-1e1b-4449-b42c-c29aa3304c15 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:48:03.465462 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 674/1320] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:48:03 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:48:06.242955 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b578d02-39d5-467c-980c-6d5859a30399 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:48:06.243479 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b578d02-39d5-467c-980c-6d5859a30399 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:48:06.243598 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b578d02-39d5-467c-980c-6d5859a30399 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:48:06.244873 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 647/1321] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:48:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:48:06.250237 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f05d23-057c-49e1-a761-63cdaa303403 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:48:06.250671 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f05d23-057c-49e1-a761-63cdaa303403 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:48:06.250767 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f05d23-057c-49e1-a761-63cdaa303403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:48:06.322774 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-82f05d23-057c-49e1-a761-63cdaa303403 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:48:06.323934 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-82f05d23-057c-49e1-a761-63cdaa303403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:48:06.387540 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:48:06.434906 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 675/1322] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:48:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:48:06.737137 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ee4b9-1c32-460c-af2a-e9bbb8e2b3a5 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:48:06.737537 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ee4b9-1c32-460c-af2a-e9bbb8e2b3a5 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:48:06.737919 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ee4b9-1c32-460c-af2a-e9bbb8e2b3a5 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:48:06.739441 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 648/1323] 10.222.0.16 () {54 vars in 965 bytes} [Wed Sep 7 15:48:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:48:06.745648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef42870-6485-496f-8cc1-abe404d88151 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:48:06.745956 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef42870-6485-496f-8cc1-abe404d88151 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:48:06.746257 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef42870-6485-496f-8cc1-abe404d88151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:48:06.822141 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-cef42870-6485-496f-8cc1-abe404d88151 None None] MFA Rules not processed for user `3195fa62961c4d64972b88449d013380`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:48:06.823358 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-cef42870-6485-496f-8cc1-abe404d88151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:48:06.897740 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 676/1324] 10.222.0.16 () {58 vars in 1062 bytes} [Wed Sep 7 15:48:06 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:48:06.906826 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ee4b9-1c32-460c-af2a-e9bbb8e2b3a5 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:48:06.908340 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-034ee4b9-1c32-460c-af2a-e9bbb8e2b3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:48:06.928500 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:48:07.012280 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ee4b9-1c32-460c-af2a-e9bbb8e2b3a5 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:48:07.087071 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab33d9-1e5c-42aa-b58a-95b134db6134 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:48:07.087675 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab33d9-1e5c-42aa-b58a-95b134db6134 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:48:07.087955 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab33d9-1e5c-42aa-b58a-95b134db6134 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:48:07.088224 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab33d9-1e5c-42aa-b58a-95b134db6134 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:48:07.089811 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-2cab33d9-1e5c-42aa-b58a-95b134db6134 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:48:07.168045 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:48:07.206541 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab33d9-1e5c-42aa-b58a-95b134db6134 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:48:07.208042 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab33d9-1e5c-42aa-b58a-95b134db6134 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:48:07.226837 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 649/1325] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:48:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:48:09.675143 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528acf0-ff4c-4610-a801-973e61bdc622 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:48:09.675672 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528acf0-ff4c-4610-a801-973e61bdc622 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:48:09.675672 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528acf0-ff4c-4610-a801-973e61bdc622 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:48:09.676957 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 677/1326] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:48:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:48:09.682260 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57936704-9c15-4c00-88d8-6e14427a8de8 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:48:09.682710 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57936704-9c15-4c00-88d8-6e14427a8de8 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:48:09.682806 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57936704-9c15-4c00-88d8-6e14427a8de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:48:09.749395 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-57936704-9c15-4c00-88d8-6e14427a8de8 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:48:09.750622 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-57936704-9c15-4c00-88d8-6e14427a8de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:48:09.848704 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 650/1327] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:48:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:48:10.129873 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528acf0-ff4c-4610-a801-973e61bdc622 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:48:10.131728 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-b528acf0-ff4c-4610-a801-973e61bdc622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:48:10.194254 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:48:10.238597 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528acf0-ff4c-4610-a801-973e61bdc622 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:48:10.312265 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee47427-3c53-4ea0-bc94-d15fcb169d37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:48:10.312784 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee47427-3c53-4ea0-bc94-d15fcb169d37 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:48:10.313064 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee47427-3c53-4ea0-bc94-d15fcb169d37 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:48:10.313341 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee47427-3c53-4ea0-bc94-d15fcb169d37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:48:10.314970 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-fee47427-3c53-4ea0-bc94-d15fcb169d37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:48:10.424668 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:48:10.427717 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee47427-3c53-4ea0-bc94-d15fcb169d37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:48:10.429682 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee47427-3c53-4ea0-bc94-d15fcb169d37 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:48:10.448721 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 678/1328] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:48:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:48:12.709877 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea1de0-063b-43a7-9230-b06463954388 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:48:12.710368 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea1de0-063b-43a7-9230-b06463954388 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:48:12.710488 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea1de0-063b-43a7-9230-b06463954388 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:48:12.711878 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 651/1329] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:48:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:48:12.717558 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf6320-8fa8-4bb8-8105-8231f992f60e None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:48:12.718031 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf6320-8fa8-4bb8-8105-8231f992f60e None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:48:12.718144 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf6320-8fa8-4bb8-8105-8231f992f60e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:48:12.790853 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-59cf6320-8fa8-4bb8-8105-8231f992f60e None None] MFA Rules not processed for user `00b45084548b49ba9aed5a6091a253ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:48:12.792915 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-59cf6320-8fa8-4bb8-8105-8231f992f60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:48:12.906394 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 679/1330] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:48:12 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:48:13.210946 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea1de0-063b-43a7-9230-b06463954388 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:48:13.212534 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-3dea1de0-063b-43a7-9230-b06463954388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:48:13.246126 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:48:13.324530 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea1de0-063b-43a7-9230-b06463954388 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:48:13.403758 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f141bfd-9388-47a7-94a9-ab1512eab401 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:48:13.404473 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f141bfd-9388-47a7-94a9-ab1512eab401 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:48:13.404755 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f141bfd-9388-47a7-94a9-ab1512eab401 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:48:13.405029 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f141bfd-9388-47a7-94a9-ab1512eab401 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:48:13.406668 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-2f141bfd-9388-47a7-94a9-ab1512eab401 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:48:13.495217 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:48:13.529878 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f141bfd-9388-47a7-94a9-ab1512eab401 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:48:13.531358 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f141bfd-9388-47a7-94a9-ab1512eab401 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:48:13.551107 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 652/1331] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:48:13 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:48:16.024563 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811554e4-81c1-4adb-b68f-59c458c591ef None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:48:16.025104 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811554e4-81c1-4adb-b68f-59c458c591ef None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:48:16.025104 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811554e4-81c1-4adb-b68f-59c458c591ef None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:48:16.026554 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 680/1332] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:48:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:48:16.031703 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd4cc3-689f-4bba-a839-704ce99b4a83 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:48:16.032116 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd4cc3-689f-4bba-a839-704ce99b4a83 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:48:16.032254 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd4cc3-689f-4bba-a839-704ce99b4a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:48:16.097139 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-a4cd4cc3-689f-4bba-a839-704ce99b4a83 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:48:16.099069 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-a4cd4cc3-689f-4bba-a839-704ce99b4a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:48:16.194109 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 653/1333] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:48:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:48:16.476490 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811554e4-81c1-4adb-b68f-59c458c591ef None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:48:16.478030 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-811554e4-81c1-4adb-b68f-59c458c591ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:48:16.549095 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:48:16.583964 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811554e4-81c1-4adb-b68f-59c458c591ef None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:48:16.655197 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a9ef8-6e3c-4ead-ad29-0a4527976b68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:48:16.655794 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a9ef8-6e3c-4ead-ad29-0a4527976b68 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:48:16.656070 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a9ef8-6e3c-4ead-ad29-0a4527976b68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:48:16.656339 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a9ef8-6e3c-4ead-ad29-0a4527976b68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:48:16.657907 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-744a9ef8-6e3c-4ead-ad29-0a4527976b68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:48:16.767120 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a9ef8-6e3c-4ead-ad29-0a4527976b68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:48:16.768472 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a9ef8-6e3c-4ead-ad29-0a4527976b68 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:48:16.778794 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:48:16.787482 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 681/1334] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:48:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:48:18.974396 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4291fec-1332-4045-80ad-99bf774efb1e None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:48:18.974952 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4291fec-1332-4045-80ad-99bf774efb1e None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:48:18.974952 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4291fec-1332-4045-80ad-99bf774efb1e None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:48:18.976288 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 654/1335] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:48:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:48:18.981703 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54e72f-afa6-4077-8d4c-8a512161931b None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:48:18.982152 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54e72f-afa6-4077-8d4c-8a512161931b None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:48:18.982275 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54e72f-afa6-4077-8d4c-8a512161931b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:48:19.053069 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-fc54e72f-afa6-4077-8d4c-8a512161931b None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:48:19.054620 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-fc54e72f-afa6-4077-8d4c-8a512161931b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:48:19.152248 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 682/1336] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:48:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:48:19.440355 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4291fec-1332-4045-80ad-99bf774efb1e None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:48:19.442519 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-d4291fec-1332-4045-80ad-99bf774efb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:48:19.482077 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:48:19.546261 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4291fec-1332-4045-80ad-99bf774efb1e None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:48:19.618760 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd1b8a3-8956-4831-b0a7-16cbb4037d22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:48:19.619363 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1b8a3-8956-4831-b0a7-16cbb4037d22 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:48:19.619643 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1b8a3-8956-4831-b0a7-16cbb4037d22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:48:19.619913 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1b8a3-8956-4831-b0a7-16cbb4037d22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:48:19.621510 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-5cd1b8a3-8956-4831-b0a7-16cbb4037d22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:48:19.703204 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:48:19.729504 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd1b8a3-8956-4831-b0a7-16cbb4037d22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:48:19.730960 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd1b8a3-8956-4831-b0a7-16cbb4037d22 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:48:19.749113 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 655/1337] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:48:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:48:22.241453 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1c2ce-49d1-4ba2-bc38-4a975b257553 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:48:22.241978 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1c2ce-49d1-4ba2-bc38-4a975b257553 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:48:22.241978 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1c2ce-49d1-4ba2-bc38-4a975b257553 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:48:22.243348 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 683/1338] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:48:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:48:22.248716 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd46036f-c3cb-4bf2-8e33-82b358dac940 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:48:22.249163 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd46036f-c3cb-4bf2-8e33-82b358dac940 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:48:22.249268 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd46036f-c3cb-4bf2-8e33-82b358dac940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:48:22.316360 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-dd46036f-c3cb-4bf2-8e33-82b358dac940 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:48:22.318274 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-dd46036f-c3cb-4bf2-8e33-82b358dac940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:48:22.415577 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 656/1339] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:48:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:48:22.696418 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1c2ce-49d1-4ba2-bc38-4a975b257553 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:48:22.697942 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-61f1c2ce-49d1-4ba2-bc38-4a975b257553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:48:22.773222 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:48:22.801848 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1c2ce-49d1-4ba2-bc38-4a975b257553 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:48:22.873375 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e18f8-0ca3-484e-9929-bda26239fb38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:48:22.873982 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e18f8-0ca3-484e-9929-bda26239fb38 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:48:22.874296 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e18f8-0ca3-484e-9929-bda26239fb38 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:48:22.874570 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e18f8-0ca3-484e-9929-bda26239fb38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:48:22.876142 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-eb4e18f8-0ca3-484e-9929-bda26239fb38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:48:22.983125 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e18f8-0ca3-484e-9929-bda26239fb38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:48:22.984823 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e18f8-0ca3-484e-9929-bda26239fb38 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:48:23.002836 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 684/1340] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:48:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:48:27.040129 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f492c-72ff-44db-b9f0-ccb6cd13cc70 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:48:27.040611 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f492c-72ff-44db-b9f0-ccb6cd13cc70 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:48:27.040854 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f492c-72ff-44db-b9f0-ccb6cd13cc70 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:48:27.042286 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 657/1341] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:48:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:48:27.047577 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4942e51-b02d-428d-b78f-4901709f0002 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:48:27.048033 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4942e51-b02d-428d-b78f-4901709f0002 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:48:27.048263 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4942e51-b02d-428d-b78f-4901709f0002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:48:27.053877 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:48:27.117534 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-a4942e51-b02d-428d-b78f-4901709f0002 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:48:27.118672 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-a4942e51-b02d-428d-b78f-4901709f0002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:48:27.216615 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 685/1342] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:48:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:48:27.508247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f492c-72ff-44db-b9f0-ccb6cd13cc70 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:48:27.509849 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-7b2f492c-72ff-44db-b9f0-ccb6cd13cc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:48:27.558949 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:48:27.618059 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f492c-72ff-44db-b9f0-ccb6cd13cc70 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:48:27.696708 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c0403-eee0-4574-987a-f26fcbefaeb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:48:27.697314 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c0403-eee0-4574-987a-f26fcbefaeb9 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:48:27.697592 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c0403-eee0-4574-987a-f26fcbefaeb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:48:27.697863 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c0403-eee0-4574-987a-f26fcbefaeb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:48:27.699484 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-551c0403-eee0-4574-987a-f26fcbefaeb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:48:27.793097 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:48:27.810048 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c0403-eee0-4574-987a-f26fcbefaeb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:48:27.811530 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c0403-eee0-4574-987a-f26fcbefaeb9 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:48:27.829804 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 658/1343] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:48:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:48:30.673993 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e7ec9-273b-42d9-b72a-6282d6bdaf3d None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:48:30.674545 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e7ec9-273b-42d9-b72a-6282d6bdaf3d None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:48:30.674545 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e7ec9-273b-42d9-b72a-6282d6bdaf3d None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:48:30.676609 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 686/1344] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:48:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:48:30.681840 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6be195-090c-4937-a7da-28657357d5ba None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:48:30.682266 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6be195-090c-4937-a7da-28657357d5ba None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:48:30.682435 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6be195-090c-4937-a7da-28657357d5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:48:30.749279 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-4f6be195-090c-4937-a7da-28657357d5ba None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:48:30.750509 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-4f6be195-090c-4937-a7da-28657357d5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:48:30.849117 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 659/1345] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:48:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:48:31.139788 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e7ec9-273b-42d9-b72a-6282d6bdaf3d None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:48:31.141333 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-3e9e7ec9-273b-42d9-b72a-6282d6bdaf3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:48:31.236851 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:48:31.253565 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e7ec9-273b-42d9-b72a-6282d6bdaf3d None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:48:31.327821 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e31062-1a96-422c-b67e-6385b57caef2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:48:31.328347 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e31062-1a96-422c-b67e-6385b57caef2 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:48:31.328625 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e31062-1a96-422c-b67e-6385b57caef2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:48:31.328898 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e31062-1a96-422c-b67e-6385b57caef2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:48:31.330510 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-11e31062-1a96-422c-b67e-6385b57caef2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:48:31.449839 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e31062-1a96-422c-b67e-6385b57caef2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:48:31.451400 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e31062-1a96-422c-b67e-6385b57caef2 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:48:31.469004 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 687/1346] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:48:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:48:35.704682 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ac458-4994-45df-bf65-4ad5adb44aee None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:48:35.705248 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ac458-4994-45df-bf65-4ad5adb44aee None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:48:35.705248 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ac458-4994-45df-bf65-4ad5adb44aee None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:48:35.706640 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 660/1347] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:48:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:48:35.712765 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630503e-d9c5-4eb6-8f2c-5b523a2122f4 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:48:35.713198 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630503e-d9c5-4eb6-8f2c-5b523a2122f4 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:48:35.713334 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630503e-d9c5-4eb6-8f2c-5b523a2122f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:48:35.729578 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:48:35.784349 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-b630503e-d9c5-4eb6-8f2c-5b523a2122f4 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:48:35.785922 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-b630503e-d9c5-4eb6-8f2c-5b523a2122f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:48:35.885756 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 688/1348] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:48:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:48:36.168294 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235ac458-4994-45df-bf65-4ad5adb44aee None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:48:36.169840 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-235ac458-4994-45df-bf65-4ad5adb44aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:48:36.234783 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:48:36.287889 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235ac458-4994-45df-bf65-4ad5adb44aee None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:48:36.366734 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a6d2c-c860-4c04-b7f5-042864e124af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:48:36.367348 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a6d2c-c860-4c04-b7f5-042864e124af service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:48:36.367632 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a6d2c-c860-4c04-b7f5-042864e124af service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:48:36.367910 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a6d2c-c860-4c04-b7f5-042864e124af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:48:36.370152 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-700a6d2c-c860-4c04-b7f5-042864e124af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:48:36.485370 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:48:36.489003 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700a6d2c-c860-4c04-b7f5-042864e124af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:48:36.490510 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700a6d2c-c860-4c04-b7f5-042864e124af service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:48:36.509335 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 661/1349] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:48:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:48:41.468900 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a18a3-8ce1-48d8-993f-247f4a6a765c None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:48:41.469379 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a18a3-8ce1-48d8-993f-247f4a6a765c None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:48:41.469675 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a18a3-8ce1-48d8-993f-247f4a6a765c None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:48:41.471144 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 689/1350] 10.222.0.16 () {54 vars in 921 bytes} [Wed Sep 7 15:48:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:48:41.476580 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceeaae2-b0b0-4b6a-8e0d-baaa7905cdfc None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:48:41.477044 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceeaae2-b0b0-4b6a-8e0d-baaa7905cdfc None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:48:41.477139 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceeaae2-b0b0-4b6a-8e0d-baaa7905cdfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:48:41.629598 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-9ceeaae2-b0b0-4b6a-8e0d-baaa7905cdfc None None] MFA Rules not processed for user `66c270b488024605af84e52d874474e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:48:41.630755 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-9ceeaae2-b0b0-4b6a-8e0d-baaa7905cdfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:48:41.750960 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 662/1351] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Sep 7 15:48:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:48:45.884000 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=59 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:48:45.992671 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cee56d-f724-4fc6-b0ad-b5ff288037a6 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:48:45.992951 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cee56d-f724-4fc6-b0ad-b5ff288037a6 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:48:45.993249 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cee56d-f724-4fc6-b0ad-b5ff288037a6 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:48:45.994794 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 690/1352] 10.222.0.16 () {54 vars in 921 bytes} [Wed Sep 7 15:48:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:48:45.999690 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f2480-a92c-4f12-86ef-b920483c33e7 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:48:46.000195 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f2480-a92c-4f12-86ef-b920483c33e7 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:48:46.000303 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f2480-a92c-4f12-86ef-b920483c33e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:48:46.064346 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:48:46.088760 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-da5f2480-a92c-4f12-86ef-b920483c33e7 None None] MFA Rules not processed for user `66c270b488024605af84e52d874474e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:48:46.090063 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-da5f2480-a92c-4f12-86ef-b920483c33e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:48:46.216752 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 663/1353] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Sep 7 15:48:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:48:47.460837 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759355c8-105a-4caf-987f-ae2e56f1578f None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:48:47.461378 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759355c8-105a-4caf-987f-ae2e56f1578f None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:48:47.461378 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759355c8-105a-4caf-987f-ae2e56f1578f None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:48:47.462724 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 691/1354] 10.222.0.16 () {54 vars in 921 bytes} [Wed Sep 7 15:48:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:48:47.467707 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebbece-7cba-424e-80d6-642d46ba85e0 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:48:47.468165 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebbece-7cba-424e-80d6-642d46ba85e0 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:48:47.468269 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebbece-7cba-424e-80d6-642d46ba85e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:48:47.546300 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-6bebbece-7cba-424e-80d6-642d46ba85e0 None None] MFA Rules not processed for user `66c270b488024605af84e52d874474e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:48:47.547488 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-6bebbece-7cba-424e-80d6-642d46ba85e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:48:47.590590 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:48:47.657740 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 664/1355] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Sep 7 15:48:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:48:51.216342 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ca5c8-85bb-42a6-8e58-d742d0027c00 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:48:51.216869 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ca5c8-85bb-42a6-8e58-d742d0027c00 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:48:51.216869 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ca5c8-85bb-42a6-8e58-d742d0027c00 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:48:51.218393 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 692/1356] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:48:51.224682 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd0946-ec25-4a03-95ed-25d29f049120 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:48:51.225133 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd0946-ec25-4a03-95ed-25d29f049120 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:48:51.225215 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd0946-ec25-4a03-95ed-25d29f049120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:48:51.314740 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-51dd0946-ec25-4a03-95ed-25d29f049120 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:48:51.316942 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-51dd0946-ec25-4a03-95ed-25d29f049120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:48:51.436563 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 665/1357] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:48:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:48:51.736101 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaed89d-e852-4adf-ba67-f38803b05fd2 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:48:51.736594 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaed89d-e852-4adf-ba67-f38803b05fd2 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:48:51.737138 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaed89d-e852-4adf-ba67-f38803b05fd2 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:48:51.739192 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 693/1358] 10.222.0.16 () {54 vars in 962 bytes} [Wed Sep 7 15:48:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:48:51.748220 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7efe18-8f24-4b17-a510-26ea69d78d0a None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:48:51.748674 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7efe18-8f24-4b17-a510-26ea69d78d0a None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:48:51.748967 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7efe18-8f24-4b17-a510-26ea69d78d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:48:51.767085 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:48:51.836169 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-cf7efe18-8f24-4b17-a510-26ea69d78d0a None None] MFA Rules not processed for user `f9b13331a5fd48f5a2521ed1600f9f35`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:48:51.837378 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-cf7efe18-8f24-4b17-a510-26ea69d78d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:48:51.960238 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 666/1359] 10.222.0.16 () {58 vars in 1059 bytes} [Wed Sep 7 15:48:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:48:51.968423 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaed89d-e852-4adf-ba67-f38803b05fd2 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:48:51.970268 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-6eaed89d-e852-4adf-ba67-f38803b05fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:48:52.125401 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaed89d-e852-4adf-ba67-f38803b05fd2 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:48:52.200972 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:48:52.248425 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834137b-d599-42c2-9716-ca0235a4d6c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:48:52.249037 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834137b-d599-42c2-9716-ca0235a4d6c9 service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:48:52.249300 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834137b-d599-42c2-9716-ca0235a4d6c9 service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:48:52.249498 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834137b-d599-42c2-9716-ca0235a4d6c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:48:52.251057 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-5834137b-d599-42c2-9716-ca0235a4d6c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:48:52.353324 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834137b-d599-42c2-9716-ca0235a4d6c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:48:52.355008 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834137b-d599-42c2-9716-ca0235a4d6c9 service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:48:52.374096 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 694/1360] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:48:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:48:54.790883 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25549532-350d-47f8-8ff6-5a0f084e7041 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:48:54.791435 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25549532-350d-47f8-8ff6-5a0f084e7041 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:48:54.791435 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25549532-350d-47f8-8ff6-5a0f084e7041 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:48:54.796851 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 667/1361] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:48:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:48:54.802391 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa9210-acdd-40b6-83bb-4d573959444f None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:48:54.802391 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa9210-acdd-40b6-83bb-4d573959444f None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:48:54.802391 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa9210-acdd-40b6-83bb-4d573959444f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:48:54.875871 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-68fa9210-acdd-40b6-83bb-4d573959444f None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:48:54.877076 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-68fa9210-acdd-40b6-83bb-4d573959444f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:48:54.919496 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:48:54.982349 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 695/1362] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:48:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:48:55.275876 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25549532-350d-47f8-8ff6-5a0f084e7041 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:48:55.277422 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-25549532-350d-47f8-8ff6-5a0f084e7041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:48:55.356502 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:48:55.482769 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25549532-350d-47f8-8ff6-5a0f084e7041 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:48:55.629241 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a50a3-0f5c-4e5c-b5af-93b5520ad470 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:48:55.629862 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a50a3-0f5c-4e5c-b5af-93b5520ad470 service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:48:55.630153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a50a3-0f5c-4e5c-b5af-93b5520ad470 service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:48:55.631342 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a50a3-0f5c-4e5c-b5af-93b5520ad470 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:48:55.632120 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-6d0a50a3-0f5c-4e5c-b5af-93b5520ad470 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:48:55.657376 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:48:55.734283 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0a50a3-0f5c-4e5c-b5af-93b5520ad470 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:48:55.735917 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0a50a3-0f5c-4e5c-b5af-93b5520ad470 service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:48:55.755732 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 668/1363] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:48:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:48:58.349231 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a4a2b-1142-402f-a87a-9ac4704ef84d None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:48:58.349791 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a4a2b-1142-402f-a87a-9ac4704ef84d None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:48:58.350032 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a4a2b-1142-402f-a87a-9ac4704ef84d None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:48:58.351735 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 696/1364] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:48:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:48:58.357185 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9df8fd-a91d-4c6a-8420-adb688a9ae2b None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:48:58.357617 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9df8fd-a91d-4c6a-8420-adb688a9ae2b None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:48:58.357788 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9df8fd-a91d-4c6a-8420-adb688a9ae2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:48:58.433959 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-6b9df8fd-a91d-4c6a-8420-adb688a9ae2b None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:48:58.435301 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-6b9df8fd-a91d-4c6a-8420-adb688a9ae2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:48:58.546513 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:48:58.558355 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 669/1365] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:48:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:48:58.852830 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6d51d-c735-4a28-9704-13b567cf5819 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:48:58.853232 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6d51d-c735-4a28-9704-13b567cf5819 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:48:58.853602 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6d51d-c735-4a28-9704-13b567cf5819 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:48:58.855180 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 697/1366] 10.222.0.16 () {54 vars in 962 bytes} [Wed Sep 7 15:48:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:48:58.860690 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c3189-360f-4333-962b-d901529753f2 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:48:58.861147 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c3189-360f-4333-962b-d901529753f2 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:48:58.861575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c3189-360f-4333-962b-d901529753f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:48:58.943300 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-a49c3189-360f-4333-962b-d901529753f2 None None] MFA Rules not processed for user `f9b13331a5fd48f5a2521ed1600f9f35`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:48:58.944802 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-a49c3189-360f-4333-962b-d901529753f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:48:59.071158 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 670/1367] 10.222.0.16 () {58 vars in 1059 bytes} [Wed Sep 7 15:48:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:48:59.078982 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6d51d-c735-4a28-9704-13b567cf5819 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:48:59.080520 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-88c6d51d-c735-4a28-9704-13b567cf5819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:48:59.241972 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6d51d-c735-4a28-9704-13b567cf5819 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:48:59.262948 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:48:59.376153 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c09cfc-c4a3-44b1-8b4c-6e3ae69e1872 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:48:59.376960 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c09cfc-c4a3-44b1-8b4c-6e3ae69e1872 service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:48:59.377346 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c09cfc-c4a3-44b1-8b4c-6e3ae69e1872 service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:48:59.377721 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c09cfc-c4a3-44b1-8b4c-6e3ae69e1872 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:48:59.380470 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-b6c09cfc-c4a3-44b1-8b4c-6e3ae69e1872 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:48:59.459322 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22bc57-de83-40fb-93bf-3d74b67cc45f None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:48:59.459856 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22bc57-de83-40fb-93bf-3d74b67cc45f None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:48:59.459856 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22bc57-de83-40fb-93bf-3d74b67cc45f None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:48:59.461359 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 671/1368] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:48:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:48:59.466250 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a8c4b-3526-4281-acae-da1d7731def7 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:48:59.466538 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a8c4b-3526-4281-acae-da1d7731def7 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:48:59.466814 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a8c4b-3526-4281-acae-da1d7731def7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:48:59.499962 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c09cfc-c4a3-44b1-8b4c-6e3ae69e1872 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:48:59.501579 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c09cfc-c4a3-44b1-8b4c-6e3ae69e1872 service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:48:59.527251 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 698/1369] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:48:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:48:59.536623 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:48:59.540571 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-c45a8c4b-3526-4281-acae-da1d7731def7 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:48:59.542736 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-c45a8c4b-3526-4281-acae-da1d7731def7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:48:59.660374 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 672/1370] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:48:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 15:48:59.995764 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc20b7-46bf-4774-9bb9-ed9ad6001c40 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:48:59.995764 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc20b7-46bf-4774-9bb9-ed9ad6001c40 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:48:59.995764 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc20b7-46bf-4774-9bb9-ed9ad6001c40 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:48:59.998600 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 699/1371] 10.222.0.16 () {54 vars in 964 bytes} [Wed Sep 7 15:48:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:49:00.001883 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ace46-b996-4b34-a5cd-9c946c41a840 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:00.003395 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ace46-b996-4b34-a5cd-9c946c41a840 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:00.003395 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ace46-b996-4b34-a5cd-9c946c41a840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:00.086253 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-6d2ace46-b996-4b34-a5cd-9c946c41a840 None None] MFA Rules not processed for user `99f8fac7bf3842cba115fa03ef9291d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:49:00.087462 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-6d2ace46-b996-4b34-a5cd-9c946c41a840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:00.166244 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:49:00.175590 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 673/1372] 10.222.0.16 () {58 vars in 1061 bytes} [Wed Sep 7 15:49:00 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:49:00.182838 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc20b7-46bf-4774-9bb9-ed9ad6001c40 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:49:00.184415 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-0fbc20b7-46bf-4774-9bb9-ed9ad6001c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:00.215056 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:49:00.295432 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc20b7-46bf-4774-9bb9-ed9ad6001c40 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:49:00.376074 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13161a34-9e15-4447-924c-68afa25b2618 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:49:00.376074 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13161a34-9e15-4447-924c-68afa25b2618 service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:00.376765 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13161a34-9e15-4447-924c-68afa25b2618 service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:00.376765 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13161a34-9e15-4447-924c-68afa25b2618 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:00.378458 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-13161a34-9e15-4447-924c-68afa25b2618 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:00.482717 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:49:00.525330 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13161a34-9e15-4447-924c-68afa25b2618 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:49:00.527288 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13161a34-9e15-4447-924c-68afa25b2618 service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:49:00.558754 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 700/1373] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:49:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:49:01.851438 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf93513-e12f-4f55-9129-4ab0385bab2c None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:01.851998 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf93513-e12f-4f55-9129-4ab0385bab2c None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:01.851998 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf93513-e12f-4f55-9129-4ab0385bab2c None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:01.853328 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 674/1374] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:49:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:49:01.858544 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbba25b-f0ac-46e2-afa0-0cd12213043c None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:01.859213 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbba25b-f0ac-46e2-afa0-0cd12213043c None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:01.859488 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbba25b-f0ac-46e2-afa0-0cd12213043c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:01.927525 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-1dbba25b-f0ac-46e2-afa0-0cd12213043c None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:49:01.928807 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-1dbba25b-f0ac-46e2-afa0-0cd12213043c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:02.040290 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 701/1375] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:49:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:49:02.334613 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf93513-e12f-4f55-9129-4ab0385bab2c None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:49:02.336146 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-2bf93513-e12f-4f55-9129-4ab0385bab2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:02.497957 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf93513-e12f-4f55-9129-4ab0385bab2c None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:49:02.568534 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:49:02.618807 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32351c9e-5025-4e7e-9aaa-1c364aabcb92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:49:02.619421 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32351c9e-5025-4e7e-9aaa-1c364aabcb92 service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:02.619699 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32351c9e-5025-4e7e-9aaa-1c364aabcb92 service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:02.619966 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32351c9e-5025-4e7e-9aaa-1c364aabcb92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:02.621542 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-32351c9e-5025-4e7e-9aaa-1c364aabcb92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:02.717763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32351c9e-5025-4e7e-9aaa-1c364aabcb92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:49:02.719462 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32351c9e-5025-4e7e-9aaa-1c364aabcb92 service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:49:02.738472 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 675/1376] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:49:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:49:04.963675 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c68da-f75f-4df3-b5a2-85fd2ca2c3bb None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:04.964301 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c68da-f75f-4df3-b5a2-85fd2ca2c3bb None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:04.964301 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c68da-f75f-4df3-b5a2-85fd2ca2c3bb None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:04.965527 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 702/1377] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:49:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:49:04.970729 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602148b-1268-4b12-9e89-508bc1a55397 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:04.971139 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602148b-1268-4b12-9e89-508bc1a55397 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:04.971276 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602148b-1268-4b12-9e89-508bc1a55397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:05.044421 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-e602148b-1268-4b12-9e89-508bc1a55397 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:49:05.045220 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-e602148b-1268-4b12-9e89-508bc1a55397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:05.076769 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:49:05.150229 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 676/1378] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:49:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:49:05.438771 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c68da-f75f-4df3-b5a2-85fd2ca2c3bb None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:49:05.440438 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-782c68da-f75f-4df3-b5a2-85fd2ca2c3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:05.481600 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:49:05.608309 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c68da-f75f-4df3-b5a2-85fd2ca2c3bb None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:49:05.725948 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:49:05.732745 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c7f73-60fc-46ff-af25-e1020fddc28b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:49:05.734207 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c7f73-60fc-46ff-af25-e1020fddc28b service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:05.734509 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c7f73-60fc-46ff-af25-e1020fddc28b service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:05.735427 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c7f73-60fc-46ff-af25-e1020fddc28b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:05.736393 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-cb8c7f73-60fc-46ff-af25-e1020fddc28b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:05.834627 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8c7f73-60fc-46ff-af25-e1020fddc28b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:49:05.836238 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8c7f73-60fc-46ff-af25-e1020fddc28b service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:49:05.855156 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 703/1379] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:49:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:49:08.083637 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac631e-627f-4016-976b-08c81b75ab76 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:08.084043 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac631e-627f-4016-976b-08c81b75ab76 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:08.084330 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac631e-627f-4016-976b-08c81b75ab76 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:08.085797 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 677/1380] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:49:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:49:08.091181 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee6749-f564-4662-8d3c-22f5b4ea358e None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:08.092329 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee6749-f564-4662-8d3c-22f5b4ea358e None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:08.092697 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee6749-f564-4662-8d3c-22f5b4ea358e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:08.161654 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-19ee6749-f564-4662-8d3c-22f5b4ea358e None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:49:08.162893 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-19ee6749-f564-4662-8d3c-22f5b4ea358e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:08.230344 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:49:08.264836 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 704/1381] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:49:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:49:08.558910 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac631e-627f-4016-976b-08c81b75ab76 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:49:08.560530 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-34ac631e-627f-4016-976b-08c81b75ab76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:08.718673 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac631e-627f-4016-976b-08c81b75ab76 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:49:08.733315 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:49:08.863798 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a496c-fdb6-47b2-83ab-27af9f1d83d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:49:08.864785 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a496c-fdb6-47b2-83ab-27af9f1d83d8 service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:08.865376 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a496c-fdb6-47b2-83ab-27af9f1d83d8 service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:08.865797 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a496c-fdb6-47b2-83ab-27af9f1d83d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:08.868902 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-e77a496c-fdb6-47b2-83ab-27af9f1d83d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:09.007916 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77a496c-fdb6-47b2-83ab-27af9f1d83d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:49:09.009511 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77a496c-fdb6-47b2-83ab-27af9f1d83d8 service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:49:09.031216 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 678/1382] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:49:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:49:11.450759 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a9478-aace-437a-a211-a2884a3256e6 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:11.451476 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a9478-aace-437a-a211-a2884a3256e6 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:11.451476 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a9478-aace-437a-a211-a2884a3256e6 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:11.452731 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 705/1383] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:49:11.459138 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116101c-6a34-4770-89c4-4ddd51883902 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:11.459582 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116101c-6a34-4770-89c4-4ddd51883902 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:11.459947 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116101c-6a34-4770-89c4-4ddd51883902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:11.490710 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:49:11.539568 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-c116101c-6a34-4770-89c4-4ddd51883902 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:49:11.540789 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-c116101c-6a34-4770-89c4-4ddd51883902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:11.645010 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 679/1384] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:49:11.999948 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a9478-aace-437a-a211-a2884a3256e6 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:49:12.001545 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-f83a9478-aace-437a-a211-a2884a3256e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:12.160661 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a9478-aace-437a-a211-a2884a3256e6 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:49:12.219242 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:49:12.281626 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db4ede-f6e6-4165-b3eb-67ca4892bfd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:49:12.282085 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db4ede-f6e6-4165-b3eb-67ca4892bfd7 service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:12.282391 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db4ede-f6e6-4165-b3eb-67ca4892bfd7 service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:12.282660 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db4ede-f6e6-4165-b3eb-67ca4892bfd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:12.284969 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-97db4ede-f6e6-4165-b3eb-67ca4892bfd7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:12.388114 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97db4ede-f6e6-4165-b3eb-67ca4892bfd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:49:12.389729 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97db4ede-f6e6-4165-b3eb-67ca4892bfd7 service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:49:12.407758 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 706/1385] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:49:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:49:14.700027 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a8dc8-dfbc-4ae4-967a-925c4271b81d None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:14.700636 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a8dc8-dfbc-4ae4-967a-925c4271b81d None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:14.700636 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a8dc8-dfbc-4ae4-967a-925c4271b81d None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:14.701902 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 680/1386] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:49:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:49:14.708511 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bec909-bc52-44e5-82b0-3dd3b2429f2e None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:14.709068 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bec909-bc52-44e5-82b0-3dd3b2429f2e None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:14.709068 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bec909-bc52-44e5-82b0-3dd3b2429f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:14.803187 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-a7bec909-bc52-44e5-82b0-3dd3b2429f2e None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:49:14.804432 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-a7bec909-bc52-44e5-82b0-3dd3b2429f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:14.813619 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:49:14.917547 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 707/1387] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:49:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:49:15.230244 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a8dc8-dfbc-4ae4-967a-925c4271b81d None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:49:15.231887 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-883a8dc8-dfbc-4ae4-967a-925c4271b81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:15.324431 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:49:15.384336 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a8dc8-dfbc-4ae4-967a-925c4271b81d None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:49:15.499733 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a053f6-1c83-417a-a489-01ebb4d7411b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:49:15.500337 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a053f6-1c83-417a-a489-01ebb4d7411b service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:15.500616 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a053f6-1c83-417a-a489-01ebb4d7411b service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:15.500885 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a053f6-1c83-417a-a489-01ebb4d7411b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:15.502564 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-f8a053f6-1c83-417a-a489-01ebb4d7411b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:15.562750 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:49:15.593009 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a053f6-1c83-417a-a489-01ebb4d7411b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:49:15.594593 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a053f6-1c83-417a-a489-01ebb4d7411b service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:49:15.614645 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 681/1388] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:49:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:49:16.135414 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af24543-2188-47ff-af3d-147a1418e034 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:16.135964 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af24543-2188-47ff-af3d-147a1418e034 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:16.135964 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af24543-2188-47ff-af3d-147a1418e034 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:16.137294 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 708/1389] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:49:16.142712 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222c267-c2b0-4e6c-ae54-addfa5aadd48 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:16.143266 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222c267-c2b0-4e6c-ae54-addfa5aadd48 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:16.143363 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222c267-c2b0-4e6c-ae54-addfa5aadd48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:16.211690 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-b222c267-c2b0-4e6c-ae54-addfa5aadd48 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:49:16.212928 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b222c267-c2b0-4e6c-ae54-addfa5aadd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:16.315944 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 682/1390] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:49:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:49:16.624665 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484f916-c726-4548-b99d-eb6375666f4c None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:16.625042 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484f916-c726-4548-b99d-eb6375666f4c None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:16.625388 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484f916-c726-4548-b99d-eb6375666f4c None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:16.626807 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 709/1391] 10.222.0.16 () {54 vars in 961 bytes} [Wed Sep 7 15:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:49:16.632636 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c0590-b80e-4c66-ba7c-5c5a4494870e None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:16.632956 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c0590-b80e-4c66-ba7c-5c5a4494870e None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:16.633232 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c0590-b80e-4c66-ba7c-5c5a4494870e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:16.679013 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:49:16.710245 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-aa1c0590-b80e-4c66-ba7c-5c5a4494870e None None] MFA Rules not processed for user `5753fea47f5944cd93dbea90fb9ad9b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:49:16.711459 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-aa1c0590-b80e-4c66-ba7c-5c5a4494870e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:16.786683 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 683/1392] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Sep 7 15:49:16 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:49:16.795592 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484f916-c726-4548-b99d-eb6375666f4c None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:49:16.797241 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-5484f916-c726-4548-b99d-eb6375666f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:16.902145 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484f916-c726-4548-b99d-eb6375666f4c None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:49:16.942577 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:49:16.980024 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a970217-dfb2-4236-92e6-e48c8421cb00 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5753fea47f5944cd93dbea90fb9ad9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:49:16.980632 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a970217-dfb2-4236-92e6-e48c8421cb00 service glance] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:16.980912 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a970217-dfb2-4236-92e6-e48c8421cb00 service glance] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:16.981182 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a970217-dfb2-4236-92e6-e48c8421cb00 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:16.982781 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-7a970217-dfb2-4236-92e6-e48c8421cb00 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:17.095712 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a970217-dfb2-4236-92e6-e48c8421cb00 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:49:17.097690 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a970217-dfb2-4236-92e6-e48c8421cb00 service glance] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:49:17.116217 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 710/1393] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:49:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:49:17.828183 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659ca89-7f9f-4591-8fe7-43e0ad973e66 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:17.828763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659ca89-7f9f-4591-8fe7-43e0ad973e66 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:17.828763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659ca89-7f9f-4591-8fe7-43e0ad973e66 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:17.830038 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 684/1394] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:49:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:49:17.835914 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d3b78-b23d-46be-8a0a-5e2667d2a6ef None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:17.836390 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d3b78-b23d-46be-8a0a-5e2667d2a6ef None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:17.836479 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d3b78-b23d-46be-8a0a-5e2667d2a6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:17.866696 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dbb312-ca46-4181-afab-9728d6991c42 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:17.867053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dbb312-ca46-4181-afab-9728d6991c42 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:17.867393 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dbb312-ca46-4181-afab-9728d6991c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:17.912705 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-ab1d3b78-b23d-46be-8a0a-5e2667d2a6ef None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:49:17.914205 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-ab1d3b78-b23d-46be-8a0a-5e2667d2a6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:17.933214 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:49:17.934895 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-50dbb312-ca46-4181-afab-9728d6991c42 None None] MFA Rules not processed for user `3e20e40a37df4898bfe692535e5e4f25`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:49:17.936266 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-50dbb312-ca46-4181-afab-9728d6991c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:18.014269 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 711/1395] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:49:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 15:49:18.016746 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:49:18.025957 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 685/1396] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Sep 7 15:49:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:49:18.070090 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145052e-3d9e-437b-8216-173cedbf5a1f None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:18.070473 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145052e-3d9e-437b-8216-173cedbf5a1f None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:18.070901 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145052e-3d9e-437b-8216-173cedbf5a1f None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:18.072339 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 712/1397] 10.222.0.16 () {54 vars in 943 bytes} [Wed Sep 7 15:49:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:49:18.078942 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c6698-d687-4b60-a509-47dad41537e2 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:18.079234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c6698-d687-4b60-a509-47dad41537e2 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:18.079512 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c6698-d687-4b60-a509-47dad41537e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:18.156045 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-ac3c6698-d687-4b60-a509-47dad41537e2 None None] MFA Rules not processed for user `16c4b090a4aa4d56a90ccf090b9caba8`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:49:18.157242 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-ac3c6698-d687-4b60-a509-47dad41537e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:18.264619 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 686/1398] 10.222.0.16 () {58 vars in 1040 bytes} [Wed Sep 7 15:49:18 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:49:18.274038 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145052e-3d9e-437b-8216-173cedbf5a1f None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:49:18.275590 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-c145052e-3d9e-437b-8216-173cedbf5a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:18.302086 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c6698-d687-4b60-a509-47dad41537e2 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:49:18.303353 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-ac3c6698-d687-4b60-a509-47dad41537e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:18.358367 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:49:18.403222 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c6698-d687-4b60-a509-47dad41537e2 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:49:18.413856 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145052e-3d9e-437b-8216-173cedbf5a1f None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:49:18.428108 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:49:18.524268 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a74d0-2d14-468e-9a13-1108745d8f9a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16c4b090a4aa4d56a90ccf090b9caba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:49:18.524702 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a03d124-5e63-4783-89a7-ca711ebe1aff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:49:18.524989 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a74d0-2d14-468e-9a13-1108745d8f9a service swift] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:18.525271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a74d0-2d14-468e-9a13-1108745d8f9a service swift] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:18.525368 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a03d124-5e63-4783-89a7-ca711ebe1aff service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:18.525560 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a74d0-2d14-468e-9a13-1108745d8f9a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:18.525653 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a03d124-5e63-4783-89a7-ca711ebe1aff service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:18.525846 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a03d124-5e63-4783-89a7-ca711ebe1aff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:18.527200 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-f90a74d0-2d14-468e-9a13-1108745d8f9a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:18.527468 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-4a03d124-5e63-4783-89a7-ca711ebe1aff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:18.591939 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:49:18.613148 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90a74d0-2d14-468e-9a13-1108745d8f9a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:49:18.614776 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90a74d0-2d14-468e-9a13-1108745d8f9a service swift] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:49:18.619869 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a03d124-5e63-4783-89a7-ca711ebe1aff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:49:18.621444 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a03d124-5e63-4783-89a7-ca711ebe1aff service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:49:18.623053 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 713/1399] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Sep 7 15:49:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 15:49:18.642432 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 687/1400] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:49:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:49:20.911421 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3cbde-e941-4722-ae65-26f8d806c641 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:20.911936 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3cbde-e941-4722-ae65-26f8d806c641 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:20.911936 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3cbde-e941-4722-ae65-26f8d806c641 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:20.913522 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 714/1401] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:49:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:49:20.918888 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c6c37-d9dc-42b0-ab06-03f93deea88d None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:20.919290 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c6c37-d9dc-42b0-ab06-03f93deea88d None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:20.919454 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c6c37-d9dc-42b0-ab06-03f93deea88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:21.003263 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-fd9c6c37-d9dc-42b0-ab06-03f93deea88d None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:49:21.004569 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-fd9c6c37-d9dc-42b0-ab06-03f93deea88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:21.239273 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 688/1402] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:49:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:49:21.539089 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3cbde-e941-4722-ae65-26f8d806c641 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:49:21.540852 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-8af3cbde-e941-4722-ae65-26f8d806c641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:21.592860 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:49:21.712322 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3cbde-e941-4722-ae65-26f8d806c641 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:49:21.847417 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb2983b-6886-4c3c-92c0-fadf60789aa3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:49:21.848017 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2983b-6886-4c3c-92c0-fadf60789aa3 service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:21.848366 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2983b-6886-4c3c-92c0-fadf60789aa3 service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:21.848729 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2983b-6886-4c3c-92c0-fadf60789aa3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:21.850697 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-adb2983b-6886-4c3c-92c0-fadf60789aa3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:21.862555 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:49:21.953130 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb2983b-6886-4c3c-92c0-fadf60789aa3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:49:21.954778 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb2983b-6886-4c3c-92c0-fadf60789aa3 service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:49:21.977583 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 715/1403] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:49:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:49:24.189791 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06cf767-478d-4267-b555-38bd38105e0a None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:24.189791 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06cf767-478d-4267-b555-38bd38105e0a None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:24.189791 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06cf767-478d-4267-b555-38bd38105e0a None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:24.194613 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 689/1404] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:49:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:49:24.196512 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250ba77-8b72-45bd-8fe1-12aae5cfd58f None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:24.196925 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250ba77-8b72-45bd-8fe1-12aae5cfd58f None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:24.197073 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250ba77-8b72-45bd-8fe1-12aae5cfd58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:24.270434 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-4250ba77-8b72-45bd-8fe1-12aae5cfd58f None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:49:24.271795 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-4250ba77-8b72-45bd-8fe1-12aae5cfd58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:24.357933 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:49:24.382436 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 716/1405] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:49:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 15:49:24.682453 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06cf767-478d-4267-b555-38bd38105e0a None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:49:24.684250 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-a06cf767-478d-4267-b555-38bd38105e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:24.735461 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:49:24.852192 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06cf767-478d-4267-b555-38bd38105e0a None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:49:24.985534 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e48ca-1512-4f74-af07-993f3d8bb44f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:49:24.986902 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e48ca-1512-4f74-af07-993f3d8bb44f service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:24.987381 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e48ca-1512-4f74-af07-993f3d8bb44f service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:24.987724 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e48ca-1512-4f74-af07-993f3d8bb44f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:24.989425 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-2b2e48ca-1512-4f74-af07-993f3d8bb44f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:24.991818 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:49:25.101445 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e48ca-1512-4f74-af07-993f3d8bb44f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:49:25.103203 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e48ca-1512-4f74-af07-993f3d8bb44f service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:49:25.125664 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 690/1406] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:49:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:49:27.352962 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e564f7-7dea-4aa4-bfcf-cfab787e9a5d None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:27.353487 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e564f7-7dea-4aa4-bfcf-cfab787e9a5d None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:27.353487 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e564f7-7dea-4aa4-bfcf-cfab787e9a5d None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:27.354772 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 717/1407] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:49:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:49:27.360139 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db56e2-3009-4ec3-988a-c1d2114edaaf None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:27.360566 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db56e2-3009-4ec3-988a-c1d2114edaaf None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:27.360684 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db56e2-3009-4ec3-988a-c1d2114edaaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:27.434952 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-38db56e2-3009-4ec3-988a-c1d2114edaaf None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:49:27.436512 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-38db56e2-3009-4ec3-988a-c1d2114edaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:27.516664 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:49:27.547720 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 691/1408] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:49:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:49:27.836720 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e564f7-7dea-4aa4-bfcf-cfab787e9a5d None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:49:27.838256 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-d4e564f7-7dea-4aa4-bfcf-cfab787e9a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:28.000012 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e564f7-7dea-4aa4-bfcf-cfab787e9a5d None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:49:28.071539 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:49:28.131140 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a482bb-08d3-4270-9d14-89bd5e9878fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:49:28.132027 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a482bb-08d3-4270-9d14-89bd5e9878fb service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:28.132309 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a482bb-08d3-4270-9d14-89bd5e9878fb service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:28.132583 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a482bb-08d3-4270-9d14-89bd5e9878fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:28.134208 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-72a482bb-08d3-4270-9d14-89bd5e9878fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:28.232665 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a482bb-08d3-4270-9d14-89bd5e9878fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:49:28.234672 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a482bb-08d3-4270-9d14-89bd5e9878fb service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:49:28.256844 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 718/1409] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:49:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:49:37.545507 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=9 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:49:38.254083 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=69 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:49:41.165463 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9251ebb-145b-44e5-9983-258754bf9eaa None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:41.166057 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9251ebb-145b-44e5-9983-258754bf9eaa None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:41.166057 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9251ebb-145b-44e5-9983-258754bf9eaa None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:41.168411 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 692/1410] 10.222.0.16 () {54 vars in 918 bytes} [Wed Sep 7 15:49:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:49:41.173928 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4abd6-515b-40a1-9f88-db5453152f74 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:41.174602 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4abd6-515b-40a1-9f88-db5453152f74 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:41.174602 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4abd6-515b-40a1-9f88-db5453152f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:41.253162 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-91c4abd6-515b-40a1-9f88-db5453152f74 None None] MFA Rules not processed for user `66c270b488024605af84e52d874474e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:49:41.254392 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-91c4abd6-515b-40a1-9f88-db5453152f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:41.357343 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 719/1411] 10.222.0.16 () {58 vars in 1015 bytes} [Wed Sep 7 15:49:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:49:41.372133 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a7780-a64e-4d20-b33d-eeef02d52b30 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:41.372416 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a7780-a64e-4d20-b33d-eeef02d52b30 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:41.372686 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a7780-a64e-4d20-b33d-eeef02d52b30 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:41.374027 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 693/1412] 10.222.0.16 () {54 vars in 918 bytes} [Wed Sep 7 15:49:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:49:41.379415 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055dbd0-f03f-40d7-a2f9-3aa874cb8356 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:41.379698 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055dbd0-f03f-40d7-a2f9-3aa874cb8356 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:41.379974 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055dbd0-f03f-40d7-a2f9-3aa874cb8356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:41.451577 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:49:41.454158 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-f055dbd0-f03f-40d7-a2f9-3aa874cb8356 None None] MFA Rules not processed for user `f9b13331a5fd48f5a2521ed1600f9f35`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:49:41.455958 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-f055dbd0-f03f-40d7-a2f9-3aa874cb8356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:41.570829 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 720/1413] 10.222.0.16 () {58 vars in 1015 bytes} [Wed Sep 7 15:49:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 15:49:44.137071 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b636b6f-6877-4085-9805-0fe7b5b6b1ec None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:44.137616 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b636b6f-6877-4085-9805-0fe7b5b6b1ec None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:44.137616 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b636b6f-6877-4085-9805-0fe7b5b6b1ec None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:44.139059 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 694/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 15:49:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:49:44.144350 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9024f-e532-4486-8511-e70c5eb2b016 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:44.144803 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9024f-e532-4486-8511-e70c5eb2b016 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:44.144913 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9024f-e532-4486-8511-e70c5eb2b016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:44.210338 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-3bf9024f-e532-4486-8511-e70c5eb2b016 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:49:44.211544 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-3bf9024f-e532-4486-8511-e70c5eb2b016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:44.266037 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:49:44.307983 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 721/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 15:49:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:49:44.598003 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b636b6f-6877-4085-9805-0fe7b5b6b1ec None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:49:44.599572 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-9b636b6f-6877-4085-9805-0fe7b5b6b1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:44.744329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b636b6f-6877-4085-9805-0fe7b5b6b1ec None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:49:44.815119 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:49:44.855021 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f308536-153f-495d-bc13-92eeed55a695 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:49:44.855555 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f308536-153f-495d-bc13-92eeed55a695 service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:44.855833 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f308536-153f-495d-bc13-92eeed55a695 service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:44.856100 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f308536-153f-495d-bc13-92eeed55a695 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:44.857680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-5f308536-153f-495d-bc13-92eeed55a695 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:44.945320 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f308536-153f-495d-bc13-92eeed55a695 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:49:44.946986 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f308536-153f-495d-bc13-92eeed55a695 service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:49:44.965334 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 695/1416] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:49:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 15:49:46.129668 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e3427-67d1-4f70-b881-05b7e39a0c08 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:46.130269 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e3427-67d1-4f70-b881-05b7e39a0c08 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:46.130269 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e3427-67d1-4f70-b881-05b7e39a0c08 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:46.131574 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 722/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 15:49:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:49:46.137665 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b793f0-9d50-4afd-987d-797c8034fc10 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:46.138063 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b793f0-9d50-4afd-987d-797c8034fc10 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:46.138250 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b793f0-9d50-4afd-987d-797c8034fc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:46.217656 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-f2b793f0-9d50-4afd-987d-797c8034fc10 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:49:46.218918 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-f2b793f0-9d50-4afd-987d-797c8034fc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:46.247203 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:49:46.319844 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 696/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 15:49:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:49:46.468900 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e3427-67d1-4f70-b881-05b7e39a0c08 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:49:46.470726 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-c94e3427-67d1-4f70-b881-05b7e39a0c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:46.622039 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e3427-67d1-4f70-b881-05b7e39a0c08 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:49:46.661583 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:49:46.735376 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db571e1-70a1-4bbe-b7b4-2d10c1cb718d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:49:46.736776 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db571e1-70a1-4bbe-b7b4-2d10c1cb718d service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:46.737163 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db571e1-70a1-4bbe-b7b4-2d10c1cb718d service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:46.737439 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db571e1-70a1-4bbe-b7b4-2d10c1cb718d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:46.739102 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-9db571e1-70a1-4bbe-b7b4-2d10c1cb718d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:46.827655 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db571e1-70a1-4bbe-b7b4-2d10c1cb718d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:49:46.829251 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db571e1-70a1-4bbe-b7b4-2d10c1cb718d service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:49:46.847620 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 723/1419] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:49:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:49:47.980365 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdfcc54-f304-41ed-b7b6-e0ca4c79e64e None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:47.980939 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdfcc54-f304-41ed-b7b6-e0ca4c79e64e None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:47.980939 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdfcc54-f304-41ed-b7b6-e0ca4c79e64e None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:47.982279 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 697/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 15:49:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:49:47.988934 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cb64b-a62c-4b10-b53e-ef430aea4bc4 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:47.989602 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cb64b-a62c-4b10-b53e-ef430aea4bc4 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:47.989880 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cb64b-a62c-4b10-b53e-ef430aea4bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:48.047587 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:49:48.069688 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-9a0cb64b-a62c-4b10-b53e-ef430aea4bc4 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:49:48.070946 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-9a0cb64b-a62c-4b10-b53e-ef430aea4bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:48.167752 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 724/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 15:49:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:49:48.319422 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdfcc54-f304-41ed-b7b6-e0ca4c79e64e None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:49:48.320901 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-bbdfcc54-f304-41ed-b7b6-e0ca4c79e64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:48.465112 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdfcc54-f304-41ed-b7b6-e0ca4c79e64e None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:49:48.477226 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:49:48.578385 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03705bdc-49a7-425b-85f4-b1a280165f20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:49:48.578896 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03705bdc-49a7-425b-85f4-b1a280165f20 service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:48.579171 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03705bdc-49a7-425b-85f4-b1a280165f20 service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:48.579992 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03705bdc-49a7-425b-85f4-b1a280165f20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:48.581581 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-03705bdc-49a7-425b-85f4-b1a280165f20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:48.668592 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03705bdc-49a7-425b-85f4-b1a280165f20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:49:48.670169 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03705bdc-49a7-425b-85f4-b1a280165f20 service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:49:48.688189 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 698/1422] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:49:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:49:49.804806 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee1c02-1edb-419a-9914-781d7dd83dab None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:49.805376 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee1c02-1edb-419a-9914-781d7dd83dab None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:49.805376 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee1c02-1edb-419a-9914-781d7dd83dab None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:49.806767 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 725/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 15:49:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:49:49.812856 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ab56f-c6a5-4d2c-a154-a34567eca71a None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:49.813279 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ab56f-c6a5-4d2c-a154-a34567eca71a None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:49.813405 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ab56f-c6a5-4d2c-a154-a34567eca71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:49.833942 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:49:49.892552 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-1f3ab56f-c6a5-4d2c-a154-a34567eca71a None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:49:49.893757 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-1f3ab56f-c6a5-4d2c-a154-a34567eca71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:49.991187 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 699/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 15:49:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:49:50.144573 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee1c02-1edb-419a-9914-781d7dd83dab None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:49:50.146002 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-86ee1c02-1edb-419a-9914-781d7dd83dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:50.257542 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:49:50.295121 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee1c02-1edb-419a-9914-781d7dd83dab None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:49:50.410362 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b91b10-4266-4567-93ec-9c9af0acd9bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:49:50.410902 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b91b10-4266-4567-93ec-9c9af0acd9bd service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:50.411181 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b91b10-4266-4567-93ec-9c9af0acd9bd service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:50.411454 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b91b10-4266-4567-93ec-9c9af0acd9bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:50.413058 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-f4b91b10-4266-4567-93ec-9c9af0acd9bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:50.490701 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:49:50.505378 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b91b10-4266-4567-93ec-9c9af0acd9bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:49:50.507029 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b91b10-4266-4567-93ec-9c9af0acd9bd service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:49:50.525594 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 726/1425] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:49:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:49:51.643325 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c0514-31ed-4257-a3a9-718a3412376a None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:51.643842 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c0514-31ed-4257-a3a9-718a3412376a None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:51.643842 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c0514-31ed-4257-a3a9-718a3412376a None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:51.645134 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 700/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 15:49:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:49:51.651651 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b25b9-bf9b-460d-b1a8-d7891fdfbb65 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:51.652112 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b25b9-bf9b-460d-b1a8-d7891fdfbb65 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:51.652210 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b25b9-bf9b-460d-b1a8-d7891fdfbb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:51.733212 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-a61b25b9-bf9b-460d-b1a8-d7891fdfbb65 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:49:51.734719 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-a61b25b9-bf9b-460d-b1a8-d7891fdfbb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:51.831815 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 727/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 15:49:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:49:51.982227 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c0514-31ed-4257-a3a9-718a3412376a None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:49:51.984029 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-003c0514-31ed-4257-a3a9-718a3412376a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:52.068085 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:49:52.129258 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c0514-31ed-4257-a3a9-718a3412376a None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:49:52.240417 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da501c08-01e4-47e7-92b1-576108dbd03f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:49:52.240958 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da501c08-01e4-47e7-92b1-576108dbd03f service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:52.241237 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da501c08-01e4-47e7-92b1-576108dbd03f service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:52.241511 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da501c08-01e4-47e7-92b1-576108dbd03f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:52.243144 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-da501c08-01e4-47e7-92b1-576108dbd03f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:52.291163 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:49:52.333430 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da501c08-01e4-47e7-92b1-576108dbd03f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:49:52.335071 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da501c08-01e4-47e7-92b1-576108dbd03f service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:49:52.353036 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 701/1428] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:49:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:49:53.424655 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22865199-4af1-4393-9a36-b6ea92221125 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:53.425221 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22865199-4af1-4393-9a36-b6ea92221125 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:53.425221 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22865199-4af1-4393-9a36-b6ea92221125 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:53.426499 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 728/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 15:49:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:49:53.432657 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a67a99-b696-4fb3-835c-e554f41499c4 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:53.433119 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a67a99-b696-4fb3-835c-e554f41499c4 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:53.433229 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a67a99-b696-4fb3-835c-e554f41499c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:53.510727 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-83a67a99-b696-4fb3-835c-e554f41499c4 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:49:53.511950 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-83a67a99-b696-4fb3-835c-e554f41499c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:53.608131 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 702/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 15:49:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:49:53.763807 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22865199-4af1-4393-9a36-b6ea92221125 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:49:53.765321 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-22865199-4af1-4393-9a36-b6ea92221125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:53.814931 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:49:53.912251 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22865199-4af1-4393-9a36-b6ea92221125 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:49:54.024084 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e3722-cf0f-435d-a0fb-bcb594d636ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:49:54.024600 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e3722-cf0f-435d-a0fb-bcb594d636ed service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:54.024876 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e3722-cf0f-435d-a0fb-bcb594d636ed service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:54.025143 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e3722-cf0f-435d-a0fb-bcb594d636ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:54.026742 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-447e3722-cf0f-435d-a0fb-bcb594d636ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:54.034272 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:49:54.118519 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447e3722-cf0f-435d-a0fb-bcb594d636ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:49:54.120126 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447e3722-cf0f-435d-a0fb-bcb594d636ed service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:49:54.137928 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 729/1431] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:49:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:49:55.200425 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7af77-c3fc-4fcd-a66f-548c444ef938 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:55.200983 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7af77-c3fc-4fcd-a66f-548c444ef938 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:55.200983 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7af77-c3fc-4fcd-a66f-548c444ef938 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:55.202360 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 703/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 15:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:49:55.209069 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31d621-2e3f-479c-9410-440d276dcb4a None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:55.209555 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31d621-2e3f-479c-9410-440d276dcb4a None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:55.209659 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31d621-2e3f-479c-9410-440d276dcb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:55.284946 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-8d31d621-2e3f-479c-9410-440d276dcb4a None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:49:55.286163 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-8d31d621-2e3f-479c-9410-440d276dcb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:55.354766 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:49:55.385088 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 730/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 15:49:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:49:55.536393 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7af77-c3fc-4fcd-a66f-548c444ef938 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:49:55.537906 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-54e7af77-c3fc-4fcd-a66f-548c444ef938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:55.556171 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:49:55.683587 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7af77-c3fc-4fcd-a66f-548c444ef938 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:49:55.771026 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:49:55.796769 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba52d70-7ef7-42d3-9657-1c04dbb324d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:49:55.797371 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba52d70-7ef7-42d3-9657-1c04dbb324d7 service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:55.797647 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba52d70-7ef7-42d3-9657-1c04dbb324d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:55.798484 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba52d70-7ef7-42d3-9657-1c04dbb324d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:55.800067 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-4ba52d70-7ef7-42d3-9657-1c04dbb324d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:55.888014 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba52d70-7ef7-42d3-9657-1c04dbb324d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:49:55.889601 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba52d70-7ef7-42d3-9657-1c04dbb324d7 service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:49:55.908051 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 704/1434] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:49:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:49:56.977934 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22be600-8463-4a30-bfe9-dc14881bae1c None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:56.978523 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22be600-8463-4a30-bfe9-dc14881bae1c None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:56.978523 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22be600-8463-4a30-bfe9-dc14881bae1c None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:56.979848 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 731/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 15:49:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:49:56.986300 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b7332-62ed-473b-993b-5ca96ca5cfbe None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:56.986753 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b7332-62ed-473b-993b-5ca96ca5cfbe None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:56.986857 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b7332-62ed-473b-993b-5ca96ca5cfbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:57.063784 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-236b7332-62ed-473b-993b-5ca96ca5cfbe None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:49:57.064993 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-236b7332-62ed-473b-993b-5ca96ca5cfbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:57.106761 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:49:57.161998 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 705/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 15:49:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:49:57.315533 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22be600-8463-4a30-bfe9-dc14881bae1c None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:49:57.317062 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-b22be600-8463-4a30-bfe9-dc14881bae1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:57.463648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22be600-8463-4a30-bfe9-dc14881bae1c None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:49:57.518055 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:49:57.577017 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6558699-665a-44f1-b84b-4520225c68c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:49:57.577624 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6558699-665a-44f1-b84b-4520225c68c4 service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:57.577900 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6558699-665a-44f1-b84b-4520225c68c4 service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:57.578165 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6558699-665a-44f1-b84b-4520225c68c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:57.579771 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-d6558699-665a-44f1-b84b-4520225c68c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:57.670581 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6558699-665a-44f1-b84b-4520225c68c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:49:57.672180 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6558699-665a-44f1-b84b-4520225c68c4 service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:49:57.689996 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 732/1437] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:49:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:49:58.755608 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d1ed1-8e91-44f9-a928-b7717e1d3cce None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:58.756170 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d1ed1-8e91-44f9-a928-b7717e1d3cce None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:58.756170 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d1ed1-8e91-44f9-a928-b7717e1d3cce None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:58.757481 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 706/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 15:49:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:49:58.763592 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b7978-10c8-47bc-a16d-e5fd6ca72b25 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:58.764009 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b7978-10c8-47bc-a16d-e5fd6ca72b25 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:58.764147 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b7978-10c8-47bc-a16d-e5fd6ca72b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:58.839360 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-913b7978-10c8-47bc-a16d-e5fd6ca72b25 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:49:58.840575 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-913b7978-10c8-47bc-a16d-e5fd6ca72b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:58.842619 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:49:58.937520 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 733/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 15:49:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:49:59.087716 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d1ed1-8e91-44f9-a928-b7717e1d3cce None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:49:59.089228 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-f35d1ed1-8e91-44f9-a928-b7717e1d3cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:59.232629 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d1ed1-8e91-44f9-a928-b7717e1d3cce None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:49:59.259432 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:49:59.346996 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab12521-98c4-490a-852e-b46cb3535f31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:49:59.347529 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab12521-98c4-490a-852e-b46cb3535f31 service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:49:59.347810 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab12521-98c4-490a-852e-b46cb3535f31 service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:49:59.348085 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab12521-98c4-490a-852e-b46cb3535f31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:49:59.349696 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-6ab12521-98c4-490a-852e-b46cb3535f31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:49:59.439578 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab12521-98c4-490a-852e-b46cb3535f31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:49:59.441180 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab12521-98c4-490a-852e-b46cb3535f31 service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:49:59.459431 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 707/1440] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:49:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:50:01.594739 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c379ff9-8fed-4e8c-9e37-54bce73fb21d None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:50:01.595357 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c379ff9-8fed-4e8c-9e37-54bce73fb21d None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:50:01.595357 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c379ff9-8fed-4e8c-9e37-54bce73fb21d None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:50:01.596614 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 734/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 15:50:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:50:01.602123 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba6a6e-02f6-4445-9dcb-e064107bd153 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:50:01.602573 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba6a6e-02f6-4445-9dcb-e064107bd153 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:50:01.602754 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba6a6e-02f6-4445-9dcb-e064107bd153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:50:01.647126 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:50:01.673533 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-09ba6a6e-02f6-4445-9dcb-e064107bd153 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:50:01.674873 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-09ba6a6e-02f6-4445-9dcb-e064107bd153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:50:01.775799 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 708/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 15:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:50:02.058711 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c379ff9-8fed-4e8c-9e37-54bce73fb21d None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:50:02.060276 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-3c379ff9-8fed-4e8c-9e37-54bce73fb21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:50:02.163970 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c379ff9-8fed-4e8c-9e37-54bce73fb21d None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:50:02.195628 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:50:02.238584 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e26f92-e305-4fdd-8ae9-150727479a15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:50:02.239191 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e26f92-e305-4fdd-8ae9-150727479a15 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:50:02.239480 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e26f92-e305-4fdd-8ae9-150727479a15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:50:02.239755 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e26f92-e305-4fdd-8ae9-150727479a15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:50:02.241342 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-b3e26f92-e305-4fdd-8ae9-150727479a15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:50:02.354217 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e26f92-e305-4fdd-8ae9-150727479a15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:50:02.355613 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e26f92-e305-4fdd-8ae9-150727479a15 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:50:02.375640 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 735/1443] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:50:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:50:04.708088 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd369e0d-a1b8-4276-9a1b-013b156f712a None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:50:04.708668 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd369e0d-a1b8-4276-9a1b-013b156f712a None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:50:04.708668 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd369e0d-a1b8-4276-9a1b-013b156f712a None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:50:04.709968 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 709/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 15:50:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:50:04.715180 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f64b5d-5566-49d6-9de6-a4842e1b2b6e None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:50:04.715609 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f64b5d-5566-49d6-9de6-a4842e1b2b6e None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:50:04.715722 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f64b5d-5566-49d6-9de6-a4842e1b2b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:50:04.781639 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-d7f64b5d-5566-49d6-9de6-a4842e1b2b6e None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:50:04.782884 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-d7f64b5d-5566-49d6-9de6-a4842e1b2b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:50:04.795227 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:50:04.878588 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 736/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 15:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 15:50:05.164838 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd369e0d-a1b8-4276-9a1b-013b156f712a None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:50:05.166411 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-dd369e0d-a1b8-4276-9a1b-013b156f712a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:50:05.269071 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd369e0d-a1b8-4276-9a1b-013b156f712a None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:50:05.280886 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:50:05.340785 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e7add7-aaf2-491a-9f05-7e595638aabc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:50:05.341304 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7add7-aaf2-491a-9f05-7e595638aabc service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:50:05.341579 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7add7-aaf2-491a-9f05-7e595638aabc service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:50:05.341848 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7add7-aaf2-491a-9f05-7e595638aabc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:50:05.343446 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-14e7add7-aaf2-491a-9f05-7e595638aabc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:50:05.451814 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e7add7-aaf2-491a-9f05-7e595638aabc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:50:05.453245 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e7add7-aaf2-491a-9f05-7e595638aabc service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:50:05.471807 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 710/1446] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:50:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:50:07.894448 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe960d6-c169-4db1-bd96-e21584817560 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:50:07.895020 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe960d6-c169-4db1-bd96-e21584817560 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:50:07.895020 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe960d6-c169-4db1-bd96-e21584817560 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:50:07.896356 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 737/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 15:50:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:50:07.901761 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06d2bb-b58a-471b-b8e0-d28a0795b8aa None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:50:07.902201 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06d2bb-b58a-471b-b8e0-d28a0795b8aa None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:50:07.902348 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06d2bb-b58a-471b-b8e0-d28a0795b8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:50:07.953122 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:50:07.971476 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-2e06d2bb-b58a-471b-b8e0-d28a0795b8aa None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:50:07.972686 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-2e06d2bb-b58a-471b-b8e0-d28a0795b8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:50:08.070329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 711/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 15:50:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:50:08.358548 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe960d6-c169-4db1-bd96-e21584817560 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:50:08.360408 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-dbe960d6-c169-4db1-bd96-e21584817560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:50:08.462205 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe960d6-c169-4db1-bd96-e21584817560 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:50:08.502106 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:50:08.538299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e94338-d8ee-40b4-b829-790976162779 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:50:08.538909 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e94338-d8ee-40b4-b829-790976162779 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:50:08.539186 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e94338-d8ee-40b4-b829-790976162779 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:50:08.539452 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e94338-d8ee-40b4-b829-790976162779 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:50:08.541021 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-07e94338-d8ee-40b4-b829-790976162779 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:50:08.649343 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e94338-d8ee-40b4-b829-790976162779 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:50:08.650813 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e94338-d8ee-40b4-b829-790976162779 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:50:08.668487 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 738/1449] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:50:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:50:10.943163 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6250ad-959d-4904-8559-f907e137c7d5 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:50:10.943730 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6250ad-959d-4904-8559-f907e137c7d5 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:50:10.943730 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6250ad-959d-4904-8559-f907e137c7d5 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:50:10.945048 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 712/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 15:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:50:10.950465 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a2e7a-43ff-436b-9a97-4fa2c884ef86 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:50:10.950865 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a2e7a-43ff-436b-9a97-4fa2c884ef86 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:50:10.951018 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a2e7a-43ff-436b-9a97-4fa2c884ef86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:50:11.019554 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-433a2e7a-43ff-436b-9a97-4fa2c884ef86 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:50:11.020789 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-433a2e7a-43ff-436b-9a97-4fa2c884ef86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:50:11.042493 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:50:11.236625 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 739/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 15:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:50:11.530877 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6250ad-959d-4904-8559-f907e137c7d5 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:50:11.533193 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-af6250ad-959d-4904-8559-f907e137c7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:50:11.637919 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6250ad-959d-4904-8559-f907e137c7d5 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:50:11.658605 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:50:11.714678 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7576c4b7-bb5e-457f-b281-50c949a46a61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:50:11.715297 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576c4b7-bb5e-457f-b281-50c949a46a61 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:50:11.715576 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576c4b7-bb5e-457f-b281-50c949a46a61 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:50:11.715858 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576c4b7-bb5e-457f-b281-50c949a46a61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:50:11.717485 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-7576c4b7-bb5e-457f-b281-50c949a46a61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:50:11.828681 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7576c4b7-bb5e-457f-b281-50c949a46a61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:50:11.829988 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7576c4b7-bb5e-457f-b281-50c949a46a61 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:50:11.848792 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 713/1452] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:50:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:50:14.185700 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ef33b-3d02-4f5a-ab70-ee3df8e9be43 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:50:14.186283 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ef33b-3d02-4f5a-ab70-ee3df8e9be43 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:50:14.186283 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ef33b-3d02-4f5a-ab70-ee3df8e9be43 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:50:14.187641 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 740/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 15:50:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:50:14.193817 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d633a02-827a-4052-b277-2bfb796a2b82 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:50:14.194568 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d633a02-827a-4052-b277-2bfb796a2b82 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:50:14.194568 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d633a02-827a-4052-b277-2bfb796a2b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:50:14.265216 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:50:14.269057 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-8d633a02-827a-4052-b277-2bfb796a2b82 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:50:14.271379 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-8d633a02-827a-4052-b277-2bfb796a2b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:50:14.383772 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 714/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 15:50:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:50:14.710162 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3ef33b-3d02-4f5a-ab70-ee3df8e9be43 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:50:14.711745 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-fa3ef33b-3d02-4f5a-ab70-ee3df8e9be43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:50:14.825474 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3ef33b-3d02-4f5a-ab70-ee3df8e9be43 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:50:14.875196 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:50:14.900195 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d67d06-4d13-413d-ae16-d87ce47bfa0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:50:14.900794 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d67d06-4d13-413d-ae16-d87ce47bfa0e service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:50:14.901069 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d67d06-4d13-413d-ae16-d87ce47bfa0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:50:14.901335 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d67d06-4d13-413d-ae16-d87ce47bfa0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:50:14.902964 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-52d67d06-4d13-413d-ae16-d87ce47bfa0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:50:15.011158 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d67d06-4d13-413d-ae16-d87ce47bfa0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:50:15.012501 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d67d06-4d13-413d-ae16-d87ce47bfa0e service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:50:15.036380 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 741/1455] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:50:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:50:17.222542 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723752a8-3b06-4550-bb7a-cac9fb72668e None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:50:17.223097 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723752a8-3b06-4550-bb7a-cac9fb72668e None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:50:17.223097 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723752a8-3b06-4550-bb7a-cac9fb72668e None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:50:17.224443 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 715/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 15:50:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:50:17.229791 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a0742-d982-4ada-bd34-012feb8f10ea None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:50:17.230272 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a0742-d982-4ada-bd34-012feb8f10ea None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:50:17.230536 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a0742-d982-4ada-bd34-012feb8f10ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:50:17.307011 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-cf3a0742-d982-4ada-bd34-012feb8f10ea None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:50:17.308213 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-cf3a0742-d982-4ada-bd34-012feb8f10ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:50:17.339372 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:50:17.407137 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 742/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 15:50:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 15:50:17.717109 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723752a8-3b06-4550-bb7a-cac9fb72668e None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:50:17.718688 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-723752a8-3b06-4550-bb7a-cac9fb72668e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:50:17.822796 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723752a8-3b06-4550-bb7a-cac9fb72668e None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:50:17.851400 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:50:17.897736 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c67c8-6ac2-4b44-912c-b51ee7219825 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:50:17.898375 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c67c8-6ac2-4b44-912c-b51ee7219825 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:50:17.898659 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c67c8-6ac2-4b44-912c-b51ee7219825 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:50:17.898929 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c67c8-6ac2-4b44-912c-b51ee7219825 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:50:17.900529 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-475c67c8-6ac2-4b44-912c-b51ee7219825 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:50:18.011875 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c67c8-6ac2-4b44-912c-b51ee7219825 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:50:18.013254 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c67c8-6ac2-4b44-912c-b51ee7219825 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:50:18.032765 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 716/1458] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:50:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:50:20.296049 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6e091-15eb-456e-8691-be4488c73e8b None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:50:20.296548 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6e091-15eb-456e-8691-be4488c73e8b None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:50:20.296548 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6e091-15eb-456e-8691-be4488c73e8b None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:50:20.297978 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 743/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 15:50:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:50:20.303419 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d003981-8759-47bf-971e-38262d5f72ef None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:50:20.303808 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d003981-8759-47bf-971e-38262d5f72ef None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:50:20.303984 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d003981-8759-47bf-971e-38262d5f72ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:50:20.370355 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-7d003981-8759-47bf-971e-38262d5f72ef None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:50:20.371573 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-7d003981-8759-47bf-971e-38262d5f72ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:50:20.380160 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:50:20.471348 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 717/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 15:50:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:50:20.758606 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6e091-15eb-456e-8691-be4488c73e8b None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:50:20.760128 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-06b6e091-15eb-456e-8691-be4488c73e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:50:20.864074 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6e091-15eb-456e-8691-be4488c73e8b None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:50:20.918843 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:50:20.936694 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e1cb03-c4ee-469e-9beb-7eca24b985d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:50:20.937290 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1cb03-c4ee-469e-9beb-7eca24b985d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:50:20.937588 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1cb03-c4ee-469e-9beb-7eca24b985d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:50:20.938056 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1cb03-c4ee-469e-9beb-7eca24b985d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:50:20.939658 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-15e1cb03-c4ee-469e-9beb-7eca24b985d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:50:21.051848 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e1cb03-c4ee-469e-9beb-7eca24b985d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:50:21.053289 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e1cb03-c4ee-469e-9beb-7eca24b985d2 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:50:21.070939 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 744/1461] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:50:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:50:23.266958 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0731a-d045-4fd9-8e97-7816945ee3da None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:50:23.267488 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0731a-d045-4fd9-8e97-7816945ee3da None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:50:23.267488 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0731a-d045-4fd9-8e97-7816945ee3da None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:50:23.268764 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 718/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 15:50:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:50:23.274039 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f59223-80a3-48a7-ac0d-9bbe635b2f35 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:50:23.274476 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f59223-80a3-48a7-ac0d-9bbe635b2f35 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:50:23.274621 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f59223-80a3-48a7-ac0d-9bbe635b2f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:50:23.343320 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-53f59223-80a3-48a7-ac0d-9bbe635b2f35 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:50:23.344776 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-53f59223-80a3-48a7-ac0d-9bbe635b2f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:50:23.382667 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:50:23.443945 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 745/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 15:50:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:50:23.727097 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0731a-d045-4fd9-8e97-7816945ee3da None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:50:23.728639 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-ebc0731a-d045-4fd9-8e97-7816945ee3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:50:23.832021 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0731a-d045-4fd9-8e97-7816945ee3da None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:50:23.869911 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:50:23.905947 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21db4b5-9d1e-458e-8fa4-44dce9562ae5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:50:23.907515 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21db4b5-9d1e-458e-8fa4-44dce9562ae5 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:50:23.907794 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21db4b5-9d1e-458e-8fa4-44dce9562ae5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:50:23.908068 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21db4b5-9d1e-458e-8fa4-44dce9562ae5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:50:23.909679 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-e21db4b5-9d1e-458e-8fa4-44dce9562ae5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:50:24.016453 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21db4b5-9d1e-458e-8fa4-44dce9562ae5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:50:24.017873 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21db4b5-9d1e-458e-8fa4-44dce9562ae5 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:50:24.037942 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 719/1464] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:50:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:50:26.422931 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d5383-3c5a-4a4f-82bb-61e6faba9734 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:50:26.423478 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d5383-3c5a-4a4f-82bb-61e6faba9734 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:50:26.423478 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d5383-3c5a-4a4f-82bb-61e6faba9734 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:50:26.424738 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 746/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 15:50:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:50:26.430157 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd8eeb-ed25-40c0-bc1b-8232e594340e None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:50:26.430676 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd8eeb-ed25-40c0-bc1b-8232e594340e None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:50:26.430786 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd8eeb-ed25-40c0-bc1b-8232e594340e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:50:26.497769 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-2bcd8eeb-ed25-40c0-bc1b-8232e594340e None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:50:26.499009 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-2bcd8eeb-ed25-40c0-bc1b-8232e594340e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:50:26.517083 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:50:26.594314 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 720/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 15:50:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:50:26.880938 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d5383-3c5a-4a4f-82bb-61e6faba9734 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:50:26.882510 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-0d5d5383-3c5a-4a4f-82bb-61e6faba9734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:50:26.987013 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d5383-3c5a-4a4f-82bb-61e6faba9734 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:50:27.053241 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:50:27.060461 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee19bb-c930-4f4a-a695-06f6c3e03925 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:50:27.061062 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee19bb-c930-4f4a-a695-06f6c3e03925 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:50:27.061337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee19bb-c930-4f4a-a695-06f6c3e03925 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:50:27.061604 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee19bb-c930-4f4a-a695-06f6c3e03925 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:50:27.063494 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-1eee19bb-c930-4f4a-a695-06f6c3e03925 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:50:27.170762 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee19bb-c930-4f4a-a695-06f6c3e03925 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:50:27.172350 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee19bb-c930-4f4a-a695-06f6c3e03925 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:50:27.190102 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 747/1467] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:50:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:50:29.377919 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5b5ee-7cdc-494a-a9da-2419b68e4218 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:50:29.378505 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5b5ee-7cdc-494a-a9da-2419b68e4218 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:50:29.378505 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5b5ee-7cdc-494a-a9da-2419b68e4218 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:50:29.379752 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 721/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 15:50:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:50:29.385030 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d4416-3507-4c3b-802c-155ccc512567 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:50:29.385482 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d4416-3507-4c3b-802c-155ccc512567 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:50:29.385620 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d4416-3507-4c3b-802c-155ccc512567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:50:29.452007 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-b31d4416-3507-4c3b-802c-155ccc512567 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:50:29.453325 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-b31d4416-3507-4c3b-802c-155ccc512567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:50:29.501170 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:50:29.550504 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 748/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 15:50:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:50:29.832565 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5b5ee-7cdc-494a-a9da-2419b68e4218 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:50:29.834160 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-11c5b5ee-7cdc-494a-a9da-2419b68e4218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:50:29.937497 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5b5ee-7cdc-494a-a9da-2419b68e4218 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:50:29.984027 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:50:30.010984 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784b3dd-191d-43a9-8747-c02a6ad55fa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:50:30.011579 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784b3dd-191d-43a9-8747-c02a6ad55fa3 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:50:30.011854 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784b3dd-191d-43a9-8747-c02a6ad55fa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:50:30.012122 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784b3dd-191d-43a9-8747-c02a6ad55fa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:50:30.013689 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-8784b3dd-191d-43a9-8747-c02a6ad55fa3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:50:30.122454 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8784b3dd-191d-43a9-8747-c02a6ad55fa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:50:30.123808 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8784b3dd-191d-43a9-8747-c02a6ad55fa3 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:50:30.142405 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 722/1470] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:50:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:50:39.548511 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=22 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:50:40.140161 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=66 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:50:50.225348 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a2286-523a-4b1c-9f92-57e63373dd76 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:50:50.225908 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a2286-523a-4b1c-9f92-57e63373dd76 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:50:50.225908 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a2286-523a-4b1c-9f92-57e63373dd76 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:50:50.227260 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 749/1471] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:50:50.232524 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928ecf0-62e5-45df-a1fa-d23e2ed670af None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:50:50.232950 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928ecf0-62e5-45df-a1fa-d23e2ed670af None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:50:50.233055 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928ecf0-62e5-45df-a1fa-d23e2ed670af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:50:50.299231 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-0928ecf0-62e5-45df-a1fa-d23e2ed670af None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:50:50.300362 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-0928ecf0-62e5-45df-a1fa-d23e2ed670af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:50:50.395456 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 723/1472] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:50:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:50:50.696690 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec0fc9-a0d5-403b-84a8-7692eaea7504 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:50:50.696972 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec0fc9-a0d5-403b-84a8-7692eaea7504 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:50:50.697246 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec0fc9-a0d5-403b-84a8-7692eaea7504 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:50:50.698590 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 750/1473] 10.222.0.16 () {54 vars in 961 bytes} [Wed Sep 7 15:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:50:50.703653 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da234f6-22c9-4216-b87f-df55dc72d4d0 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:50:50.703934 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da234f6-22c9-4216-b87f-df55dc72d4d0 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:50:50.704206 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da234f6-22c9-4216-b87f-df55dc72d4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:50:50.780585 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-0da234f6-22c9-4216-b87f-df55dc72d4d0 None None] MFA Rules not processed for user `5753fea47f5944cd93dbea90fb9ad9b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:50:50.781967 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-0da234f6-22c9-4216-b87f-df55dc72d4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:50:50.802724 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:50:50.857769 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 724/1474] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Sep 7 15:50:50 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:50:50.866001 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec0fc9-a0d5-403b-84a8-7692eaea7504 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:50:50.867537 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-84ec0fc9-a0d5-403b-84a8-7692eaea7504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:50:50.969765 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec0fc9-a0d5-403b-84a8-7692eaea7504 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:50:51.044343 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd542f0-f9f3-4ddd-bce6-6bad8080992c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5753fea47f5944cd93dbea90fb9ad9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:50:51.044957 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd542f0-f9f3-4ddd-bce6-6bad8080992c service glance] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:50:51.045232 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd542f0-f9f3-4ddd-bce6-6bad8080992c service glance] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:50:51.045502 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd542f0-f9f3-4ddd-bce6-6bad8080992c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:50:51.048130 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-7cd542f0-f9f3-4ddd-bce6-6bad8080992c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:50:51.102309 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:50:51.158748 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd542f0-f9f3-4ddd-bce6-6bad8080992c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:50:51.160183 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd542f0-f9f3-4ddd-bce6-6bad8080992c service glance] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:50:51.178155 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 751/1475] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:50:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:50:53.416330 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09271bed-2439-4d9f-b99f-fbb56e932712 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:50:53.416838 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09271bed-2439-4d9f-b99f-fbb56e932712 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:50:53.416838 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09271bed-2439-4d9f-b99f-fbb56e932712 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:50:53.418135 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 725/1476] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:50:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:50:53.424167 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da113c72-c961-4175-b4a2-a8cd8ba4a949 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:50:53.424600 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da113c72-c961-4175-b4a2-a8cd8ba4a949 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:50:53.424698 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da113c72-c961-4175-b4a2-a8cd8ba4a949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:50:53.489603 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-da113c72-c961-4175-b4a2-a8cd8ba4a949 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:50:53.490835 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-da113c72-c961-4175-b4a2-a8cd8ba4a949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:50:53.585298 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 752/1477] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:50:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:50:53.855341 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09271bed-2439-4d9f-b99f-fbb56e932712 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:50:53.856884 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-09271bed-2439-4d9f-b99f-fbb56e932712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:50:54.005672 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09271bed-2439-4d9f-b99f-fbb56e932712 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:50:54.055428 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:50:54.100772 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c942d-fb0f-4e4d-93ba-726076867456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:50:54.101379 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c942d-fb0f-4e4d-93ba-726076867456 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:50:54.101658 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c942d-fb0f-4e4d-93ba-726076867456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:50:54.101936 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c942d-fb0f-4e4d-93ba-726076867456 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:50:54.102604 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2c942d-fb0f-4e4d-93ba-726076867456 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:50:54.104315 dv-cinder-853315-8-smb devstack@keystone.service[81502]: WARNING py.warnings [None req-4b2c942d-fb0f-4e4d-93ba-726076867456 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 15:50:54.104315 dv-cinder-853315-8-smb devstack@keystone.service[81502]: warnings.warn(msg) Sep 07 15:50:54.104315 dv-cinder-853315-8-smb devstack@keystone.service[81502]: Sep 07 15:50:54.105511 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2c942d-fb0f-4e4d-93ba-726076867456 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:50:54.124853 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 726/1478] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Sep 7 15:50:53 2022] GET /identity/v3/projects => generated 2553 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:50:56.329516 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd30d71-46d7-42e1-acae-54082f24abf6 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:50:56.330059 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd30d71-46d7-42e1-acae-54082f24abf6 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:50:56.330059 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd30d71-46d7-42e1-acae-54082f24abf6 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:50:56.331354 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 753/1479] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:50:56.336617 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2472df43-b139-49cf-874b-a9bee1379a90 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:50:56.337044 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2472df43-b139-49cf-874b-a9bee1379a90 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:50:56.337227 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2472df43-b139-49cf-874b-a9bee1379a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:50:56.402599 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-2472df43-b139-49cf-874b-a9bee1379a90 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:50:56.403805 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-2472df43-b139-49cf-874b-a9bee1379a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:50:56.500408 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 727/1480] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:50:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:50:56.791684 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd30d71-46d7-42e1-acae-54082f24abf6 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:50:56.793202 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-2fd30d71-46d7-42e1-acae-54082f24abf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:50:56.803530 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:50:56.940841 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd30d71-46d7-42e1-acae-54082f24abf6 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:50:57.023725 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:50:57.058067 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a98b2-0e63-42c6-b07b-939c707ae321 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:50:57.058712 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a98b2-0e63-42c6-b07b-939c707ae321 service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:50:57.059021 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a98b2-0e63-42c6-b07b-939c707ae321 service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:50:57.059294 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a98b2-0e63-42c6-b07b-939c707ae321 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:50:57.060930 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-043a98b2-0e63-42c6-b07b-939c707ae321 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:50:57.150578 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a98b2-0e63-42c6-b07b-939c707ae321 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:50:57.152158 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a98b2-0e63-42c6-b07b-939c707ae321 service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:50:57.170702 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 754/1481] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:50:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:50:59.522975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e41e7-224c-4290-a722-c222010598b5 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:50:59.523509 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e41e7-224c-4290-a722-c222010598b5 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:50:59.523509 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e41e7-224c-4290-a722-c222010598b5 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:50:59.524875 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 728/1482] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:50:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:50:59.530801 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdd330-d996-4f10-a4b5-2b3f237845a0 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:50:59.531231 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdd330-d996-4f10-a4b5-2b3f237845a0 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:50:59.531404 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdd330-d996-4f10-a4b5-2b3f237845a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:50:59.596457 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-debdd330-d996-4f10-a4b5-2b3f237845a0 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:50:59.597655 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-debdd330-d996-4f10-a4b5-2b3f237845a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:50:59.645026 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:50:59.696221 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 755/1483] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:50:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:50:59.987474 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e41e7-224c-4290-a722-c222010598b5 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:50:59.989030 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-908e41e7-224c-4290-a722-c222010598b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:51:00.014151 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:51:00.097571 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e41e7-224c-4290-a722-c222010598b5 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:51:00.169655 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a42259-cbac-4cbc-bbb2-9f952dbec8da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:51:00.170288 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a42259-cbac-4cbc-bbb2-9f952dbec8da service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:51:00.170573 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a42259-cbac-4cbc-bbb2-9f952dbec8da service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:51:00.171411 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a42259-cbac-4cbc-bbb2-9f952dbec8da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:51:00.173011 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-19a42259-cbac-4cbc-bbb2-9f952dbec8da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:51:00.248005 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:51:00.286335 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a42259-cbac-4cbc-bbb2-9f952dbec8da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:51:00.287773 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a42259-cbac-4cbc-bbb2-9f952dbec8da service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:51:00.305823 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 729/1484] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:50:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:51:02.505205 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607fa0e7-9bc9-48fc-a45a-35eda2372365 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:51:02.505744 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607fa0e7-9bc9-48fc-a45a-35eda2372365 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:51:02.505744 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607fa0e7-9bc9-48fc-a45a-35eda2372365 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:51:02.507127 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 756/1485] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:51:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:51:02.512393 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227a17b-4fcc-4130-9654-8a9ab322b7e2 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:51:02.512790 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227a17b-4fcc-4130-9654-8a9ab322b7e2 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:51:02.513042 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227a17b-4fcc-4130-9654-8a9ab322b7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:51:02.580529 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-d227a17b-4fcc-4130-9654-8a9ab322b7e2 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:51:02.581727 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-d227a17b-4fcc-4130-9654-8a9ab322b7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:51:02.677450 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 730/1486] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:51:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:51:02.963692 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607fa0e7-9bc9-48fc-a45a-35eda2372365 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:51:02.965286 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-607fa0e7-9bc9-48fc-a45a-35eda2372365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:51:03.072073 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607fa0e7-9bc9-48fc-a45a-35eda2372365 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:51:03.143774 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:51:03.145502 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad5800-3e99-4df7-a6d1-9bc80959bcdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:51:03.146114 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad5800-3e99-4df7-a6d1-9bc80959bcdd service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:51:03.146619 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad5800-3e99-4df7-a6d1-9bc80959bcdd service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:51:03.147108 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad5800-3e99-4df7-a6d1-9bc80959bcdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:51:03.148878 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-faad5800-3e99-4df7-a6d1-9bc80959bcdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:51:03.257551 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad5800-3e99-4df7-a6d1-9bc80959bcdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:51:03.258924 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad5800-3e99-4df7-a6d1-9bc80959bcdd service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:51:03.286566 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 757/1487] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:51:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:51:05.530352 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef2c3c-8ff9-4780-84ec-960aaff3b55b None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:51:05.530945 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef2c3c-8ff9-4780-84ec-960aaff3b55b None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:51:05.531077 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef2c3c-8ff9-4780-84ec-960aaff3b55b None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:51:05.532420 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 731/1488] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:51:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:51:05.537839 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f71cf-8afa-4dbe-8125-fbbad161856a None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:51:05.538265 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f71cf-8afa-4dbe-8125-fbbad161856a None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:51:05.538434 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f71cf-8afa-4dbe-8125-fbbad161856a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:51:05.604222 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-c09f71cf-8afa-4dbe-8125-fbbad161856a None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:51:05.605421 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-c09f71cf-8afa-4dbe-8125-fbbad161856a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:51:05.657756 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:51:05.702339 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 758/1489] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:51:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:51:05.995012 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef2c3c-8ff9-4780-84ec-960aaff3b55b None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:51:05.996554 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-01ef2c3c-8ff9-4780-84ec-960aaff3b55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:51:06.035053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:51:06.104785 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef2c3c-8ff9-4780-84ec-960aaff3b55b None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:51:06.177452 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ceee2-8e03-485b-aa06-8a92b461768a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:51:06.178052 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ceee2-8e03-485b-aa06-8a92b461768a service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:51:06.178364 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ceee2-8e03-485b-aa06-8a92b461768a service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:51:06.178637 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ceee2-8e03-485b-aa06-8a92b461768a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:51:06.180240 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-fc3ceee2-8e03-485b-aa06-8a92b461768a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:51:06.261049 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:51:06.291379 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3ceee2-8e03-485b-aa06-8a92b461768a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:51:06.292818 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3ceee2-8e03-485b-aa06-8a92b461768a service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:51:06.312584 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 732/1490] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:51:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:51:08.645361 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00988e9c-df54-4653-a218-6643024e38a1 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:51:08.645934 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00988e9c-df54-4653-a218-6643024e38a1 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:51:08.645934 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00988e9c-df54-4653-a218-6643024e38a1 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:51:08.647257 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 759/1491] 10.222.0.16 () {54 vars in 927 bytes} [Wed Sep 7 15:51:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:51:08.652429 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1b59e-3e07-4ba9-960e-471a3d6b513d None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:51:08.652838 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1b59e-3e07-4ba9-960e-471a3d6b513d None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:51:08.652977 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1b59e-3e07-4ba9-960e-471a3d6b513d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:51:08.718476 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-3fb1b59e-3e07-4ba9-960e-471a3d6b513d None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:51:08.719684 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-3fb1b59e-3e07-4ba9-960e-471a3d6b513d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:51:08.816192 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 733/1492] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Sep 7 15:51:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:51:09.106165 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00988e9c-df54-4653-a218-6643024e38a1 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:51:09.107760 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-00988e9c-df54-4653-a218-6643024e38a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:51:09.209703 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00988e9c-df54-4653-a218-6643024e38a1 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:51:09.282656 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ffbf9-2c26-44ef-8832-ccd89b13973c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:51:09.283270 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ffbf9-2c26-44ef-8832-ccd89b13973c service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:51:09.283549 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ffbf9-2c26-44ef-8832-ccd89b13973c service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:51:09.283821 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ffbf9-2c26-44ef-8832-ccd89b13973c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:51:09.285398 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-ea8ffbf9-2c26-44ef-8832-ccd89b13973c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:51:09.294704 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:51:09.393814 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8ffbf9-2c26-44ef-8832-ccd89b13973c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:51:09.395269 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8ffbf9-2c26-44ef-8832-ccd89b13973c service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:51:09.416600 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 760/1493] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:51:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:51:18.814430 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=82 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:51:19.414406 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=50 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:52:22.203347 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97d18a-f458-45dc-91c5-a56343c6eddd None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:52:22.203922 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97d18a-f458-45dc-91c5-a56343c6eddd None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:52:22.203922 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97d18a-f458-45dc-91c5-a56343c6eddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:52:22.280059 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-3e97d18a-f458-45dc-91c5-a56343c6eddd None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:52:22.281264 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-3e97d18a-f458-45dc-91c5-a56343c6eddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:52:22.379054 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 734/1494] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:52:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:52:22.387211 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1bd3f6-f6db-48de-a81a-56a9c6d54998 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:52:22.387692 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1bd3f6-f6db-48de-a81a-56a9c6d54998 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:52:22.387795 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1bd3f6-f6db-48de-a81a-56a9c6d54998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:52:22.465463 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-6e1bd3f6-f6db-48de-a81a-56a9c6d54998 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:52:22.466686 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-6e1bd3f6-f6db-48de-a81a-56a9c6d54998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:52:22.563359 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 761/1495] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:52:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:52:22.567876 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e97d18a-f458-45dc-91c5-a56343c6eddd None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:52:22.569218 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-3e97d18a-f458-45dc-91c5-a56343c6eddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:52:22.581041 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e97d18a-f458-45dc-91c5-a56343c6eddd None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:52:22.642026 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:52:22.681541 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07bdffc-ff70-45de-811c-8aee786ca688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:52:22.682151 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07bdffc-ff70-45de-811c-8aee786ca688 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:52:22.682464 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07bdffc-ff70-45de-811c-8aee786ca688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:52:22.682738 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07bdffc-ff70-45de-811c-8aee786ca688 admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:52:22.683374 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07bdffc-ff70-45de-811c-8aee786ca688 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:52:22.684168 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07bdffc-ff70-45de-811c-8aee786ca688 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:52:22.685276 dv-cinder-853315-8-smb devstack@keystone.service[81502]: WARNING py.warnings [None req-b07bdffc-ff70-45de-811c-8aee786ca688 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 07 15:52:22.685276 dv-cinder-853315-8-smb devstack@keystone.service[81502]: warnings.warn(msg) Sep 07 15:52:22.685276 dv-cinder-853315-8-smb devstack@keystone.service[81502]: Sep 07 15:52:22.686160 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07bdffc-ff70-45de-811c-8aee786ca688 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:52:22.697185 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 735/1496] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 15:52:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:52:22.706470 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1bd3f6-f6db-48de-a81a-56a9c6d54998 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:52:22.715928 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1bd3f6-f6db-48de-a81a-56a9c6d54998 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:52:22.777472 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:52:22.811872 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cacbe-259f-4bd9-8e2d-1e9970f6f89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:52:22.812473 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cacbe-259f-4bd9-8e2d-1e9970f6f89a admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:52:22.812747 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cacbe-259f-4bd9-8e2d-1e9970f6f89a admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:52:22.813012 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cacbe-259f-4bd9-8e2d-1e9970f6f89a admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:52:22.813683 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557cacbe-259f-4bd9-8e2d-1e9970f6f89a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:52:22.815422 dv-cinder-853315-8-smb devstack@keystone.service[81501]: WARNING py.warnings [None req-557cacbe-259f-4bd9-8e2d-1e9970f6f89a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 15:52:22.815422 dv-cinder-853315-8-smb devstack@keystone.service[81501]: warnings.warn(msg) Sep 07 15:52:22.815422 dv-cinder-853315-8-smb devstack@keystone.service[81501]: Sep 07 15:52:22.816690 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557cacbe-259f-4bd9-8e2d-1e9970f6f89a admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:52:22.872930 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 762/1497] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:52:22 2022] POST /identity/v3/projects => generated 379 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:52:22.877346 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07bdffc-ff70-45de-811c-8aee786ca688 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:52:22.878905 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b07bdffc-ff70-45de-811c-8aee786ca688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:52:22.913202 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07bdffc-ff70-45de-811c-8aee786ca688 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:52:23.010272 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca8884-c502-4089-bad8-b865b046f8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:52:23.010880 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca8884-c502-4089-bad8-b865b046f8b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:52:23.011167 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca8884-c502-4089-bad8-b865b046f8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:52:23.011440 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca8884-c502-4089-bad8-b865b046f8b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:52:23.012381 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca8884-c502-4089-bad8-b865b046f8b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:52:23.013402 dv-cinder-853315-8-smb devstack@keystone.service[81502]: WARNING py.warnings [None req-b5ca8884-c502-4089-bad8-b865b046f8b6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 15:52:23.013402 dv-cinder-853315-8-smb devstack@keystone.service[81502]: warnings.warn(msg) Sep 07 15:52:23.013402 dv-cinder-853315-8-smb devstack@keystone.service[81502]: Sep 07 15:52:23.014647 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca8884-c502-4089-bad8-b865b046f8b6 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:52:23.063834 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 736/1498] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:52:22 2022] POST /identity/v3/users => generated 290 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:52:23.067896 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cacbe-259f-4bd9-8e2d-1e9970f6f89a admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:52:23.069421 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-557cacbe-259f-4bd9-8e2d-1e9970f6f89a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:52:23.132163 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cacbe-259f-4bd9-8e2d-1e9970f6f89a admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:52:23.215226 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:52:23.226888 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7a65c-361e-43d4-af65-3b2be8789f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:52:23.227493 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7a65c-361e-43d4-af65-3b2be8789f9c admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:52:23.227771 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7a65c-361e-43d4-af65-3b2be8789f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:52:23.228041 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7a65c-361e-43d4-af65-3b2be8789f9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:52:23.228667 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b7a65c-361e-43d4-af65-3b2be8789f9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:52:23.229663 dv-cinder-853315-8-smb devstack@keystone.service[81501]: WARNING py.warnings [None req-07b7a65c-361e-43d4-af65-3b2be8789f9c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 07 15:52:23.229663 dv-cinder-853315-8-smb devstack@keystone.service[81501]: warnings.warn(msg) Sep 07 15:52:23.229663 dv-cinder-853315-8-smb devstack@keystone.service[81501]: Sep 07 15:52:23.231352 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b7a65c-361e-43d4-af65-3b2be8789f9c admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:52:23.243710 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 763/1499] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:52:23.247944 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca8884-c502-4089-bad8-b865b046f8b6 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:52:23.249563 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b5ca8884-c502-4089-bad8-b865b046f8b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:52:23.260835 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca8884-c502-4089-bad8-b865b046f8b6 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:52:23.285745 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:52:23.354953 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d568c-36a9-410d-8dec-9c9de5895966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:52:23.355560 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d568c-36a9-410d-8dec-9c9de5895966 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:52:23.355844 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d568c-36a9-410d-8dec-9c9de5895966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:52:23.356122 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d568c-36a9-410d-8dec-9c9de5895966 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:52:23.356759 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93d568c-36a9-410d-8dec-9c9de5895966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:52:23.357766 dv-cinder-853315-8-smb devstack@keystone.service[81502]: WARNING py.warnings [None req-a93d568c-36a9-410d-8dec-9c9de5895966 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 07 15:52:23.357766 dv-cinder-853315-8-smb devstack@keystone.service[81502]: warnings.warn(msg) Sep 07 15:52:23.357766 dv-cinder-853315-8-smb devstack@keystone.service[81502]: Sep 07 15:52:23.358936 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93d568c-36a9-410d-8dec-9c9de5895966 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:52:23.371664 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 737/1500] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:52:23.375984 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7a65c-361e-43d4-af65-3b2be8789f9c admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:52:23.377519 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-07b7a65c-361e-43d4-af65-3b2be8789f9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:52:23.411972 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7a65c-361e-43d4-af65-3b2be8789f9c admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:52:23.506343 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d0e88-36e8-40bb-9124-2b5177ab6ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:52:23.506995 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d0e88-36e8-40bb-9124-2b5177ab6ff7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:52:23.507268 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d0e88-36e8-40bb-9124-2b5177ab6ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:52:23.507536 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d0e88-36e8-40bb-9124-2b5177ab6ff7 admin admin] PATH_INFO: `/v3/projects/b54c3262a38e48228eb0341555f36e52/users/94251cf7bc7346b78dece40f42b1bbee/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:52:23.530321 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d0e88-36e8-40bb-9124-2b5177ab6ff7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b54c3262a38e48228eb0341555f36e52, user_id=94251cf7bc7346b78dece40f42b1bbee, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:52:23.531329 dv-cinder-853315-8-smb devstack@keystone.service[81501]: WARNING py.warnings [None req-815d0e88-36e8-40bb-9124-2b5177ab6ff7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 15:52:23.531329 dv-cinder-853315-8-smb devstack@keystone.service[81501]: warnings.warn(msg) Sep 07 15:52:23.531329 dv-cinder-853315-8-smb devstack@keystone.service[81501]: Sep 07 15:52:23.533265 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d0e88-36e8-40bb-9124-2b5177ab6ff7 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:52:23.557220 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 764/1501] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:52:23 2022] PUT /identity/v3/projects/b54c3262a38e48228eb0341555f36e52/users/94251cf7bc7346b78dece40f42b1bbee/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:52:23.569199 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c6f0f-d102-404e-8028-c4f4a8410714 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:52:23.569566 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c6f0f-d102-404e-8028-c4f4a8410714 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:52:23.569850 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c6f0f-d102-404e-8028-c4f4a8410714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:52:23.628332 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-304c6f0f-d102-404e-8028-c4f4a8410714 None None] MFA Rules not processed for user `94251cf7bc7346b78dece40f42b1bbee`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:52:23.629497 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-304c6f0f-d102-404e-8028-c4f4a8410714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:52:23.705725 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 738/1502] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:52:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:52:23.719570 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9cf846-d537-4f63-afa1-440137fe98f9 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:52:23.719855 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9cf846-d537-4f63-afa1-440137fe98f9 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:52:23.720130 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9cf846-d537-4f63-afa1-440137fe98f9 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:52:23.721497 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 765/1503] 10.222.0.16 () {54 vars in 964 bytes} [Wed Sep 7 15:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:52:23.726123 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97fb526-1b03-4dba-bd84-ecfc1a0f1bae None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:52:23.726429 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97fb526-1b03-4dba-bd84-ecfc1a0f1bae None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:52:23.726704 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97fb526-1b03-4dba-bd84-ecfc1a0f1bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:52:23.757779 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:52:23.802195 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-c97fb526-1b03-4dba-bd84-ecfc1a0f1bae None None] MFA Rules not processed for user `99f8fac7bf3842cba115fa03ef9291d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:52:23.803404 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-c97fb526-1b03-4dba-bd84-ecfc1a0f1bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:52:23.878575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 739/1504] 10.222.0.16 () {58 vars in 1061 bytes} [Wed Sep 7 15:52:23 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:52:23.886301 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9cf846-d537-4f63-afa1-440137fe98f9 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:52:23.888474 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-de9cf846-d537-4f63-afa1-440137fe98f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:52:23.937423 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:52:23.992868 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9cf846-d537-4f63-afa1-440137fe98f9 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:52:24.066536 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cedf1b-ba4c-4245-8674-640d64cced7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:52:24.067143 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cedf1b-ba4c-4245-8674-640d64cced7c service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:52:24.067419 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cedf1b-ba4c-4245-8674-640d64cced7c service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:52:24.067691 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cedf1b-ba4c-4245-8674-640d64cced7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:52:24.069265 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-58cedf1b-ba4c-4245-8674-640d64cced7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:52:24.165798 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cedf1b-ba4c-4245-8674-640d64cced7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:52:24.167165 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cedf1b-ba4c-4245-8674-640d64cced7c service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:52:24.171299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:52:24.185857 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 766/1505] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:52:23 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 15:52:24.232132 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb25987-76c2-40b7-9438-46acae265ce4 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:52:24.232420 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb25987-76c2-40b7-9438-46acae265ce4 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:52:24.232702 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb25987-76c2-40b7-9438-46acae265ce4 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:52:24.234229 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 740/1506] 10.222.0.16 () {52 vars in 830 bytes} [Wed Sep 7 15:52:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:52:24.237741 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cedf1b-ba4c-4245-8674-640d64cced7c service cinder] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:52:24.238984 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-58cedf1b-ba4c-4245-8674-640d64cced7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:52:24.335405 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cedf1b-ba4c-4245-8674-640d64cced7c service cinder] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:52:24.431393 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f1499-f5de-4476-bab5-b424bfdb8332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:52:24.432033 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f1499-f5de-4476-bab5-b424bfdb8332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:52:24.432283 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f1499-f5de-4476-bab5-b424bfdb8332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:52:24.432551 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f1499-f5de-4476-bab5-b424bfdb8332 admin admin] PATH_INFO: `/v3/users/94251cf7bc7346b78dece40f42b1bbee` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:52:24.445212 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1f1499-f5de-4476-bab5-b424bfdb8332 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94251cf7bc7346b78dece40f42b1bbee)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:52:24.446240 dv-cinder-853315-8-smb devstack@keystone.service[81501]: WARNING py.warnings [None req-ae1f1499-f5de-4476-bab5-b424bfdb8332 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 15:52:24.446240 dv-cinder-853315-8-smb devstack@keystone.service[81501]: warnings.warn(msg) Sep 07 15:52:24.446240 dv-cinder-853315-8-smb devstack@keystone.service[81501]: Sep 07 15:52:24.447450 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1f1499-f5de-4476-bab5-b424bfdb8332 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:52:24.456893 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:52:24.513192 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-ae1f1499-f5de-4476-bab5-b424bfdb8332 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94251cf7bc7346b78dece40f42b1bbee'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:52:24.522501 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-ae1f1499-f5de-4476-bab5-b424bfdb8332 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94251cf7bc7346b78dece40f42b1bbee'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:52:24.522932 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-ae1f1499-f5de-4476-bab5-b424bfdb8332 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94251cf7bc7346b78dece40f42b1bbee'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:52:24.547490 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-ae1f1499-f5de-4476-bab5-b424bfdb8332 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94251cf7bc7346b78dece40f42b1bbee'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:52:24.548065 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-ae1f1499-f5de-4476-bab5-b424bfdb8332 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94251cf7bc7346b78dece40f42b1bbee'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:52:24.567765 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 767/1507] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:52:24 2022] DELETE /identity/v3/users/94251cf7bc7346b78dece40f42b1bbee => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:52:24.572084 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b20880-7076-42bc-90bb-60d5902f0634 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:52:24.572564 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b20880-7076-42bc-90bb-60d5902f0634 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:52:24.572656 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b20880-7076-42bc-90bb-60d5902f0634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:52:24.630732 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-90b20880-7076-42bc-90bb-60d5902f0634 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:52:24.631950 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-90b20880-7076-42bc-90bb-60d5902f0634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:52:24.707549 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:52:24.721291 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 741/1508] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:52:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:52:24.731761 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f1499-f5de-4476-bab5-b424bfdb8332 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:52:24.732988 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-ae1f1499-f5de-4476-bab5-b424bfdb8332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:52:24.832578 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f1499-f5de-4476-bab5-b424bfdb8332 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:52:24.888018 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:52:24.908479 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8316e-3343-41c0-b081-02a0975feadf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:52:24.909081 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8316e-3343-41c0-b081-02a0975feadf service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:52:24.909357 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8316e-3343-41c0-b081-02a0975feadf service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:52:24.909624 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8316e-3343-41c0-b081-02a0975feadf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:52:24.911231 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-ccc8316e-3343-41c0-b081-02a0975feadf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:52:25.021198 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc8316e-3343-41c0-b081-02a0975feadf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:52:25.022600 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc8316e-3343-41c0-b081-02a0975feadf service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:52:25.041921 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 768/1509] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:52:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:52:25.399433 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b20880-7076-42bc-90bb-60d5902f0634 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:52:25.400739 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-90b20880-7076-42bc-90bb-60d5902f0634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:52:25.413484 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b20880-7076-42bc-90bb-60d5902f0634 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:52:25.517016 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955851fd-9670-4038-a084-c450c4eb1581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:52:25.517644 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955851fd-9670-4038-a084-c450c4eb1581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:52:25.517924 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955851fd-9670-4038-a084-c450c4eb1581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:52:25.518221 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955851fd-9670-4038-a084-c450c4eb1581 admin admin] PATH_INFO: `/v3/projects/b54c3262a38e48228eb0341555f36e52` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:52:25.529114 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955851fd-9670-4038-a084-c450c4eb1581 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b54c3262a38e48228eb0341555f36e52)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:52:25.530069 dv-cinder-853315-8-smb devstack@keystone.service[81502]: WARNING py.warnings [None req-955851fd-9670-4038-a084-c450c4eb1581 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 15:52:25.530069 dv-cinder-853315-8-smb devstack@keystone.service[81502]: warnings.warn(msg) Sep 07 15:52:25.530069 dv-cinder-853315-8-smb devstack@keystone.service[81502]: Sep 07 15:52:25.531298 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955851fd-9670-4038-a084-c450c4eb1581 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:52:25.587841 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-955851fd-9670-4038-a084-c450c4eb1581 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b54c3262a38e48228eb0341555f36e52', 'request_id': 'req-955851fd-9670-4038-a084-c450c4eb1581'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:52:25.594524 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-955851fd-9670-4038-a084-c450c4eb1581 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b54c3262a38e48228eb0341555f36e52', 'request_id': 'req-955851fd-9670-4038-a084-c450c4eb1581'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:52:25.609010 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-955851fd-9670-4038-a084-c450c4eb1581 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b54c3262a38e48228eb0341555f36e52', 'request_id': 'req-955851fd-9670-4038-a084-c450c4eb1581'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:52:25.635990 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-955851fd-9670-4038-a084-c450c4eb1581 admin admin] The token cache is being invalidate because project b54c3262a38e48228eb0341555f36e52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:52:25.636277 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-955851fd-9670-4038-a084-c450c4eb1581 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:52:25.636870 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-955851fd-9670-4038-a084-c450c4eb1581 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:52:25.638339 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 742/1510] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:52:25 2022] DELETE /identity/v3/projects/b54c3262a38e48228eb0341555f36e52 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:52:35.039482 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=62 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:52:35.633992 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:54:01.563595 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b293cb0-db9e-4bec-9b0b-4fcb8eb5511f None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:54:01.564196 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b293cb0-db9e-4bec-9b0b-4fcb8eb5511f None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:54:01.564196 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b293cb0-db9e-4bec-9b0b-4fcb8eb5511f None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:54:01.565488 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 769/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 15:54:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:54:01.570245 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90109f-dead-45a5-a4b0-6578c22a0d5b None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:54:01.570653 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90109f-dead-45a5-a4b0-6578c22a0d5b None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:54:01.570804 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90109f-dead-45a5-a4b0-6578c22a0d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:54:01.652939 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-fe90109f-dead-45a5-a4b0-6578c22a0d5b None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:54:01.654136 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-fe90109f-dead-45a5-a4b0-6578c22a0d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:54:01.760711 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 743/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 15:54:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:54:01.914951 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b293cb0-db9e-4bec-9b0b-4fcb8eb5511f None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:54:01.917392 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-8b293cb0-db9e-4bec-9b0b-4fcb8eb5511f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:54:02.037412 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b293cb0-db9e-4bec-9b0b-4fcb8eb5511f None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:54:02.043569 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70df5b2-04f8-4d72-bb8f-a50fd753b8d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:54:02.044217 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70df5b2-04f8-4d72-bb8f-a50fd753b8d7 service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:54:02.044568 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70df5b2-04f8-4d72-bb8f-a50fd753b8d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:54:02.044914 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70df5b2-04f8-4d72-bb8f-a50fd753b8d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:54:02.057636 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70df5b2-04f8-4d72-bb8f-a50fd753b8d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:54:02.059349 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70df5b2-04f8-4d72-bb8f-a50fd753b8d7 service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:54:02.069581 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 770/1513] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:54:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:54:03.177067 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03101f14-2df4-45b7-8626-b5d42417c3ca None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:54:03.177631 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03101f14-2df4-45b7-8626-b5d42417c3ca None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:54:03.177631 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03101f14-2df4-45b7-8626-b5d42417c3ca None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:54:03.179014 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 744/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 15:54:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:54:03.185167 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7faf1e-c41e-4464-ae80-258aeb64bc72 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:54:03.185628 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7faf1e-c41e-4464-ae80-258aeb64bc72 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:54:03.185736 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7faf1e-c41e-4464-ae80-258aeb64bc72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:54:03.205761 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-7a7faf1e-c41e-4464-ae80-258aeb64bc72 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:54:03.207003 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-7a7faf1e-c41e-4464-ae80-258aeb64bc72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:54:03.215917 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 771/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 15:54:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:54:03.367923 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03101f14-2df4-45b7-8626-b5d42417c3ca None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:54:03.383182 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03101f14-2df4-45b7-8626-b5d42417c3ca None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:54:03.389567 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f06367a-fe97-4692-89e3-37d354c68480 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:54:03.390168 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06367a-fe97-4692-89e3-37d354c68480 service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:54:03.390476 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06367a-fe97-4692-89e3-37d354c68480 service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:54:03.390751 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06367a-fe97-4692-89e3-37d354c68480 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:54:03.399302 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f06367a-fe97-4692-89e3-37d354c68480 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:54:03.401037 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f06367a-fe97-4692-89e3-37d354c68480 service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:54:03.410992 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 745/1516] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:54:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:54:03.439359 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeaa582-9772-4458-8cc4-b18247c2201d None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:54:03.439643 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeaa582-9772-4458-8cc4-b18247c2201d None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:54:03.439915 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeaa582-9772-4458-8cc4-b18247c2201d None None] PATH_INFO: `/v3` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:54:03.441162 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 772/1517] 10.222.0.26 () {54 vars in 925 bytes} [Wed Sep 7 15:54:03 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:54:03.448470 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410aaf32-d7e2-417b-81c3-05d359822447 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:54:03.448756 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410aaf32-d7e2-417b-81c3-05d359822447 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:54:03.449030 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410aaf32-d7e2-417b-81c3-05d359822447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:54:03.520002 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-410aaf32-d7e2-417b-81c3-05d359822447 None None] MFA Rules not processed for user `66c270b488024605af84e52d874474e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:54:03.522598 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-410aaf32-d7e2-417b-81c3-05d359822447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:54:03.541045 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:54:03.599881 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 746/1518] 10.222.0.26 () {58 vars in 1015 bytes} [Wed Sep 7 15:54:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:54:07.182149 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ead63-6d39-43df-9e47-5d822ca02eab None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:54:07.182878 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ead63-6d39-43df-9e47-5d822ca02eab None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:54:07.182878 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ead63-6d39-43df-9e47-5d822ca02eab None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:54:07.184042 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 773/1519] 10.222.0.16 () {54 vars in 961 bytes} [Wed Sep 7 15:54:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:54:07.188917 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772704a-6dc8-43f9-b3c4-dc85eb36421a None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:54:07.189351 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772704a-6dc8-43f9-b3c4-dc85eb36421a None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:54:07.189474 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772704a-6dc8-43f9-b3c4-dc85eb36421a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:54:07.208685 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-0772704a-6dc8-43f9-b3c4-dc85eb36421a None None] MFA Rules not processed for user `66c270b488024605af84e52d874474e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:54:07.209858 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-0772704a-6dc8-43f9-b3c4-dc85eb36421a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:54:07.218871 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 747/1520] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Sep 7 15:54:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:54:07.226731 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ead63-6d39-43df-9e47-5d822ca02eab None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:54:07.240875 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ead63-6d39-43df-9e47-5d822ca02eab None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:54:07.245842 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d39a319-26ad-44e8-8c1f-c90d6267166d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c270b488024605af84e52d874474e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:54:07.246469 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39a319-26ad-44e8-8c1f-c90d6267166d service placement] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:54:07.246755 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39a319-26ad-44e8-8c1f-c90d6267166d service placement] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:54:07.247034 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39a319-26ad-44e8-8c1f-c90d6267166d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:54:07.257512 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d39a319-26ad-44e8-8c1f-c90d6267166d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:54:07.260406 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d39a319-26ad-44e8-8c1f-c90d6267166d service placement] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:54:07.273131 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 774/1521] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:54:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:54:14.896593 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd9094-a809-4781-8f41-36b953cd9662 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:54:14.897158 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd9094-a809-4781-8f41-36b953cd9662 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:54:14.897158 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd9094-a809-4781-8f41-36b953cd9662 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:54:14.898530 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 748/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 15:54:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:54:14.905596 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae4cfb-af3e-4427-a015-6173ad3d3f42 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:54:14.906036 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae4cfb-af3e-4427-a015-6173ad3d3f42 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:54:14.906146 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae4cfb-af3e-4427-a015-6173ad3d3f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:54:14.926200 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-b2ae4cfb-af3e-4427-a015-6173ad3d3f42 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:54:14.927436 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-b2ae4cfb-af3e-4427-a015-6173ad3d3f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:54:14.935334 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 775/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 15:54:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:54:15.091455 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd9094-a809-4781-8f41-36b953cd9662 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:54:15.105816 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd9094-a809-4781-8f41-36b953cd9662 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:54:15.111478 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1105d91-930a-424a-acf4-16f7cd2f4418 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:54:15.112067 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1105d91-930a-424a-acf4-16f7cd2f4418 service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:54:15.112349 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1105d91-930a-424a-acf4-16f7cd2f4418 service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:54:15.112619 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1105d91-930a-424a-acf4-16f7cd2f4418 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:54:15.120804 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1105d91-930a-424a-acf4-16f7cd2f4418 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:54:15.122416 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1105d91-930a-424a-acf4-16f7cd2f4418 service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:54:15.131549 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 749/1524] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:54:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:54:16.241433 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a77790-473a-42d7-8ee1-17249906233d None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:54:16.242022 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a77790-473a-42d7-8ee1-17249906233d None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:54:16.242022 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a77790-473a-42d7-8ee1-17249906233d None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:54:16.243388 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 776/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 15:54:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:54:16.250549 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f25bfb-8251-479d-9f58-2e5eb64ad290 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:54:16.251034 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f25bfb-8251-479d-9f58-2e5eb64ad290 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:54:16.251164 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f25bfb-8251-479d-9f58-2e5eb64ad290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:54:16.272647 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-80f25bfb-8251-479d-9f58-2e5eb64ad290 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:54:16.273895 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-80f25bfb-8251-479d-9f58-2e5eb64ad290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:54:16.283607 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 750/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 15:54:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:54:16.449150 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a77790-473a-42d7-8ee1-17249906233d None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:54:16.465407 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a77790-473a-42d7-8ee1-17249906233d None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:54:16.470955 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e06ddce-73e1-421a-835c-5e09b57009f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:54:16.471566 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06ddce-73e1-421a-835c-5e09b57009f0 service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:54:16.471851 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06ddce-73e1-421a-835c-5e09b57009f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:54:16.472128 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06ddce-73e1-421a-835c-5e09b57009f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:54:16.484607 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e06ddce-73e1-421a-835c-5e09b57009f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:54:16.486257 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e06ddce-73e1-421a-835c-5e09b57009f0 service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:54:16.497760 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 777/1527] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:54:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:54:20.794383 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfaab00-550d-4f25-91e5-a671dfd500c0 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:54:20.794948 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfaab00-550d-4f25-91e5-a671dfd500c0 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:54:20.794948 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfaab00-550d-4f25-91e5-a671dfd500c0 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:54:20.796275 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 751/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 15:54:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:54:20.801341 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ae1dc-4ccd-4279-9f4f-ea76e3aaf0d1 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:54:20.801746 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ae1dc-4ccd-4279-9f4f-ea76e3aaf0d1 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:54:20.801894 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ae1dc-4ccd-4279-9f4f-ea76e3aaf0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:54:20.821479 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-620ae1dc-4ccd-4279-9f4f-ea76e3aaf0d1 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:54:20.822966 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-620ae1dc-4ccd-4279-9f4f-ea76e3aaf0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:54:20.830728 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 778/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 15:54:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:54:21.119597 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfaab00-550d-4f25-91e5-a671dfd500c0 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:54:21.121293 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-dcfaab00-550d-4f25-91e5-a671dfd500c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:54:21.198184 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfaab00-550d-4f25-91e5-a671dfd500c0 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:54:21.201738 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2026fa2-490c-4430-81f9-abbb40029d17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:54:21.202372 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2026fa2-490c-4430-81f9-abbb40029d17 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:54:21.202656 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2026fa2-490c-4430-81f9-abbb40029d17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:54:21.202928 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2026fa2-490c-4430-81f9-abbb40029d17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:54:21.211672 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2026fa2-490c-4430-81f9-abbb40029d17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:54:21.213126 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2026fa2-490c-4430-81f9-abbb40029d17 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:54:21.222453 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 752/1530] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:54:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:54:23.358449 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe6ffb-0371-4ea1-9cb3-de919c64803d None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:54:23.359004 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe6ffb-0371-4ea1-9cb3-de919c64803d None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:54:23.359004 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe6ffb-0371-4ea1-9cb3-de919c64803d None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:54:23.360302 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 779/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 15:54:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:54:23.365705 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2e053-3c26-4d61-a771-edec76efe5f0 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:54:23.366121 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2e053-3c26-4d61-a771-edec76efe5f0 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:54:23.366282 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2e053-3c26-4d61-a771-edec76efe5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:54:23.385883 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-d4b2e053-3c26-4d61-a771-edec76efe5f0 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:54:23.387097 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-d4b2e053-3c26-4d61-a771-edec76efe5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:54:23.394819 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 753/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 15:54:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:54:23.684146 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe6ffb-0371-4ea1-9cb3-de919c64803d None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:54:23.695006 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe6ffb-0371-4ea1-9cb3-de919c64803d None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:54:23.699549 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5d42c-0ee4-4db8-ada1-93a562a48144 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:54:23.700147 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5d42c-0ee4-4db8-ada1-93a562a48144 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:54:23.700430 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5d42c-0ee4-4db8-ada1-93a562a48144 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:54:23.700706 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5d42c-0ee4-4db8-ada1-93a562a48144 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:54:23.709497 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac5d42c-0ee4-4db8-ada1-93a562a48144 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:54:23.710961 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac5d42c-0ee4-4db8-ada1-93a562a48144 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:54:23.720848 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 780/1533] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:54:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:54:27.474336 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c13ea-fec9-45f8-a5f3-f2f8df4a8f3c None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:54:27.474929 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c13ea-fec9-45f8-a5f3-f2f8df4a8f3c None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:54:27.474929 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c13ea-fec9-45f8-a5f3-f2f8df4a8f3c None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:54:27.476336 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 754/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 15:54:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:54:27.482370 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d09926-37d2-4135-9680-a832753cef47 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:54:27.482778 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d09926-37d2-4135-9680-a832753cef47 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:54:27.482921 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d09926-37d2-4135-9680-a832753cef47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:54:27.490718 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=81 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:54:27.503664 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-93d09926-37d2-4135-9680-a832753cef47 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:54:27.504859 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-93d09926-37d2-4135-9680-a832753cef47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:54:27.512722 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 781/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 15:54:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:54:27.815067 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c13ea-fec9-45f8-a5f3-f2f8df4a8f3c None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:54:27.816714 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-5d9c13ea-fec9-45f8-a5f3-f2f8df4a8f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:54:27.882433 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:54:27.895804 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c13ea-fec9-45f8-a5f3-f2f8df4a8f3c None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:54:27.899353 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceba7a4-8346-48d1-826b-ce26a2178a94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:54:27.899952 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceba7a4-8346-48d1-826b-ce26a2178a94 service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:54:27.900232 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceba7a4-8346-48d1-826b-ce26a2178a94 service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:54:27.900503 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceba7a4-8346-48d1-826b-ce26a2178a94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:54:27.909341 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceba7a4-8346-48d1-826b-ce26a2178a94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:54:27.910800 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceba7a4-8346-48d1-826b-ce26a2178a94 service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:54:27.920547 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 755/1536] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:54:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:54:30.080079 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712f7e6-32ac-4d58-946d-1db0cf36d32d None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:54:30.080669 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712f7e6-32ac-4d58-946d-1db0cf36d32d None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:54:30.080669 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712f7e6-32ac-4d58-946d-1db0cf36d32d None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:54:30.081972 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 782/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 15:54:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:54:30.087233 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234e166-7402-4afb-a452-87688e0158a6 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:54:30.087647 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234e166-7402-4afb-a452-87688e0158a6 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:54:30.087781 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234e166-7402-4afb-a452-87688e0158a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:54:30.107492 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-1234e166-7402-4afb-a452-87688e0158a6 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:54:30.108964 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-1234e166-7402-4afb-a452-87688e0158a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:54:30.116865 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 756/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 15:54:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:54:30.424272 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712f7e6-32ac-4d58-946d-1db0cf36d32d None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:54:30.425924 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-c712f7e6-32ac-4d58-946d-1db0cf36d32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:54:30.438982 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712f7e6-32ac-4d58-946d-1db0cf36d32d None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:54:30.442442 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45f100-bd59-4ffe-bfc8-96c67fbbe60f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:54:30.443032 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45f100-bd59-4ffe-bfc8-96c67fbbe60f service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:54:30.443312 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45f100-bd59-4ffe-bfc8-96c67fbbe60f service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:54:30.443584 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45f100-bd59-4ffe-bfc8-96c67fbbe60f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:54:30.452442 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d45f100-bd59-4ffe-bfc8-96c67fbbe60f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:54:30.453849 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d45f100-bd59-4ffe-bfc8-96c67fbbe60f service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:54:30.463019 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 783/1539] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:54:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:54:40.102080 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=11 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:54:40.458963 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=8 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:00.602214 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670378ac-a16c-423d-a68c-d9e9b9dab1e9 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:00.602861 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670378ac-a16c-423d-a68c-d9e9b9dab1e9 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:00.602861 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670378ac-a16c-423d-a68c-d9e9b9dab1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:00.632018 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-670378ac-a16c-423d-a68c-d9e9b9dab1e9 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:00.633265 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-670378ac-a16c-423d-a68c-d9e9b9dab1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:00.643482 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 757/1540] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:00.652126 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ae758-e2fa-4232-8841-bae50447edc8 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:00.653129 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ae758-e2fa-4232-8841-bae50447edc8 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:00.653622 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ae758-e2fa-4232-8841-bae50447edc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:00.680746 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-be1ae758-e2fa-4232-8841-bae50447edc8 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:00.682702 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-be1ae758-e2fa-4232-8841-bae50447edc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:00.695098 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 784/1541] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:00.700438 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670378ac-a16c-423d-a68c-d9e9b9dab1e9 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:00.714397 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670378ac-a16c-423d-a68c-d9e9b9dab1e9 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:00.722488 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303174e9-ff94-4f92-ad44-2942440e6105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:00.723291 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303174e9-ff94-4f92-ad44-2942440e6105 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:00.723577 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303174e9-ff94-4f92-ad44-2942440e6105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:00.723855 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303174e9-ff94-4f92-ad44-2942440e6105 admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:00.724513 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303174e9-ff94-4f92-ad44-2942440e6105 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:00.724820 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303174e9-ff94-4f92-ad44-2942440e6105 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:00.726456 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303174e9-ff94-4f92-ad44-2942440e6105 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:00.732562 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442fc9d-4692-4086-9543-6aa3309b93e7 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:00.733109 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442fc9d-4692-4086-9543-6aa3309b93e7 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:00.733386 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442fc9d-4692-4086-9543-6aa3309b93e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:00.742295 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 758/1542] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 15:56:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:00.743594 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f11ed-64f6-49fa-9244-9bc62c39de94 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:00.743862 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f11ed-64f6-49fa-9244-9bc62c39de94 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:00.744140 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f11ed-64f6-49fa-9244-9bc62c39de94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:00.767405 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-c442fc9d-4692-4086-9543-6aa3309b93e7 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:00.768633 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-c442fc9d-4692-4086-9543-6aa3309b93e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:00.783387 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-6f2f11ed-64f6-49fa-9244-9bc62c39de94 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:00.784640 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-6f2f11ed-64f6-49fa-9244-9bc62c39de94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:00.785642 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 785/1543] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 15:56:00.786502 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442fc9d-4692-4086-9543-6aa3309b93e7 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:00.800908 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 759/1544] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:00.801996 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc436a4-e3de-47c4-a67a-aafce7032b95 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:00.802355 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc436a4-e3de-47c4-a67a-aafce7032b95 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:00.802593 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc436a4-e3de-47c4-a67a-aafce7032b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:00.809690 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442fc9d-4692-4086-9543-6aa3309b93e7 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:00.823647 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60debac8-43ac-41bb-a6d7-25b2e3c990de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:00.824276 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60debac8-43ac-41bb-a6d7-25b2e3c990de admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:00.824559 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60debac8-43ac-41bb-a6d7-25b2e3c990de admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:00.824833 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60debac8-43ac-41bb-a6d7-25b2e3c990de admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:00.825471 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60debac8-43ac-41bb-a6d7-25b2e3c990de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:00.827416 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60debac8-43ac-41bb-a6d7-25b2e3c990de admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:00.834763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-7dc436a4-e3de-47c4-a67a-aafce7032b95 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:00.836495 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-7dc436a4-e3de-47c4-a67a-aafce7032b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:00.862252 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 760/1545] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:00.863319 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c75945-09ac-4ee2-9311-849b3841b49c None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:00.864591 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c75945-09ac-4ee2-9311-849b3841b49c None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:00.864869 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c75945-09ac-4ee2-9311-849b3841b49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:00.915882 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-a1c75945-09ac-4ee2-9311-849b3841b49c None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:00.918767 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-a1c75945-09ac-4ee2-9311-849b3841b49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:00.934685 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 761/1546] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:00.936424 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724aff39-e9dc-4db9-983d-24fe3433831c None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:00.937027 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724aff39-e9dc-4db9-983d-24fe3433831c None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:00.937330 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 786/1547] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:56:00 2022] POST /identity/v3/projects => generated 405 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:00.937765 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724aff39-e9dc-4db9-983d-24fe3433831c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:00.938251 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60debac8-43ac-41bb-a6d7-25b2e3c990de admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:00.975617 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-724aff39-e9dc-4db9-983d-24fe3433831c None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:00.977249 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-724aff39-e9dc-4db9-983d-24fe3433831c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:01.085687 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60debac8-43ac-41bb-a6d7-25b2e3c990de admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:01.092528 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b51556-5652-466c-838a-3c667d01846a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:01.093467 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b51556-5652-466c-838a-3c667d01846a admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:01.093748 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b51556-5652-466c-838a-3c667d01846a admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:01.094027 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b51556-5652-466c-838a-3c667d01846a admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:01.094734 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b51556-5652-466c-838a-3c667d01846a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:01.095040 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b51556-5652-466c-838a-3c667d01846a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:01.096062 dv-cinder-853315-8-smb devstack@keystone.service[81501]: WARNING py.warnings [None req-05b51556-5652-466c-838a-3c667d01846a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 07 15:56:01.096062 dv-cinder-853315-8-smb devstack@keystone.service[81501]: warnings.warn(msg) Sep 07 15:56:01.096062 dv-cinder-853315-8-smb devstack@keystone.service[81501]: Sep 07 15:56:01.096953 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b51556-5652-466c-838a-3c667d01846a admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:01.100623 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 762/1548] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:01.101457 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724aff39-e9dc-4db9-983d-24fe3433831c None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:01.112628 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724aff39-e9dc-4db9-983d-24fe3433831c None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:01.118904 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d882043-4325-42f6-9ec2-96ccde0dfa1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:01.120753 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 787/1549] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 15:56:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:01.120889 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d882043-4325-42f6-9ec2-96ccde0dfa1f admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:01.120889 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d882043-4325-42f6-9ec2-96ccde0dfa1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:01.121313 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d882043-4325-42f6-9ec2-96ccde0dfa1f admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:01.121429 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb781f20-6ff4-4bbc-b6c4-659263977c26 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:01.121533 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb781f20-6ff4-4bbc-b6c4-659263977c26 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:01.127035 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb781f20-6ff4-4bbc-b6c4-659263977c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:01.127186 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d882043-4325-42f6-9ec2-96ccde0dfa1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:01.127186 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d882043-4325-42f6-9ec2-96ccde0dfa1f admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:01.147275 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-fb781f20-6ff4-4bbc-b6c4-659263977c26 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:01.148501 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-fb781f20-6ff4-4bbc-b6c4-659263977c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:01.152595 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 763/1550] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:56:01 2022] POST /identity/v3/users => generated 303 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:01.153850 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c295f5a-d809-4b56-aca8-e0fbdf01f9cc None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:01.154125 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c295f5a-d809-4b56-aca8-e0fbdf01f9cc None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:01.154429 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c295f5a-d809-4b56-aca8-e0fbdf01f9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:01.159699 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 788/1551] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:01.161102 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66c11d-969e-4719-a2a3-5ec9dd40db13 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:01.161384 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66c11d-969e-4719-a2a3-5ec9dd40db13 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:01.161652 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66c11d-969e-4719-a2a3-5ec9dd40db13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:01.176795 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-1c295f5a-d809-4b56-aca8-e0fbdf01f9cc None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:01.177999 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-1c295f5a-d809-4b56-aca8-e0fbdf01f9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:01.182090 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-8e66c11d-969e-4719-a2a3-5ec9dd40db13 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:01.185325 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-8e66c11d-969e-4719-a2a3-5ec9dd40db13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:01.186549 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 764/1552] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:01.187746 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06009250-b259-4271-affe-f54edc16c05c None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:01.188033 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06009250-b259-4271-affe-f54edc16c05c None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:01.188307 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06009250-b259-4271-affe-f54edc16c05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:01.195030 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 789/1553] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:01.196105 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e66c11d-969e-4719-a2a3-5ec9dd40db13 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:01.206172 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e66c11d-969e-4719-a2a3-5ec9dd40db13 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:01.208959 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-06009250-b259-4271-affe-f54edc16c05c None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:01.210154 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-06009250-b259-4271-affe-f54edc16c05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:01.210889 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a978217b-d999-4473-94c1-eef05dcfc456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:01.211482 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978217b-d999-4473-94c1-eef05dcfc456 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:01.211757 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978217b-d999-4473-94c1-eef05dcfc456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:01.212024 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978217b-d999-4473-94c1-eef05dcfc456 admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:01.212656 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a978217b-d999-4473-94c1-eef05dcfc456 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:01.213514 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a978217b-d999-4473-94c1-eef05dcfc456 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:01.215442 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a978217b-d999-4473-94c1-eef05dcfc456 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:01.218873 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 765/1554] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:01.219628 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06009250-b259-4271-affe-f54edc16c05c None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:01.227910 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 790/1555] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 15:56:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:01.229242 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831747e6-70d1-44fb-8185-1b4e73fd8af1 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:01.229521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831747e6-70d1-44fb-8185-1b4e73fd8af1 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:01.229791 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831747e6-70d1-44fb-8185-1b4e73fd8af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:01.233310 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06009250-b259-4271-affe-f54edc16c05c None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:01.238493 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d141fbe-f784-4ff0-8159-c91407baab4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:01.239103 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d141fbe-f784-4ff0-8159-c91407baab4d admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:01.239378 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d141fbe-f784-4ff0-8159-c91407baab4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:01.239713 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d141fbe-f784-4ff0-8159-c91407baab4d admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:01.240367 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d141fbe-f784-4ff0-8159-c91407baab4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:01.241432 dv-cinder-853315-8-smb devstack@keystone.service[81502]: WARNING py.warnings [None req-1d141fbe-f784-4ff0-8159-c91407baab4d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 15:56:01.241432 dv-cinder-853315-8-smb devstack@keystone.service[81502]: warnings.warn(msg) Sep 07 15:56:01.241432 dv-cinder-853315-8-smb devstack@keystone.service[81502]: Sep 07 15:56:01.242644 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d141fbe-f784-4ff0-8159-c91407baab4d admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:01.250343 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-831747e6-70d1-44fb-8185-1b4e73fd8af1 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:01.251548 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-831747e6-70d1-44fb-8185-1b4e73fd8af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:01.259984 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 791/1556] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:01.260691 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831747e6-70d1-44fb-8185-1b4e73fd8af1 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:01.270607 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831747e6-70d1-44fb-8185-1b4e73fd8af1 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:01.275274 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f0ad5-66c6-47f5-b380-b58ce6a302fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:01.276628 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f0ad5-66c6-47f5-b380-b58ce6a302fd admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:01.277019 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f0ad5-66c6-47f5-b380-b58ce6a302fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:01.277294 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f0ad5-66c6-47f5-b380-b58ce6a302fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:01.277929 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2f0ad5-66c6-47f5-b380-b58ce6a302fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:01.279532 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 766/1557] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:56:01 2022] POST /identity/v3/projects => generated 363 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:01.279663 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2f0ad5-66c6-47f5-b380-b58ce6a302fd admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:01.280715 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d141fbe-f784-4ff0-8159-c91407baab4d admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:01.292156 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 792/1558] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:01.293364 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2ef6f-68e0-47f6-9f3b-82e4321dbc77 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:01.293652 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2ef6f-68e0-47f6-9f3b-82e4321dbc77 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:01.293927 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2ef6f-68e0-47f6-9f3b-82e4321dbc77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:01.313360 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-54c2ef6f-68e0-47f6-9f3b-82e4321dbc77 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:01.314605 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-54c2ef6f-68e0-47f6-9f3b-82e4321dbc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:01.348092 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d141fbe-f784-4ff0-8159-c91407baab4d admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:01.354316 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cffb92c-4298-42f8-b266-7751ad356350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:01.355042 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffb92c-4298-42f8-b266-7751ad356350 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:01.355323 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffb92c-4298-42f8-b266-7751ad356350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:01.355600 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffb92c-4298-42f8-b266-7751ad356350 admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:01.356264 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cffb92c-4298-42f8-b266-7751ad356350 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:01.356731 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cffb92c-4298-42f8-b266-7751ad356350 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:01.358671 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cffb92c-4298-42f8-b266-7751ad356350 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:01.370245 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 767/1559] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 15:56:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:01.371510 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1645003-fc30-4885-8cdd-54d23409cad2 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:01.371805 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1645003-fc30-4885-8cdd-54d23409cad2 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:01.372079 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1645003-fc30-4885-8cdd-54d23409cad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:01.381746 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:01.382545 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 793/1560] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:01.388147 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d252ae4-ba21-4dc1-a9b6-6e13e8c2507d None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:01.388463 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d252ae4-ba21-4dc1-a9b6-6e13e8c2507d None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:01.388796 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d252ae4-ba21-4dc1-a9b6-6e13e8c2507d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:01.397190 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-a1645003-fc30-4885-8cdd-54d23409cad2 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:01.398430 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-a1645003-fc30-4885-8cdd-54d23409cad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:01.403050 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:01.407423 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 768/1561] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:01.411231 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1645003-fc30-4885-8cdd-54d23409cad2 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:01.411350 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-9d252ae4-ba21-4dc1-a9b6-6e13e8c2507d None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:01.411350 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-9d252ae4-ba21-4dc1-a9b6-6e13e8c2507d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:01.417977 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1645003-fc30-4885-8cdd-54d23409cad2 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:01.420302 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 794/1562] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:01.421480 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb36ce-cc59-4358-b780-254df0165f41 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:01.421762 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb36ce-cc59-4358-b780-254df0165f41 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:01.422032 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb36ce-cc59-4358-b780-254df0165f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:01.426119 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7d2fb-b94c-4060-bca7-648336dcb126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:01.426791 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7d2fb-b94c-4060-bca7-648336dcb126 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:01.427042 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7d2fb-b94c-4060-bca7-648336dcb126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:01.427391 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7d2fb-b94c-4060-bca7-648336dcb126 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:01.428090 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b7d2fb-b94c-4060-bca7-648336dcb126 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:01.430162 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b7d2fb-b94c-4060-bca7-648336dcb126 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:01.445114 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-15cb36ce-cc59-4358-b780-254df0165f41 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:01.446505 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-15cb36ce-cc59-4358-b780-254df0165f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:01.457065 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 795/1563] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:01.457889 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb36ce-cc59-4358-b780-254df0165f41 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:01.460638 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 769/1564] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:56:01 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:01.461360 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7d2fb-b94c-4060-bca7-648336dcb126 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:01.471509 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb36ce-cc59-4358-b780-254df0165f41 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:01.524987 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7d2fb-b94c-4060-bca7-648336dcb126 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:01.529627 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec9dfa-9d2e-4842-a31d-5a211a90ddbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:01.529870 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd2d6e-3319-42a8-9c95-ab2cad13c396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:01.530264 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec9dfa-9d2e-4842-a31d-5a211a90ddbf admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:01.530514 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd2d6e-3319-42a8-9c95-ab2cad13c396 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:01.530635 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec9dfa-9d2e-4842-a31d-5a211a90ddbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:01.530798 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd2d6e-3319-42a8-9c95-ab2cad13c396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:01.530923 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec9dfa-9d2e-4842-a31d-5a211a90ddbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:01.531076 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd2d6e-3319-42a8-9c95-ab2cad13c396 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:01.531431 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec9dfa-9d2e-4842-a31d-5a211a90ddbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:01.531709 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd2d6e-3319-42a8-9c95-ab2cad13c396 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:01.532730 dv-cinder-853315-8-smb devstack@keystone.service[81501]: WARNING py.warnings [None req-53fd2d6e-3319-42a8-9c95-ab2cad13c396 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 15:56:01.532730 dv-cinder-853315-8-smb devstack@keystone.service[81501]: warnings.warn(msg) Sep 07 15:56:01.532730 dv-cinder-853315-8-smb devstack@keystone.service[81501]: Sep 07 15:56:01.533036 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec9dfa-9d2e-4842-a31d-5a211a90ddbf admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:01.533944 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd2d6e-3319-42a8-9c95-ab2cad13c396 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:01.543668 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 770/1565] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:01.544448 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec9dfa-9d2e-4842-a31d-5a211a90ddbf admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:01.558749 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 796/1566] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:56:01 2022] POST /identity/v3/users => generated 282 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:01.560004 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd2d6e-3319-42a8-9c95-ab2cad13c396 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:01.560254 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec9dfa-9d2e-4842-a31d-5a211a90ddbf admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:01.566409 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852df122-75a9-497b-9c40-93e6485e984a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:01.567111 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852df122-75a9-497b-9c40-93e6485e984a admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:01.567467 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852df122-75a9-497b-9c40-93e6485e984a admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:01.567819 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852df122-75a9-497b-9c40-93e6485e984a admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:01.568454 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852df122-75a9-497b-9c40-93e6485e984a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:01.570271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd2d6e-3319-42a8-9c95-ab2cad13c396 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:01.570450 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852df122-75a9-497b-9c40-93e6485e984a admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:01.575420 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9798e-4d63-467f-94a7-367b5f9aeb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:01.576010 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9798e-4d63-467f-94a7-367b5f9aeb99 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:01.576294 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9798e-4d63-467f-94a7-367b5f9aeb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:01.576568 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9798e-4d63-467f-94a7-367b5f9aeb99 admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:01.577205 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b9798e-4d63-467f-94a7-367b5f9aeb99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:01.577510 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b9798e-4d63-467f-94a7-367b5f9aeb99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:01.579131 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b9798e-4d63-467f-94a7-367b5f9aeb99 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:01.598401 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 797/1567] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 15:56:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:01.599472 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9798e-4d63-467f-94a7-367b5f9aeb99 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:01.603155 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 771/1568] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:56:01 2022] POST /identity/v3/projects => generated 393 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:01.603155 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852df122-75a9-497b-9c40-93e6485e984a admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:01.611004 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9798e-4d63-467f-94a7-367b5f9aeb99 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:01.667590 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852df122-75a9-497b-9c40-93e6485e984a admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:01.670842 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec4abb-b087-4a9a-b087-3c6591bc350a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:01.671483 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec4abb-b087-4a9a-b087-3c6591bc350a admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:01.671771 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec4abb-b087-4a9a-b087-3c6591bc350a admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:01.672047 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec4abb-b087-4a9a-b087-3c6591bc350a admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:01.672185 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552ce1f-96a8-4572-aa1e-8f6241036a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:01.672750 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec4abb-b087-4a9a-b087-3c6591bc350a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:01.672854 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552ce1f-96a8-4572-aa1e-8f6241036a43 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:01.673049 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552ce1f-96a8-4572-aa1e-8f6241036a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:01.673148 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec4abb-b087-4a9a-b087-3c6591bc350a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:01.673340 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552ce1f-96a8-4572-aa1e-8f6241036a43 admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:01.673952 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0552ce1f-96a8-4572-aa1e-8f6241036a43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:01.674282 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0552ce1f-96a8-4572-aa1e-8f6241036a43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:01.674744 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec4abb-b087-4a9a-b087-3c6591bc350a admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:01.675867 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0552ce1f-96a8-4572-aa1e-8f6241036a43 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:01.686698 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 798/1569] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 15:56:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:01.687591 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec4abb-b087-4a9a-b087-3c6591bc350a admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:01.687776 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 772/1570] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 15:56:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:01.688549 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552ce1f-96a8-4572-aa1e-8f6241036a43 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:01.700643 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552ce1f-96a8-4572-aa1e-8f6241036a43 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:01.705336 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2098d98-8b35-402c-a479-e26c887defaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:01.705776 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec4abb-b087-4a9a-b087-3c6591bc350a admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:01.706062 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2098d98-8b35-402c-a479-e26c887defaf admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:01.706387 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2098d98-8b35-402c-a479-e26c887defaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:01.706769 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2098d98-8b35-402c-a479-e26c887defaf admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:01.707396 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2098d98-8b35-402c-a479-e26c887defaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:01.709358 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2098d98-8b35-402c-a479-e26c887defaf admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:01.710490 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201125c5-aedb-4249-afed-4dbe4fc1e400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:01.711078 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201125c5-aedb-4249-afed-4dbe4fc1e400 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:01.711355 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201125c5-aedb-4249-afed-4dbe4fc1e400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:01.711627 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201125c5-aedb-4249-afed-4dbe4fc1e400 admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:01.712254 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201125c5-aedb-4249-afed-4dbe4fc1e400 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:01.712551 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201125c5-aedb-4249-afed-4dbe4fc1e400 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:01.715008 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201125c5-aedb-4249-afed-4dbe4fc1e400 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:01.727812 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 799/1571] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 15:56:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:01.729296 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201125c5-aedb-4249-afed-4dbe4fc1e400 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:01.734630 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 773/1572] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:56:01 2022] POST /identity/v3/users => generated 286 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:01.735354 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2098d98-8b35-402c-a479-e26c887defaf admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:01.740117 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201125c5-aedb-4249-afed-4dbe4fc1e400 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:01.746386 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2098d98-8b35-402c-a479-e26c887defaf admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:01.748523 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ce27f-52ca-4992-b449-25d78b99ad7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:01.749228 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ce27f-52ca-4992-b449-25d78b99ad7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:01.749512 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ce27f-52ca-4992-b449-25d78b99ad7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:01.749793 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ce27f-52ca-4992-b449-25d78b99ad7b admin admin] PATH_INFO: `/v3/projects/9d48b6a59f5045cfa7c05cd05ebe3d28/users/24c1fcf6fbfd46878875f3ac885fd8c3/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:01.752171 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4619ef28-5acc-488e-9d64-9fa6fc511242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:01.752997 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619ef28-5acc-488e-9d64-9fa6fc511242 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:01.753284 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619ef28-5acc-488e-9d64-9fa6fc511242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:01.753558 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619ef28-5acc-488e-9d64-9fa6fc511242 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:01.754226 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4619ef28-5acc-488e-9d64-9fa6fc511242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:01.755837 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4619ef28-5acc-488e-9d64-9fa6fc511242 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:01.766702 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 774/1573] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:01.767224 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ce27f-52ca-4992-b449-25d78b99ad7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d48b6a59f5045cfa7c05cd05ebe3d28, user_id=24c1fcf6fbfd46878875f3ac885fd8c3, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:01.767480 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4619ef28-5acc-488e-9d64-9fa6fc511242 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:01.769966 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ce27f-52ca-4992-b449-25d78b99ad7b admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:01.777410 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4619ef28-5acc-488e-9d64-9fa6fc511242 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:01.783957 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 800/1574] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:01 2022] PUT /identity/v3/projects/9d48b6a59f5045cfa7c05cd05ebe3d28/users/24c1fcf6fbfd46878875f3ac885fd8c3/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:01.784811 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ce27f-52ca-4992-b449-25d78b99ad7b admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:01.796376 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:01.816032 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:01.846318 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65ce05-e8a2-455c-ac49-d716a92b002a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:01.847218 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65ce05-e8a2-455c-ac49-d716a92b002a admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:01.847500 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65ce05-e8a2-455c-ac49-d716a92b002a admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:01.847777 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65ce05-e8a2-455c-ac49-d716a92b002a admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:01.848401 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e65ce05-e8a2-455c-ac49-d716a92b002a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:01.850124 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ce27f-52ca-4992-b449-25d78b99ad7b admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:01.850339 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e65ce05-e8a2-455c-ac49-d716a92b002a admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:01.855017 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fe4ee-0205-46f4-961b-ec75a20af430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:01.855624 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fe4ee-0205-46f4-961b-ec75a20af430 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:01.855902 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fe4ee-0205-46f4-961b-ec75a20af430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:01.856174 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fe4ee-0205-46f4-961b-ec75a20af430 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:01.856794 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29fe4ee-0205-46f4-961b-ec75a20af430 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:01.859063 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29fe4ee-0205-46f4-961b-ec75a20af430 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:01.881780 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 775/1575] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:56:01 2022] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:01.881780 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65ce05-e8a2-455c-ac49-d716a92b002a admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:01.888483 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 801/1576] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:56:01 2022] POST /identity/v3/users => generated 297 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:01.888483 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fe4ee-0205-46f4-961b-ec75a20af430 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:01.896313 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fe4ee-0205-46f4-961b-ec75a20af430 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:01.943800 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65ce05-e8a2-455c-ac49-d716a92b002a admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:01.948795 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707d4e2-8dda-4400-b20c-67860af18ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:01.949417 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707d4e2-8dda-4400-b20c-67860af18ce1 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:01.949701 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707d4e2-8dda-4400-b20c-67860af18ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:01.949978 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707d4e2-8dda-4400-b20c-67860af18ce1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:01.950700 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a707d4e2-8dda-4400-b20c-67860af18ce1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:01.952570 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a707d4e2-8dda-4400-b20c-67860af18ce1 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:01.954386 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0d498-a32d-4d64-b331-1ac16eb7b3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:01.955002 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0d498-a32d-4d64-b331-1ac16eb7b3ef admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:01.955285 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0d498-a32d-4d64-b331-1ac16eb7b3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:01.955560 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0d498-a32d-4d64-b331-1ac16eb7b3ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:01.956182 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b0d498-a32d-4d64-b331-1ac16eb7b3ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:01.958082 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b0d498-a32d-4d64-b331-1ac16eb7b3ef admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:01.980318 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 776/1577] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:56:01 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:01.984661 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707d4e2-8dda-4400-b20c-67860af18ce1 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:01.986668 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 802/1578] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:56:01 2022] POST /identity/v3/projects => generated 367 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:01.987865 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0d498-a32d-4d64-b331-1ac16eb7b3ef admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:02.051899 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707d4e2-8dda-4400-b20c-67860af18ce1 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:02.054946 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0d498-a32d-4d64-b331-1ac16eb7b3ef admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:02.057126 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ef586-fbf0-450c-b386-b8d81d416c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:02.057857 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ef586-fbf0-450c-b386-b8d81d416c5f admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:02.058144 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ef586-fbf0-450c-b386-b8d81d416c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:02.058451 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ef586-fbf0-450c-b386-b8d81d416c5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:02.059122 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ef586-fbf0-450c-b386-b8d81d416c5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:02.060414 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe867f-34ac-4070-8820-8f18e8ae8c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:02.060733 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ef586-fbf0-450c-b386-b8d81d416c5f admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:02.061013 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe867f-34ac-4070-8820-8f18e8ae8c92 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:02.061299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe867f-34ac-4070-8820-8f18e8ae8c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:02.061576 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe867f-34ac-4070-8820-8f18e8ae8c92 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:02.062236 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fe867f-34ac-4070-8820-8f18e8ae8c92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:02.064176 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fe867f-34ac-4070-8820-8f18e8ae8c92 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:02.070775 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 777/1579] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:02.074540 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ef586-fbf0-450c-b386-b8d81d416c5f admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:02.084088 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ef586-fbf0-450c-b386-b8d81d416c5f admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:02.089268 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59719c95-3747-40d2-a705-10636b6e01a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:02.089860 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59719c95-3747-40d2-a705-10636b6e01a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:02.090145 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59719c95-3747-40d2-a705-10636b6e01a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:02.090453 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59719c95-3747-40d2-a705-10636b6e01a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:02.091052 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 803/1580] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:56:01 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:02.091236 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59719c95-3747-40d2-a705-10636b6e01a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:02.092294 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bddf728-edba-4cc1-b79b-a30ef4593315 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:02.092666 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59719c95-3747-40d2-a705-10636b6e01a0 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:02.092846 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bddf728-edba-4cc1-b79b-a30ef4593315 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:02.092993 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bddf728-edba-4cc1-b79b-a30ef4593315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:02.108076 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 778/1581] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:02.108076 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59719c95-3747-40d2-a705-10636b6e01a0 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:02.116059 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59719c95-3747-40d2-a705-10636b6e01a0 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:02.120953 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:02.123341 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-2bddf728-edba-4cc1-b79b-a30ef4593315 None None] MFA Rules not processed for user `24c1fcf6fbfd46878875f3ac885fd8c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:02.124648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-2bddf728-edba-4cc1-b79b-a30ef4593315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:02.138081 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:02.175458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e690f4c-cc3e-4b42-8c39-3c5dab580b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:02.176062 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e690f4c-cc3e-4b42-8c39-3c5dab580b9b admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:02.176353 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e690f4c-cc3e-4b42-8c39-3c5dab580b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:02.176630 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e690f4c-cc3e-4b42-8c39-3c5dab580b9b admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:02.177244 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e690f4c-cc3e-4b42-8c39-3c5dab580b9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:02.179238 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e690f4c-cc3e-4b42-8c39-3c5dab580b9b admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:02.192830 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 804/1582] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:02 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:02.193665 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bddf728-edba-4cc1-b79b-a30ef4593315 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:02.202033 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 779/1583] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:56:02 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:02.203055 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e690f4c-cc3e-4b42-8c39-3c5dab580b9b admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:02.207845 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bddf728-edba-4cc1-b79b-a30ef4593315 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:02.212454 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e690f4c-cc3e-4b42-8c39-3c5dab580b9b admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:02.213674 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c3b1b-8872-471a-b257-ac06f86ea88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:02.214330 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c3b1b-8872-471a-b257-ac06f86ea88b admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:02.214607 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c3b1b-8872-471a-b257-ac06f86ea88b admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:02.214872 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c3b1b-8872-471a-b257-ac06f86ea88b admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:02.215533 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12c3b1b-8872-471a-b257-ac06f86ea88b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:02.217261 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12c3b1b-8872-471a-b257-ac06f86ea88b admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:02.217690 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe7882-d6e1-4f61-9de6-5184c261054d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:02.218327 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe7882-d6e1-4f61-9de6-5184c261054d admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:02.218605 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe7882-d6e1-4f61-9de6-5184c261054d admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:02.218896 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe7882-d6e1-4f61-9de6-5184c261054d admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:02.219504 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafe7882-d6e1-4f61-9de6-5184c261054d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:02.221440 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafe7882-d6e1-4f61-9de6-5184c261054d admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:02.228932 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 805/1584] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:02.229820 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c3b1b-8872-471a-b257-ac06f86ea88b admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:02.240117 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c3b1b-8872-471a-b257-ac06f86ea88b admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:02.244164 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 780/1585] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:56:02 2022] POST /identity/v3/users => generated 289 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:02.245000 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe7882-d6e1-4f61-9de6-5184c261054d admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:02.248006 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e886c69-b7bd-440b-af0b-0b419895b9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:02.248623 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e886c69-b7bd-440b-af0b-0b419895b9b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:02.248932 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e886c69-b7bd-440b-af0b-0b419895b9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:02.249215 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e886c69-b7bd-440b-af0b-0b419895b9b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:02.249871 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e886c69-b7bd-440b-af0b-0b419895b9b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:02.251928 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e886c69-b7bd-440b-af0b-0b419895b9b5 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:02.256245 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe7882-d6e1-4f61-9de6-5184c261054d admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:02.261785 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b70aa-4c79-4b29-ab8a-f3e948e556bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:02.262490 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b70aa-4c79-4b29-ab8a-f3e948e556bc admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:02.262776 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b70aa-4c79-4b29-ab8a-f3e948e556bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:02.263050 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b70aa-4c79-4b29-ab8a-f3e948e556bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:02.263713 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951b70aa-4c79-4b29-ab8a-f3e948e556bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:02.265335 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951b70aa-4c79-4b29-ab8a-f3e948e556bc admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:02.274645 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 806/1586] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:56:02 2022] POST /identity/v3/users => generated 284 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:02.275801 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e886c69-b7bd-440b-af0b-0b419895b9b5 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:02.276664 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 781/1587] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:02.277447 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b70aa-4c79-4b29-ab8a-f3e948e556bc admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:02.287228 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b70aa-4c79-4b29-ab8a-f3e948e556bc admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:02.288577 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e886c69-b7bd-440b-af0b-0b419895b9b5 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:02.292710 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf803d-9d5d-411c-80d9-0b5e54b5fc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:02.293416 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf803d-9d5d-411c-80d9-0b5e54b5fc33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:02.293697 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf803d-9d5d-411c-80d9-0b5e54b5fc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:02.293941 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043cd529-5f7c-4f8d-89a4-d7d488250f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:02.294084 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf803d-9d5d-411c-80d9-0b5e54b5fc33 admin admin] PATH_INFO: `/v3/projects/793a7041d8c04cbe9b3117ea8b01c90f/users/ab72867752f941b2ab53e1a6b8a744ca/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:02.294568 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043cd529-5f7c-4f8d-89a4-d7d488250f1f admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:02.294850 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043cd529-5f7c-4f8d-89a4-d7d488250f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:02.295128 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043cd529-5f7c-4f8d-89a4-d7d488250f1f admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:02.295752 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043cd529-5f7c-4f8d-89a4-d7d488250f1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:02.297698 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043cd529-5f7c-4f8d-89a4-d7d488250f1f admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:02.309958 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf803d-9d5d-411c-80d9-0b5e54b5fc33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=793a7041d8c04cbe9b3117ea8b01c90f, user_id=ab72867752f941b2ab53e1a6b8a744ca, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:02.311337 dv-cinder-853315-8-smb devstack@keystone.service[81502]: WARNING py.warnings [None req-bbaf803d-9d5d-411c-80d9-0b5e54b5fc33 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 15:56:02.311337 dv-cinder-853315-8-smb devstack@keystone.service[81502]: warnings.warn(msg) Sep 07 15:56:02.311337 dv-cinder-853315-8-smb devstack@keystone.service[81502]: Sep 07 15:56:02.313999 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf803d-9d5d-411c-80d9-0b5e54b5fc33 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:02.320792 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 807/1588] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:56:02 2022] POST /identity/v3/users => generated 287 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:02.321652 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043cd529-5f7c-4f8d-89a4-d7d488250f1f admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:02.327513 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 782/1589] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:02 2022] PUT /identity/v3/projects/793a7041d8c04cbe9b3117ea8b01c90f/users/ab72867752f941b2ab53e1a6b8a744ca/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:02.328387 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf803d-9d5d-411c-80d9-0b5e54b5fc33 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:02.332703 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043cd529-5f7c-4f8d-89a4-d7d488250f1f admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:02.392469 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4a1d6-70de-44e0-b54b-c97d321a0702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:02.393084 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4a1d6-70de-44e0-b54b-c97d321a0702 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:02.393365 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4a1d6-70de-44e0-b54b-c97d321a0702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:02.393636 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf803d-9d5d-411c-80d9-0b5e54b5fc33 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:02.393762 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4a1d6-70de-44e0-b54b-c97d321a0702 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:02.394334 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb4a1d6-70de-44e0-b54b-c97d321a0702 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:02.396398 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb4a1d6-70de-44e0-b54b-c97d321a0702 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:02.398355 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39bdb70-13da-4d74-aa0c-49b76927a806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:02.398963 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39bdb70-13da-4d74-aa0c-49b76927a806 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:02.399311 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39bdb70-13da-4d74-aa0c-49b76927a806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:02.399530 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39bdb70-13da-4d74-aa0c-49b76927a806 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:02.400184 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39bdb70-13da-4d74-aa0c-49b76927a806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:02.402401 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39bdb70-13da-4d74-aa0c-49b76927a806 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:02.412648 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 783/1590] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:02.413461 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39bdb70-13da-4d74-aa0c-49b76927a806 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:02.425043 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 808/1591] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:56:02 2022] POST /identity/v3/projects => generated 403 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:02.425719 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4a1d6-70de-44e0-b54b-c97d321a0702 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:02.431002 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39bdb70-13da-4d74-aa0c-49b76927a806 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:02.475527 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:02.483871 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:02.490336 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4a1d6-70de-44e0-b54b-c97d321a0702 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:02.493616 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beddfa31-b806-49fa-a6a1-d8843da9117f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:02.494784 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beddfa31-b806-49fa-a6a1-d8843da9117f admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:02.495064 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beddfa31-b806-49fa-a6a1-d8843da9117f admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:02.495335 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beddfa31-b806-49fa-a6a1-d8843da9117f admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:02.495963 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beddfa31-b806-49fa-a6a1-d8843da9117f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:02.496078 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31fa625-73d1-4204-b7f0-970cf5c3cfc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:02.496690 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fa625-73d1-4204-b7f0-970cf5c3cfc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:02.496972 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fa625-73d1-4204-b7f0-970cf5c3cfc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:02.497324 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fa625-73d1-4204-b7f0-970cf5c3cfc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:02.497546 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beddfa31-b806-49fa-a6a1-d8843da9117f admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:02.497964 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31fa625-73d1-4204-b7f0-970cf5c3cfc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:02.499594 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31fa625-73d1-4204-b7f0-970cf5c3cfc2 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:02.507737 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 784/1592] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:02.508686 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beddfa31-b806-49fa-a6a1-d8843da9117f admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:02.512917 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 809/1593] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:02.513762 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31fa625-73d1-4204-b7f0-970cf5c3cfc2 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:02.519484 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beddfa31-b806-49fa-a6a1-d8843da9117f admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:02.523304 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31fa625-73d1-4204-b7f0-970cf5c3cfc2 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:02.524457 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af049f79-9598-43b0-a8fd-068c24f4fcb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:02.525044 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af049f79-9598-43b0-a8fd-068c24f4fcb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:02.525322 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af049f79-9598-43b0-a8fd-068c24f4fcb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:02.525592 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af049f79-9598-43b0-a8fd-068c24f4fcb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:02.526320 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af049f79-9598-43b0-a8fd-068c24f4fcb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:02.528151 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af049f79-9598-43b0-a8fd-068c24f4fcb3 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:02.528442 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2cfa29-925f-4cdd-b6d3-7bab181a6363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:02.529082 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2cfa29-925f-4cdd-b6d3-7bab181a6363 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:02.529365 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2cfa29-925f-4cdd-b6d3-7bab181a6363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:02.529637 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2cfa29-925f-4cdd-b6d3-7bab181a6363 admin admin] PATH_INFO: `/v3/projects/ee018095c240480bbb2f698b21540e54/users/6d2316ba082b42bea5203aea5dc618a6/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:02.538021 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 785/1594] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:02.538964 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af049f79-9598-43b0-a8fd-068c24f4fcb3 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:02.545956 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2cfa29-925f-4cdd-b6d3-7bab181a6363 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee018095c240480bbb2f698b21540e54, user_id=6d2316ba082b42bea5203aea5dc618a6, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:02.548371 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af049f79-9598-43b0-a8fd-068c24f4fcb3 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:02.548692 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2cfa29-925f-4cdd-b6d3-7bab181a6363 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:02.553468 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1cb7f4-eccd-427e-b5b0-9dae50b58f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:02.554362 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1cb7f4-eccd-427e-b5b0-9dae50b58f25 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:02.554709 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1cb7f4-eccd-427e-b5b0-9dae50b58f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:02.555021 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1cb7f4-eccd-427e-b5b0-9dae50b58f25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:02.555979 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1cb7f4-eccd-427e-b5b0-9dae50b58f25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:02.558379 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1cb7f4-eccd-427e-b5b0-9dae50b58f25 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:02.563343 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 810/1595] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:02 2022] PUT /identity/v3/projects/ee018095c240480bbb2f698b21540e54/users/6d2316ba082b42bea5203aea5dc618a6/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:02.569026 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 786/1596] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:02.569815 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c690179-6fb5-46be-95df-2f318ea110f1 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:02.569954 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1cb7f4-eccd-427e-b5b0-9dae50b58f25 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:02.570153 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c690179-6fb5-46be-95df-2f318ea110f1 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:02.570424 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c690179-6fb5-46be-95df-2f318ea110f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:02.580722 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1cb7f4-eccd-427e-b5b0-9dae50b58f25 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:02.601355 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-7c690179-6fb5-46be-95df-2f318ea110f1 None None] MFA Rules not processed for user `ab72867752f941b2ab53e1a6b8a744ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:02.603145 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-7c690179-6fb5-46be-95df-2f318ea110f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:02.652227 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9660528e-ed05-4e77-a532-0080935cc3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:02.653602 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660528e-ed05-4e77-a532-0080935cc3e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:02.653888 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660528e-ed05-4e77-a532-0080935cc3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:02.654322 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660528e-ed05-4e77-a532-0080935cc3e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:02.654965 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9660528e-ed05-4e77-a532-0080935cc3e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:02.656630 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9660528e-ed05-4e77-a532-0080935cc3e5 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:02.668793 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 787/1597] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:02.669937 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9660528e-ed05-4e77-a532-0080935cc3e5 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:02.680471 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9660528e-ed05-4e77-a532-0080935cc3e5 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:02.686025 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a31409-5196-44e8-a322-83fc35c99ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:02.686664 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a31409-5196-44e8-a322-83fc35c99ca6 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:02.686946 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a31409-5196-44e8-a322-83fc35c99ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:02.687219 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a31409-5196-44e8-a322-83fc35c99ca6 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:02.687901 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a31409-5196-44e8-a322-83fc35c99ca6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:02.689867 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a31409-5196-44e8-a322-83fc35c99ca6 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:02.698600 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 811/1598] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:02.698600 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c690179-6fb5-46be-95df-2f318ea110f1 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:02.709711 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c690179-6fb5-46be-95df-2f318ea110f1 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:02.714823 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 788/1599] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:56:02 2022] POST /identity/v3/users => generated 308 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:02.716032 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b3c82-17d1-4088-adab-3f796a843c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:02.716786 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b3c82-17d1-4088-adab-3f796a843c3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:02.717138 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b3c82-17d1-4088-adab-3f796a843c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:02.717684 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b3c82-17d1-4088-adab-3f796a843c3b admin admin] PATH_INFO: `/v3/projects/4efa5d7e44bb48fcafe283dc6c39dfa6/users/d7738e76f24f48d4a66a9237ddbc939e/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:02.718454 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a31409-5196-44e8-a322-83fc35c99ca6 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:02.728995 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a31409-5196-44e8-a322-83fc35c99ca6 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:02.733884 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8b5f1-7c18-44e3-bad2-1e537a39fdac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:02.737272 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8b5f1-7c18-44e3-bad2-1e537a39fdac admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:02.737401 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6b3c82-17d1-4088-adab-3f796a843c3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4efa5d7e44bb48fcafe283dc6c39dfa6, user_id=d7738e76f24f48d4a66a9237ddbc939e, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:02.737508 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8b5f1-7c18-44e3-bad2-1e537a39fdac admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:02.737508 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8b5f1-7c18-44e3-bad2-1e537a39fdac admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:02.737508 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b8b5f1-7c18-44e3-bad2-1e537a39fdac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:02.737508 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b8b5f1-7c18-44e3-bad2-1e537a39fdac admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:02.737825 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6b3c82-17d1-4088-adab-3f796a843c3b admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:02.750262 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 789/1600] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:02.751175 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8b5f1-7c18-44e3-bad2-1e537a39fdac admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:02.752067 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 812/1601] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:02 2022] PUT /identity/v3/projects/4efa5d7e44bb48fcafe283dc6c39dfa6/users/d7738e76f24f48d4a66a9237ddbc939e/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:02.752882 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b3c82-17d1-4088-adab-3f796a843c3b admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:02.764108 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8b5f1-7c18-44e3-bad2-1e537a39fdac admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:02.820343 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b3c82-17d1-4088-adab-3f796a843c3b admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:02.823876 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d2501-d5aa-4095-a5a2-85bcd3b3eaaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:02.824620 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d2501-d5aa-4095-a5a2-85bcd3b3eaaf admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:02.824914 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d2501-d5aa-4095-a5a2-85bcd3b3eaaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:02.825190 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d2501-d5aa-4095-a5a2-85bcd3b3eaaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:02.825862 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d2501-d5aa-4095-a5a2-85bcd3b3eaaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:02.826991 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd74f95e-5997-4284-bdbc-5cdf66a69ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:02.827547 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d2501-d5aa-4095-a5a2-85bcd3b3eaaf admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:02.828197 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74f95e-5997-4284-bdbc-5cdf66a69ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:02.828670 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74f95e-5997-4284-bdbc-5cdf66a69ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:02.829141 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74f95e-5997-4284-bdbc-5cdf66a69ff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:02.829973 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd74f95e-5997-4284-bdbc-5cdf66a69ff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:02.831596 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd74f95e-5997-4284-bdbc-5cdf66a69ff1 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:02.839902 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 790/1602] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:02.841448 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe42f94-a6cc-414d-84f5-60ed6b4b8205 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:02.841920 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe42f94-a6cc-414d-84f5-60ed6b4b8205 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:02.842394 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe42f94-a6cc-414d-84f5-60ed6b4b8205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:02.845741 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 813/1603] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:02.845741 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd74f95e-5997-4284-bdbc-5cdf66a69ff1 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:02.855547 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd74f95e-5997-4284-bdbc-5cdf66a69ff1 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:02.862104 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104db50c-3dd4-4dfa-906e-68a373b881be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:02.862912 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104db50c-3dd4-4dfa-906e-68a373b881be admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:02.863193 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104db50c-3dd4-4dfa-906e-68a373b881be admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:02.863466 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104db50c-3dd4-4dfa-906e-68a373b881be admin admin] PATH_INFO: `/v3/projects/a9d2782c7b0a473a90fb907a1b8aedf1/users/20ee77db82594e6da5fe36d155120edd/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:02.875910 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-dbe42f94-a6cc-414d-84f5-60ed6b4b8205 None None] MFA Rules not processed for user `6d2316ba082b42bea5203aea5dc618a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:02.877245 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-dbe42f94-a6cc-414d-84f5-60ed6b4b8205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:02.880190 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104db50c-3dd4-4dfa-906e-68a373b881be admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9d2782c7b0a473a90fb907a1b8aedf1, user_id=20ee77db82594e6da5fe36d155120edd, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:02.883206 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104db50c-3dd4-4dfa-906e-68a373b881be admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:02.889241 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:02.900736 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 814/1604] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:02 2022] PUT /identity/v3/projects/a9d2782c7b0a473a90fb907a1b8aedf1/users/20ee77db82594e6da5fe36d155120edd/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:02.901594 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104db50c-3dd4-4dfa-906e-68a373b881be admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:02.908590 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:02.956146 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 791/1605] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:02.960748 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe42f94-a6cc-414d-84f5-60ed6b4b8205 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:02.969829 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe42f94-a6cc-414d-84f5-60ed6b4b8205 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:02.990597 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104db50c-3dd4-4dfa-906e-68a373b881be admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:02.997238 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad1397e-5279-40b5-84ef-09302c5dd74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:02.997883 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1397e-5279-40b5-84ef-09302c5dd74d admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:02.998161 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1397e-5279-40b5-84ef-09302c5dd74d admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:02.998498 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1397e-5279-40b5-84ef-09302c5dd74d admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:02.999117 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad1397e-5279-40b5-84ef-09302c5dd74d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:03.001046 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad1397e-5279-40b5-84ef-09302c5dd74d admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:03.029447 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 815/1606] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:56:02 2022] POST /identity/v3/projects => generated 365 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:03.030406 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad1397e-5279-40b5-84ef-09302c5dd74d admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:03.035914 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea6051a-6225-475b-81b5-61d2efd488fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:03.036540 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6051a-6225-475b-81b5-61d2efd488fd admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:03.036843 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6051a-6225-475b-81b5-61d2efd488fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:03.037182 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6051a-6225-475b-81b5-61d2efd488fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:03.037727 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea6051a-6225-475b-81b5-61d2efd488fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:03.039367 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea6051a-6225-475b-81b5-61d2efd488fd admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:03.051076 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 792/1607] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:03.052457 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac32ce-c10c-4cb2-ab19-d1ea662bd948 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:03.052826 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac32ce-c10c-4cb2-ab19-d1ea662bd948 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:03.053099 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac32ce-c10c-4cb2-ab19-d1ea662bd948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:03.075858 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-81ac32ce-c10c-4cb2-ab19-d1ea662bd948 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:03.077124 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-81ac32ce-c10c-4cb2-ab19-d1ea662bd948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:03.107004 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad1397e-5279-40b5-84ef-09302c5dd74d admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:03.111850 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd9e72-3887-45a3-a1e2-50f7b6c289a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:03.112506 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd9e72-3887-45a3-a1e2-50f7b6c289a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:03.112785 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd9e72-3887-45a3-a1e2-50f7b6c289a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:03.113054 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd9e72-3887-45a3-a1e2-50f7b6c289a4 admin admin] PATH_INFO: `/v3/projects/88ce96327a2d49489714d08aa5b155cf/users/1eec1d820efc467a8e5856e6302a1885/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:03.127916 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bd9e72-3887-45a3-a1e2-50f7b6c289a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88ce96327a2d49489714d08aa5b155cf, user_id=1eec1d820efc467a8e5856e6302a1885, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:03.130639 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bd9e72-3887-45a3-a1e2-50f7b6c289a4 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:03.137282 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 793/1608] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:03.138095 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac32ce-c10c-4cb2-ab19-d1ea662bd948 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:03.145306 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 816/1609] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:03 2022] PUT /identity/v3/projects/88ce96327a2d49489714d08aa5b155cf/users/1eec1d820efc467a8e5856e6302a1885/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:03.146022 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd9e72-3887-45a3-a1e2-50f7b6c289a4 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:03.152491 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac32ce-c10c-4cb2-ab19-d1ea662bd948 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:03.195487 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:03.209615 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd9e72-3887-45a3-a1e2-50f7b6c289a4 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:03.209858 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616c267-0817-4344-8146-680bbe955e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:03.210620 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616c267-0817-4344-8146-680bbe955e8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:03.210967 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616c267-0817-4344-8146-680bbe955e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:03.211307 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616c267-0817-4344-8146-680bbe955e8a admin admin] PATH_INFO: `/v3/projects/e269f0a3936a43e989d734cab743f9f8/users/d86ab83462f0429794ad9b2f571e879b/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:03.214557 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be87477-dc44-40ab-ba3f-f850599dc75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:03.215212 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be87477-dc44-40ab-ba3f-f850599dc75e admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:03.215491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be87477-dc44-40ab-ba3f-f850599dc75e admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:03.215766 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be87477-dc44-40ab-ba3f-f850599dc75e admin admin] PATH_INFO: `/v3/projects/3b146601d0cb4f60b8f011d1586936ad/users/bfd650e9271e47af81da42149625030f/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:03.225864 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3616c267-0817-4344-8146-680bbe955e8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e269f0a3936a43e989d734cab743f9f8, user_id=d86ab83462f0429794ad9b2f571e879b, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:03.229831 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3616c267-0817-4344-8146-680bbe955e8a admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:03.230910 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be87477-dc44-40ab-ba3f-f850599dc75e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b146601d0cb4f60b8f011d1586936ad, user_id=bfd650e9271e47af81da42149625030f, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:03.233950 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be87477-dc44-40ab-ba3f-f850599dc75e admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:03.237577 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:03.244863 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 794/1610] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:03 2022] PUT /identity/v3/projects/e269f0a3936a43e989d734cab743f9f8/users/d86ab83462f0429794ad9b2f571e879b/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:03.246084 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da5223-e37e-46e5-8d48-3ce2740ae629 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:03.246406 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da5223-e37e-46e5-8d48-3ce2740ae629 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:03.246687 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da5223-e37e-46e5-8d48-3ce2740ae629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:03.261416 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 817/1611] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:03 2022] PUT /identity/v3/projects/3b146601d0cb4f60b8f011d1586936ad/users/bfd650e9271e47af81da42149625030f/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:03.261416 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689b769-db7f-4869-a670-5ca589dfd754 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:03.261416 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689b769-db7f-4869-a670-5ca589dfd754 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:03.261416 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689b769-db7f-4869-a670-5ca589dfd754 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:03.261416 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 818/1612] 10.222.0.16 () {54 vars in 962 bytes} [Wed Sep 7 15:56:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:03.261416 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689b769-db7f-4869-a670-5ca589dfd754 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:03.269157 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-15da5223-e37e-46e5-8d48-3ce2740ae629 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:03.270408 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-15da5223-e37e-46e5-8d48-3ce2740ae629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:03.324741 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689b769-db7f-4869-a670-5ca589dfd754 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:03.329441 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da795b8-4574-4dc8-92dd-e58e9891e3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:03.330052 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da795b8-4574-4dc8-92dd-e58e9891e3f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:03.330369 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da795b8-4574-4dc8-92dd-e58e9891e3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:03.330650 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da795b8-4574-4dc8-92dd-e58e9891e3f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:03.331279 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da795b8-4574-4dc8-92dd-e58e9891e3f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:03.333216 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da795b8-4574-4dc8-92dd-e58e9891e3f8 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:03.333334 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 795/1613] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:03.334207 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15da5223-e37e-46e5-8d48-3ce2740ae629 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:03.346736 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15da5223-e37e-46e5-8d48-3ce2740ae629 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:03.352715 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff33f28-d0b0-4aaa-bf74-164dfe997836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:03.353372 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff33f28-d0b0-4aaa-bf74-164dfe997836 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:03.354302 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff33f28-d0b0-4aaa-bf74-164dfe997836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:03.354648 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff33f28-d0b0-4aaa-bf74-164dfe997836 admin admin] PATH_INFO: `/v3/projects/b690dc1429a44dabb7ab61bd5bb25e6b/users/035407ee95cf4a31869695a658a4e87b/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:03.359497 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 819/1614] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:56:03 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:03.359497 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3016d2-580b-4c33-913a-79b939a54b96 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:03.359497 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3016d2-580b-4c33-913a-79b939a54b96 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:03.359497 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3016d2-580b-4c33-913a-79b939a54b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:03.370739 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff33f28-d0b0-4aaa-bf74-164dfe997836 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b690dc1429a44dabb7ab61bd5bb25e6b, user_id=035407ee95cf4a31869695a658a4e87b, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:03.373409 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff33f28-d0b0-4aaa-bf74-164dfe997836 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:03.377803 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-6b3016d2-580b-4c33-913a-79b939a54b96 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:03.379804 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-6b3016d2-580b-4c33-913a-79b939a54b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:03.386916 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 796/1615] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:03 2022] PUT /identity/v3/projects/b690dc1429a44dabb7ab61bd5bb25e6b/users/035407ee95cf4a31869695a658a4e87b/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:03.387719 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff33f28-d0b0-4aaa-bf74-164dfe997836 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:03.441503 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 820/1616] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:03.442844 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b1e2f-e2b5-491e-afce-f91dcf6fb192 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:03.443170 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b1e2f-e2b5-491e-afce-f91dcf6fb192 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:03.443393 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b1e2f-e2b5-491e-afce-f91dcf6fb192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:03.444272 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff33f28-d0b0-4aaa-bf74-164dfe997836 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:03.448609 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b93148-26c0-456c-9350-f16cc65543dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:03.449217 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b93148-26c0-456c-9350-f16cc65543dc service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:03.449501 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b93148-26c0-456c-9350-f16cc65543dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:03.449774 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b93148-26c0-456c-9350-f16cc65543dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:03.459316 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b93148-26c0-456c-9350-f16cc65543dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:03.460748 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b93148-26c0-456c-9350-f16cc65543dc service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:03.472435 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 797/1617] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:03.473641 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6888373-6d21-4059-a6bb-2cfe35a2f02e None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:03.473930 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6888373-6d21-4059-a6bb-2cfe35a2f02e None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:03.474226 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6888373-6d21-4059-a6bb-2cfe35a2f02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:03.474333 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-492b1e2f-e2b5-491e-afce-f91dcf6fb192 None None] MFA Rules not processed for user `d86ab83462f0429794ad9b2f571e879b`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:03.475527 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-492b1e2f-e2b5-491e-afce-f91dcf6fb192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:03.507175 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-b6888373-6d21-4059-a6bb-2cfe35a2f02e None None] MFA Rules not processed for user `bfd650e9271e47af81da42149625030f`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:03.508841 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b6888373-6d21-4059-a6bb-2cfe35a2f02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:03.553146 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 821/1618] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:03.554464 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbc356-3bbe-4ccb-ba3a-6b3edd2c04b3 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:03.554754 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbc356-3bbe-4ccb-ba3a-6b3edd2c04b3 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:03.555031 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbc356-3bbe-4ccb-ba3a-6b3edd2c04b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:03.557249 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:03.595879 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:03.597399 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 798/1619] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:03.598668 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6888373-6d21-4059-a6bb-2cfe35a2f02e None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:03.605848 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-a1cbc356-3bbe-4ccb-ba3a-6b3edd2c04b3 None None] MFA Rules not processed for user `f9b13331a5fd48f5a2521ed1600f9f35`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:03.607683 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-a1cbc356-3bbe-4ccb-ba3a-6b3edd2c04b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:03.625434 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6888373-6d21-4059-a6bb-2cfe35a2f02e None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:03.629452 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910a591-99a2-4203-aa8e-2e267886cf7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:03.630062 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910a591-99a2-4203-aa8e-2e267886cf7c service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:03.630373 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910a591-99a2-4203-aa8e-2e267886cf7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:03.630645 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910a591-99a2-4203-aa8e-2e267886cf7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:03.646433 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3910a591-99a2-4203-aa8e-2e267886cf7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:03.647944 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3910a591-99a2-4203-aa8e-2e267886cf7c service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:03.661500 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 799/1620] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:03.662543 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910a591-99a2-4203-aa8e-2e267886cf7c service neutron] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:03.674324 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910a591-99a2-4203-aa8e-2e267886cf7c service neutron] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:03.679647 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9239f5ed-6f46-4b6c-a617-a7aaff3f1a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:03.680325 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239f5ed-6f46-4b6c-a617-a7aaff3f1a46 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:03.680699 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239f5ed-6f46-4b6c-a617-a7aaff3f1a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:03.681039 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239f5ed-6f46-4b6c-a617-a7aaff3f1a46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:03.682315 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9239f5ed-6f46-4b6c-a617-a7aaff3f1a46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:03.684505 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9239f5ed-6f46-4b6c-a617-a7aaff3f1a46 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:03.700051 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 800/1621] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:03.700051 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9239f5ed-6f46-4b6c-a617-a7aaff3f1a46 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:03.706263 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 822/1622] 10.222.0.16 () {58 vars in 1059 bytes} [Wed Sep 7 15:56:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:03.708097 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cbc356-3bbe-4ccb-ba3a-6b3edd2c04b3 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:03.710259 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-a1cbc356-3bbe-4ccb-ba3a-6b3edd2c04b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:03.711074 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9239f5ed-6f46-4b6c-a617-a7aaff3f1a46 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:03.721357 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34be73a-8de3-43e8-a8c3-cc3cfb63256c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:03.722436 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34be73a-8de3-43e8-a8c3-cc3cfb63256c admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:03.722436 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34be73a-8de3-43e8-a8c3-cc3cfb63256c admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:03.722661 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34be73a-8de3-43e8-a8c3-cc3cfb63256c admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:03.723197 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34be73a-8de3-43e8-a8c3-cc3cfb63256c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:03.724887 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34be73a-8de3-43e8-a8c3-cc3cfb63256c admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:03.736742 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cbc356-3bbe-4ccb-ba3a-6b3edd2c04b3 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:03.741047 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11647424-c004-4e48-b7bd-faf585b2c55e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:03.741622 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 801/1623] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:03.742690 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34be73a-8de3-43e8-a8c3-cc3cfb63256c admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:03.745679 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11647424-c004-4e48-b7bd-faf585b2c55e service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:03.745968 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11647424-c004-4e48-b7bd-faf585b2c55e service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:03.746272 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11647424-c004-4e48-b7bd-faf585b2c55e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:03.757112 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11647424-c004-4e48-b7bd-faf585b2c55e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:03.758680 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11647424-c004-4e48-b7bd-faf585b2c55e service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:03.769076 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 823/1624] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:03.770124 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034abce-d9d5-4a3b-95d1-726a7c547425 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:03.770445 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034abce-d9d5-4a3b-95d1-726a7c547425 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:03.771144 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034abce-d9d5-4a3b-95d1-726a7c547425 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:03.772089 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 824/1625] 10.222.0.16 () {54 vars in 962 bytes} [Wed Sep 7 15:56:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:03.772645 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5034abce-d9d5-4a3b-95d1-726a7c547425 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:03.787893 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5034abce-d9d5-4a3b-95d1-726a7c547425 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:03.804146 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9bd454-c16e-4be8-9c16-e6087b845fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:03.805298 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9bd454-c16e-4be8-9c16-e6087b845fbd admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:03.806172 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9bd454-c16e-4be8-9c16-e6087b845fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:03.807732 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9bd454-c16e-4be8-9c16-e6087b845fbd admin admin] PATH_INFO: `/v3/projects/139e5822bdfa467e8e43c5cae505fd07/users/f433d2fb33f64e8a893b134477a3596d/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:03.820501 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34be73a-8de3-43e8-a8c3-cc3cfb63256c admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:03.826160 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b996fa-783b-4000-b64a-516bae83041b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:03.826374 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9bd454-c16e-4be8-9c16-e6087b845fbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=139e5822bdfa467e8e43c5cae505fd07, user_id=f433d2fb33f64e8a893b134477a3596d, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:03.826667 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b996fa-783b-4000-b64a-516bae83041b service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:03.826948 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b996fa-783b-4000-b64a-516bae83041b service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:03.827228 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b996fa-783b-4000-b64a-516bae83041b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:03.830051 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9bd454-c16e-4be8-9c16-e6087b845fbd admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:03.839280 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b996fa-783b-4000-b64a-516bae83041b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:03.841440 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b996fa-783b-4000-b64a-516bae83041b service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:03.849870 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 825/1626] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:03 2022] PUT /identity/v3/projects/139e5822bdfa467e8e43c5cae505fd07/users/f433d2fb33f64e8a893b134477a3596d/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:03.849870 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9bd454-c16e-4be8-9c16-e6087b845fbd admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:03.855980 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 802/1627] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:03.872570 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b996fa-783b-4000-b64a-516bae83041b service cinder] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:03.901567 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b996fa-783b-4000-b64a-516bae83041b service cinder] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:03.955633 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9bd454-c16e-4be8-9c16-e6087b845fbd admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:03.965485 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2fc9d-e6a1-4dc9-896d-b62b1f4caee9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:03.966327 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2fc9d-e6a1-4dc9-896d-b62b1f4caee9 service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:03.966746 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2fc9d-e6a1-4dc9-896d-b62b1f4caee9 service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:03.967324 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2fc9d-e6a1-4dc9-896d-b62b1f4caee9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:04.036328 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b60ea-2dbc-4a62-b957-e04cc5bff519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:04.037021 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b60ea-2dbc-4a62-b957-e04cc5bff519 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:04.037358 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b60ea-2dbc-4a62-b957-e04cc5bff519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:04.037638 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b60ea-2dbc-4a62-b957-e04cc5bff519 admin admin] PATH_INFO: `/v3/projects/b690dc1429a44dabb7ab61bd5bb25e6b/users/035407ee95cf4a31869695a658a4e87b/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:04.042723 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8b60ea-2dbc-4a62-b957-e04cc5bff519 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b690dc1429a44dabb7ab61bd5bb25e6b, user_id=035407ee95cf4a31869695a658a4e87b, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:04.050167 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8b60ea-2dbc-4a62-b957-e04cc5bff519 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:04.077692 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 803/1628] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:03 2022] PUT /identity/v3/projects/b690dc1429a44dabb7ab61bd5bb25e6b/users/035407ee95cf4a31869695a658a4e87b/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:04.079014 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489c711-a4f9-4960-b764-d5f01f44f6a1 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:04.082814 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489c711-a4f9-4960-b764-d5f01f44f6a1 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:04.082814 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489c711-a4f9-4960-b764-d5f01f44f6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:04.095511 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:04.102012 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd2fc9d-e6a1-4dc9-896d-b62b1f4caee9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:04.106155 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd2fc9d-e6a1-4dc9-896d-b62b1f4caee9 service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:04.123086 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-6489c711-a4f9-4960-b764-d5f01f44f6a1 None None] MFA Rules not processed for user `f9b13331a5fd48f5a2521ed1600f9f35`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:04.124261 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-6489c711-a4f9-4960-b764-d5f01f44f6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:04.130279 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 826/1629] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:04.131574 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2fc9d-e6a1-4dc9-896d-b62b1f4caee9 service nova] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:04.163152 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2fc9d-e6a1-4dc9-896d-b62b1f4caee9 service nova] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:04.193625 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:04.275037 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 804/1630] 10.222.0.16 () {58 vars in 1059 bytes} [Wed Sep 7 15:56:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:04.276614 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3fa96-0237-4508-b2e7-c7b8575e2a48 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:04.277559 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3fa96-0237-4508-b2e7-c7b8575e2a48 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:04.277852 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3fa96-0237-4508-b2e7-c7b8575e2a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:04.302519 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9fc9ed-f9cf-46ed-9cad-187ffeb9d2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:04.303199 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9fc9ed-f9cf-46ed-9cad-187ffeb9d2a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:04.303486 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9fc9ed-f9cf-46ed-9cad-187ffeb9d2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:04.303760 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9fc9ed-f9cf-46ed-9cad-187ffeb9d2a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:04.304406 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9fc9ed-f9cf-46ed-9cad-187ffeb9d2a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:04.308126 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9fc9ed-f9cf-46ed-9cad-187ffeb9d2a8 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:04.334894 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 827/1631] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:04.336753 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9fc9ed-f9cf-46ed-9cad-187ffeb9d2a8 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:04.345777 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-f9d3fa96-0237-4508-b2e7-c7b8575e2a48 None None] MFA Rules not processed for user `035407ee95cf4a31869695a658a4e87b`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:04.348235 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-f9d3fa96-0237-4508-b2e7-c7b8575e2a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:04.362973 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9fc9ed-f9cf-46ed-9cad-187ffeb9d2a8 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:04.377962 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3542f8d-bc37-49e3-a40d-aa09ac2c09c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:04.378619 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3542f8d-bc37-49e3-a40d-aa09ac2c09c3 service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:04.379690 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3542f8d-bc37-49e3-a40d-aa09ac2c09c3 service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:04.381398 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3542f8d-bc37-49e3-a40d-aa09ac2c09c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:04.547245 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 805/1632] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:04 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:04.548199 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3542f8d-bc37-49e3-a40d-aa09ac2c09c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:04.549647 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3fa96-0237-4508-b2e7-c7b8575e2a48 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:04.560852 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3542f8d-bc37-49e3-a40d-aa09ac2c09c3 service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:04.591169 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3fa96-0237-4508-b2e7-c7b8575e2a48 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:04.606598 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 828/1633] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:04.611149 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3542f8d-bc37-49e3-a40d-aa09ac2c09c3 service nova] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:04.618871 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b8f96d-0589-45c7-bfd8-1674e46dd4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:04.623430 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8f96d-0589-45c7-bfd8-1674e46dd4c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:04.623870 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8f96d-0589-45c7-bfd8-1674e46dd4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:04.626533 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8f96d-0589-45c7-bfd8-1674e46dd4c8 admin admin] PATH_INFO: `/v3/projects/139e5822bdfa467e8e43c5cae505fd07/users/f433d2fb33f64e8a893b134477a3596d/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:04.636449 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b8f96d-0589-45c7-bfd8-1674e46dd4c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=139e5822bdfa467e8e43c5cae505fd07, user_id=f433d2fb33f64e8a893b134477a3596d, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:04.647217 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b8f96d-0589-45c7-bfd8-1674e46dd4c8 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:04.683158 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 806/1634] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:04 2022] PUT /identity/v3/projects/139e5822bdfa467e8e43c5cae505fd07/users/f433d2fb33f64e8a893b134477a3596d/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:04.694624 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3542f8d-bc37-49e3-a40d-aa09ac2c09c3 service nova] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:04.700328 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7f92f-5b37-42b5-9433-79a4d5ce6a79 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:04.701565 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7f92f-5b37-42b5-9433-79a4d5ce6a79 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:04.704155 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7f92f-5b37-42b5-9433-79a4d5ce6a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:04.747306 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:04.757272 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917da959-8bec-4767-a7aa-e64a8de621f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:04.758151 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917da959-8bec-4767-a7aa-e64a8de621f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:04.758560 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917da959-8bec-4767-a7aa-e64a8de621f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:04.758905 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917da959-8bec-4767-a7aa-e64a8de621f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:04.779464 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-55f7f92f-5b37-42b5-9433-79a4d5ce6a79 None None] MFA Rules not processed for user `f433d2fb33f64e8a893b134477a3596d`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:04.780770 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-55f7f92f-5b37-42b5-9433-79a4d5ce6a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:04.834738 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917da959-8bec-4767-a7aa-e64a8de621f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:04.837174 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917da959-8bec-4767-a7aa-e64a8de621f4 service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:04.865389 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 829/1635] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:04 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:04.867026 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f383dd2-bddd-42a2-8003-f66907b79393 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:04.867388 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f383dd2-bddd-42a2-8003-f66907b79393 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:04.867927 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f383dd2-bddd-42a2-8003-f66907b79393 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:04.869939 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 830/1636] 10.222.0.16 () {54 vars in 912 bytes} [Wed Sep 7 15:56:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:04.876844 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e7d0e-519c-42bc-8fec-9d7710013080 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:04.877416 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e7d0e-519c-42bc-8fec-9d7710013080 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:04.877971 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e7d0e-519c-42bc-8fec-9d7710013080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:04.926058 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-cd1e7d0e-519c-42bc-8fec-9d7710013080 None None] MFA Rules not processed for user `f9b13331a5fd48f5a2521ed1600f9f35`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:04.937671 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-cd1e7d0e-519c-42bc-8fec-9d7710013080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:04.961205 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 807/1637] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:04 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:05.005627 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7f92f-5b37-42b5-9433-79a4d5ce6a79 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:05.017143 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7f92f-5b37-42b5-9433-79a4d5ce6a79 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:05.028742 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dda223-1342-41e4-ae70-53adad7682fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:05.029411 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dda223-1342-41e4-ae70-53adad7682fc service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:05.029642 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dda223-1342-41e4-ae70-53adad7682fc service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:05.029920 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dda223-1342-41e4-ae70-53adad7682fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:05.036421 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 831/1638] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Sep 7 15:56:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 15:56:05.050292 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e7d0e-519c-42bc-8fec-9d7710013080 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:05.064046 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dda223-1342-41e4-ae70-53adad7682fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:05.065552 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dda223-1342-41e4-ae70-53adad7682fc service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:05.079054 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 808/1639] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:05 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:05.080710 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e7d0e-519c-42bc-8fec-9d7710013080 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:05.090934 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a33071-685c-46f1-8115-e22751ba3df4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:05.091776 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a33071-685c-46f1-8115-e22751ba3df4 service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:05.092125 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a33071-685c-46f1-8115-e22751ba3df4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:05.092464 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a33071-685c-46f1-8115-e22751ba3df4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:05.112732 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a33071-685c-46f1-8115-e22751ba3df4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:05.115838 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a33071-685c-46f1-8115-e22751ba3df4 service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:05.139831 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 832/1640] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:05.398910 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87087705-0804-4482-9eac-3b09b5291a68 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:05.399540 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87087705-0804-4482-9eac-3b09b5291a68 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:05.400031 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87087705-0804-4482-9eac-3b09b5291a68 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:05.402113 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 809/1641] 10.222.0.16 () {54 vars in 912 bytes} [Wed Sep 7 15:56:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:05.412284 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a0297-0f3c-4690-800d-6771f47ba513 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:05.412566 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a0297-0f3c-4690-800d-6771f47ba513 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:05.412841 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a0297-0f3c-4690-800d-6771f47ba513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:05.444876 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-074a0297-0f3c-4690-800d-6771f47ba513 None None] MFA Rules not processed for user `f9b13331a5fd48f5a2521ed1600f9f35`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:05.445839 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-074a0297-0f3c-4690-800d-6771f47ba513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:05.456548 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 833/1642] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Sep 7 15:56:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:05.529400 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87087705-0804-4482-9eac-3b09b5291a68 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:05.544482 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87087705-0804-4482-9eac-3b09b5291a68 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:05.549958 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936823ce-4584-416e-9190-d8c6cc02d317 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:05.550643 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936823ce-4584-416e-9190-d8c6cc02d317 service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:05.550931 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936823ce-4584-416e-9190-d8c6cc02d317 service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:05.551210 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936823ce-4584-416e-9190-d8c6cc02d317 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:05.565925 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936823ce-4584-416e-9190-d8c6cc02d317 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:05.567933 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936823ce-4584-416e-9190-d8c6cc02d317 service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:05.591612 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 810/1643] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:05.696243 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a0297-0f3c-4690-800d-6771f47ba513 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:05.873879 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a0297-0f3c-4690-800d-6771f47ba513 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:05.879687 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296e3a9-a867-4481-90ff-a395348005df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:05.880047 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296e3a9-a867-4481-90ff-a395348005df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:05.880716 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296e3a9-a867-4481-90ff-a395348005df admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:05.881104 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296e3a9-a867-4481-90ff-a395348005df admin admin] PATH_INFO: `/v3/users/24c1fcf6fbfd46878875f3ac885fd8c3` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:05.882707 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4296e3a9-a867-4481-90ff-a395348005df admin admin] RBAC: Authorizing `identity:delete_user(user_id=24c1fcf6fbfd46878875f3ac885fd8c3)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:05.885250 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4296e3a9-a867-4481-90ff-a395348005df admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:05.892752 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:05.977433 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-4296e3a9-a867-4481-90ff-a395348005df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24c1fcf6fbfd46878875f3ac885fd8c3'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:05.992858 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-4296e3a9-a867-4481-90ff-a395348005df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24c1fcf6fbfd46878875f3ac885fd8c3'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:05.994991 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-4296e3a9-a867-4481-90ff-a395348005df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24c1fcf6fbfd46878875f3ac885fd8c3'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:06.034693 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-4296e3a9-a867-4481-90ff-a395348005df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24c1fcf6fbfd46878875f3ac885fd8c3'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:06.034693 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-4296e3a9-a867-4481-90ff-a395348005df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24c1fcf6fbfd46878875f3ac885fd8c3'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:06.065175 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 834/1644] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:56:05 2022] DELETE /identity/v3/users/24c1fcf6fbfd46878875f3ac885fd8c3 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:06.070322 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0bf2c-bdf6-4aae-9818-f8931ff86b95 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:06.070856 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0bf2c-bdf6-4aae-9818-f8931ff86b95 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:06.070957 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0bf2c-bdf6-4aae-9818-f8931ff86b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:06.082939 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:06.120488 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-51a0bf2c-bdf6-4aae-9818-f8931ff86b95 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:06.121752 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-51a0bf2c-bdf6-4aae-9818-f8931ff86b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:06.152392 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296e3a9-a867-4481-90ff-a395348005df admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:06.154426 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-4296e3a9-a867-4481-90ff-a395348005df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:06.263271 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 811/1645] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:06.273153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a0bf2c-bdf6-4aae-9818-f8931ff86b95 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:06.279016 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-51a0bf2c-bdf6-4aae-9818-f8931ff86b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:06.438649 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296e3a9-a867-4481-90ff-a395348005df admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:06.450279 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c96fed-1991-493a-a5ef-743ece876f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:06.452176 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c96fed-1991-493a-a5ef-743ece876f66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:06.452956 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c96fed-1991-493a-a5ef-743ece876f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:06.455031 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c96fed-1991-493a-a5ef-743ece876f66 admin admin] PATH_INFO: `/v3/users/bfd650e9271e47af81da42149625030f` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:06.457896 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c96fed-1991-493a-a5ef-743ece876f66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfd650e9271e47af81da42149625030f)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:06.462345 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c96fed-1991-493a-a5ef-743ece876f66 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:06.488573 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a0bf2c-bdf6-4aae-9818-f8931ff86b95 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:06.492632 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a036f25-d648-452e-9a6e-067652278e65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:06.493257 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a036f25-d648-452e-9a6e-067652278e65 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:06.493665 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a036f25-d648-452e-9a6e-067652278e65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:06.493816 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a036f25-d648-452e-9a6e-067652278e65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:06.526207 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a036f25-d648-452e-9a6e-067652278e65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:06.527837 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a036f25-d648-452e-9a6e-067652278e65 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:06.564649 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 812/1646] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:06.599170 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-20c96fed-1991-493a-a5ef-743ece876f66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfd650e9271e47af81da42149625030f'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:06.641565 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-20c96fed-1991-493a-a5ef-743ece876f66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfd650e9271e47af81da42149625030f'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:06.641565 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-20c96fed-1991-493a-a5ef-743ece876f66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfd650e9271e47af81da42149625030f'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:06.659885 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-20c96fed-1991-493a-a5ef-743ece876f66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfd650e9271e47af81da42149625030f'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:06.661701 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-20c96fed-1991-493a-a5ef-743ece876f66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfd650e9271e47af81da42149625030f'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:06.700889 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 835/1647] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:56:06 2022] DELETE /identity/v3/users/bfd650e9271e47af81da42149625030f => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:06.701087 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3c965-a998-4197-9c6f-78e89aba1d95 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:06.701270 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3c965-a998-4197-9c6f-78e89aba1d95 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:06.701534 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3c965-a998-4197-9c6f-78e89aba1d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:06.739949 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-e6b3c965-a998-4197-9c6f-78e89aba1d95 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:06.741170 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-e6b3c965-a998-4197-9c6f-78e89aba1d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:06.792590 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c96fed-1991-493a-a5ef-743ece876f66 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:06.798692 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-20c96fed-1991-493a-a5ef-743ece876f66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:06.811713 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:06.875130 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 813/1648] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 15:56:06.935689 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3c965-a998-4197-9c6f-78e89aba1d95 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:06.937578 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-e6b3c965-a998-4197-9c6f-78e89aba1d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:06.947609 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c96fed-1991-493a-a5ef-743ece876f66 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:06.966645 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f75246-d3f7-4d7f-aeab-5607d3f13130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:06.967621 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f75246-d3f7-4d7f-aeab-5607d3f13130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:06.968087 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f75246-d3f7-4d7f-aeab-5607d3f13130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:06.968540 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f75246-d3f7-4d7f-aeab-5607d3f13130 admin admin] PATH_INFO: `/v3/users/ab72867752f941b2ab53e1a6b8a744ca` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:06.969912 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f75246-d3f7-4d7f-aeab-5607d3f13130 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab72867752f941b2ab53e1a6b8a744ca)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:06.971901 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f75246-d3f7-4d7f-aeab-5607d3f13130 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:07.073687 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-f3f75246-d3f7-4d7f-aeab-5607d3f13130 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab72867752f941b2ab53e1a6b8a744ca'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:07.081770 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:07.097935 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-f3f75246-d3f7-4d7f-aeab-5607d3f13130 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab72867752f941b2ab53e1a6b8a744ca'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:07.098860 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-f3f75246-d3f7-4d7f-aeab-5607d3f13130 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab72867752f941b2ab53e1a6b8a744ca'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:07.100455 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3c965-a998-4197-9c6f-78e89aba1d95 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:07.108454 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9766dbb1-6df1-4afe-9a84-ebf871de1a5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:07.110469 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766dbb1-6df1-4afe-9a84-ebf871de1a5e service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:07.110854 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766dbb1-6df1-4afe-9a84-ebf871de1a5e service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:07.111229 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766dbb1-6df1-4afe-9a84-ebf871de1a5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:07.116187 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-9766dbb1-6df1-4afe-9a84-ebf871de1a5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:07.123650 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-f3f75246-d3f7-4d7f-aeab-5607d3f13130 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab72867752f941b2ab53e1a6b8a744ca'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:07.124657 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-f3f75246-d3f7-4d7f-aeab-5607d3f13130 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab72867752f941b2ab53e1a6b8a744ca'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:07.148110 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9766dbb1-6df1-4afe-9a84-ebf871de1a5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:07.153022 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9766dbb1-6df1-4afe-9a84-ebf871de1a5e service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:07.161379 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 836/1649] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:56:06 2022] DELETE /identity/v3/users/ab72867752f941b2ab53e1a6b8a744ca => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:07.162470 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1087a6-2295-4ad8-ae1f-203b2a26177c None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:07.162769 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1087a6-2295-4ad8-ae1f-203b2a26177c None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:07.163243 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1087a6-2295-4ad8-ae1f-203b2a26177c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:07.189011 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 814/1650] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:07.222451 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-5e1087a6-2295-4ad8-ae1f-203b2a26177c None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:07.224310 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-5e1087a6-2295-4ad8-ae1f-203b2a26177c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:07.410187 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 837/1651] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:07.434023 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9766dbb1-6df1-4afe-9a84-ebf871de1a5e service neutron] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:07.435712 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-9766dbb1-6df1-4afe-9a84-ebf871de1a5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:07.457193 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9766dbb1-6df1-4afe-9a84-ebf871de1a5e service neutron] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:07.631841 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0652c127-6b7d-4715-aa59-47a99e264089 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:07.632688 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652c127-6b7d-4715-aa59-47a99e264089 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:07.633122 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652c127-6b7d-4715-aa59-47a99e264089 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:07.633542 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652c127-6b7d-4715-aa59-47a99e264089 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:07.668757 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0652c127-6b7d-4715-aa59-47a99e264089 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:07.671252 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0652c127-6b7d-4715-aa59-47a99e264089 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:07.686332 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 815/1652] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:08.277984 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1087a6-2295-4ad8-ae1f-203b2a26177c None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:08.280692 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-5e1087a6-2295-4ad8-ae1f-203b2a26177c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:08.302041 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1087a6-2295-4ad8-ae1f-203b2a26177c None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:08.310967 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9c80f1-8383-402c-a8bc-1736c486473d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:08.312229 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c80f1-8383-402c-a8bc-1736c486473d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:08.312577 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c80f1-8383-402c-a8bc-1736c486473d admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:08.312858 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c80f1-8383-402c-a8bc-1736c486473d admin admin] PATH_INFO: `/v3/projects/9d48b6a59f5045cfa7c05cd05ebe3d28` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:08.314301 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9c80f1-8383-402c-a8bc-1736c486473d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d48b6a59f5045cfa7c05cd05ebe3d28)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:08.315587 dv-cinder-853315-8-smb devstack@keystone.service[81501]: WARNING py.warnings [None req-3b9c80f1-8383-402c-a8bc-1736c486473d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 15:56:08.315587 dv-cinder-853315-8-smb devstack@keystone.service[81501]: warnings.warn(msg) Sep 07 15:56:08.315587 dv-cinder-853315-8-smb devstack@keystone.service[81501]: Sep 07 15:56:08.316818 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9c80f1-8383-402c-a8bc-1736c486473d admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:08.365666 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:08.469389 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0652c127-6b7d-4715-aa59-47a99e264089 service neutron] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:08.471551 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-0652c127-6b7d-4715-aa59-47a99e264089 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:08.495912 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-3b9c80f1-8383-402c-a8bc-1736c486473d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d48b6a59f5045cfa7c05cd05ebe3d28', 'request_id': 'req-3b9c80f1-8383-402c-a8bc-1736c486473d'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:08.512700 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0652c127-6b7d-4715-aa59-47a99e264089 service neutron] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:08.522061 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-3b9c80f1-8383-402c-a8bc-1736c486473d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d48b6a59f5045cfa7c05cd05ebe3d28', 'request_id': 'req-3b9c80f1-8383-402c-a8bc-1736c486473d'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:08.539610 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-3b9c80f1-8383-402c-a8bc-1736c486473d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d48b6a59f5045cfa7c05cd05ebe3d28', 'request_id': 'req-3b9c80f1-8383-402c-a8bc-1736c486473d'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:08.579312 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-3b9c80f1-8383-402c-a8bc-1736c486473d admin admin] The token cache is being invalidate because project 9d48b6a59f5045cfa7c05cd05ebe3d28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:56:08.580119 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-3b9c80f1-8383-402c-a8bc-1736c486473d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:08.580742 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-3b9c80f1-8383-402c-a8bc-1736c486473d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:08.583916 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 838/1653] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:56:08 2022] DELETE /identity/v3/projects/9d48b6a59f5045cfa7c05cd05ebe3d28 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:08.594320 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9c80f1-8383-402c-a8bc-1736c486473d admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:08.594320 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-3b9c80f1-8383-402c-a8bc-1736c486473d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:08.653914 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea99a65c-8f7f-4afd-a50c-3e478db37ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:08.654869 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99a65c-8f7f-4afd-a50c-3e478db37ea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:08.655303 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99a65c-8f7f-4afd-a50c-3e478db37ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:08.656939 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99a65c-8f7f-4afd-a50c-3e478db37ea8 admin admin] PATH_INFO: `/v3/projects/3b146601d0cb4f60b8f011d1586936ad` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:08.658737 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea99a65c-8f7f-4afd-a50c-3e478db37ea8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b146601d0cb4f60b8f011d1586936ad)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:08.661306 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea99a65c-8f7f-4afd-a50c-3e478db37ea8 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:08.702777 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9c80f1-8383-402c-a8bc-1736c486473d admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:08.709304 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e054b-b1da-45bb-bf16-c73ec32b7a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:08.710131 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e054b-b1da-45bb-bf16-c73ec32b7a52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:08.710531 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e054b-b1da-45bb-bf16-c73ec32b7a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:08.710886 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e054b-b1da-45bb-bf16-c73ec32b7a52 admin admin] PATH_INFO: `/v3/users/035407ee95cf4a31869695a658a4e87b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:08.712377 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e054b-b1da-45bb-bf16-c73ec32b7a52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=035407ee95cf4a31869695a658a4e87b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:08.715311 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e054b-b1da-45bb-bf16-c73ec32b7a52 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:08.754887 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-ea99a65c-8f7f-4afd-a50c-3e478db37ea8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b146601d0cb4f60b8f011d1586936ad', 'request_id': 'req-ea99a65c-8f7f-4afd-a50c-3e478db37ea8'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:08.767343 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-ea99a65c-8f7f-4afd-a50c-3e478db37ea8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b146601d0cb4f60b8f011d1586936ad', 'request_id': 'req-ea99a65c-8f7f-4afd-a50c-3e478db37ea8'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:08.788365 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-ea99a65c-8f7f-4afd-a50c-3e478db37ea8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b146601d0cb4f60b8f011d1586936ad', 'request_id': 'req-ea99a65c-8f7f-4afd-a50c-3e478db37ea8'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:08.799841 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-133e054b-b1da-45bb-bf16-c73ec32b7a52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '035407ee95cf4a31869695a658a4e87b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:08.816068 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-ea99a65c-8f7f-4afd-a50c-3e478db37ea8 admin admin] The token cache is being invalidate because project 3b146601d0cb4f60b8f011d1586936ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:56:08.816569 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-ea99a65c-8f7f-4afd-a50c-3e478db37ea8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:08.819911 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-ea99a65c-8f7f-4afd-a50c-3e478db37ea8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:08.823298 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 816/1654] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:56:08 2022] DELETE /identity/v3/projects/3b146601d0cb4f60b8f011d1586936ad => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 15:56:08.823485 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-133e054b-b1da-45bb-bf16-c73ec32b7a52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '035407ee95cf4a31869695a658a4e87b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:08.827531 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-133e054b-b1da-45bb-bf16-c73ec32b7a52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '035407ee95cf4a31869695a658a4e87b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:08.829255 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdcc4f5-1522-4ae4-bc9a-8ca58b56c4d2 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:08.830007 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdcc4f5-1522-4ae4-bc9a-8ca58b56c4d2 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:08.830482 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdcc4f5-1522-4ae4-bc9a-8ca58b56c4d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:08.865225 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-133e054b-b1da-45bb-bf16-c73ec32b7a52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '035407ee95cf4a31869695a658a4e87b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:08.868126 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-133e054b-b1da-45bb-bf16-c73ec32b7a52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '035407ee95cf4a31869695a658a4e87b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:08.881685 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-9cdcc4f5-1522-4ae4-bc9a-8ca58b56c4d2 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:08.886475 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-9cdcc4f5-1522-4ae4-bc9a-8ca58b56c4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:08.892611 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 839/1655] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:56:08 2022] DELETE /identity/v3/users/035407ee95cf4a31869695a658a4e87b => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:08.893881 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e054b-b1da-45bb-bf16-c73ec32b7a52 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:08.896418 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-133e054b-b1da-45bb-bf16-c73ec32b7a52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:08.932502 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:08.946464 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:09.055566 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 817/1656] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:09.064485 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc64c93-61ac-4f87-a0fd-a9909163c043 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:09.064990 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc64c93-61ac-4f87-a0fd-a9909163c043 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:09.065381 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc64c93-61ac-4f87-a0fd-a9909163c043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:09.066843 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e054b-b1da-45bb-bf16-c73ec32b7a52 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:09.073312 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371a60d-57de-4752-8e8b-27c29568d64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:09.073966 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371a60d-57de-4752-8e8b-27c29568d64e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:09.074281 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371a60d-57de-4752-8e8b-27c29568d64e admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:09.074563 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371a60d-57de-4752-8e8b-27c29568d64e admin admin] PATH_INFO: `/v3/projects/793a7041d8c04cbe9b3117ea8b01c90f` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:09.075767 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5371a60d-57de-4752-8e8b-27c29568d64e admin admin] RBAC: Authorizing `identity:delete_project(project_id=793a7041d8c04cbe9b3117ea8b01c90f)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:09.079783 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5371a60d-57de-4752-8e8b-27c29568d64e admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:09.123323 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-9fc64c93-61ac-4f87-a0fd-a9909163c043 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:09.125048 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-9fc64c93-61ac-4f87-a0fd-a9909163c043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:09.161705 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 818/1657] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:09.166213 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc64c93-61ac-4f87-a0fd-a9909163c043 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:09.181147 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc64c93-61ac-4f87-a0fd-a9909163c043 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:09.189965 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5936f0b2-b081-4ec2-8d1d-2fc57e79edc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:09.190673 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936f0b2-b081-4ec2-8d1d-2fc57e79edc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:09.190953 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936f0b2-b081-4ec2-8d1d-2fc57e79edc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:09.191223 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936f0b2-b081-4ec2-8d1d-2fc57e79edc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:09.192227 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5936f0b2-b081-4ec2-8d1d-2fc57e79edc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:09.192560 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5936f0b2-b081-4ec2-8d1d-2fc57e79edc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:09.195514 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5936f0b2-b081-4ec2-8d1d-2fc57e79edc1 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:09.222894 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-5371a60d-57de-4752-8e8b-27c29568d64e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '793a7041d8c04cbe9b3117ea8b01c90f', 'request_id': 'req-5371a60d-57de-4752-8e8b-27c29568d64e'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:09.225186 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 819/1658] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 15:56:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:09.230695 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5936f0b2-b081-4ec2-8d1d-2fc57e79edc1 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:09.236881 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-5936f0b2-b081-4ec2-8d1d-2fc57e79edc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:09.241389 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-5371a60d-57de-4752-8e8b-27c29568d64e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '793a7041d8c04cbe9b3117ea8b01c90f', 'request_id': 'req-5371a60d-57de-4752-8e8b-27c29568d64e'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:09.261700 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-5371a60d-57de-4752-8e8b-27c29568d64e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '793a7041d8c04cbe9b3117ea8b01c90f', 'request_id': 'req-5371a60d-57de-4752-8e8b-27c29568d64e'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:09.273327 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5936f0b2-b081-4ec2-8d1d-2fc57e79edc1 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:09.286159 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-5371a60d-57de-4752-8e8b-27c29568d64e admin admin] The token cache is being invalidate because project 793a7041d8c04cbe9b3117ea8b01c90f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:56:09.286887 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-5371a60d-57de-4752-8e8b-27c29568d64e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:09.287562 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-5371a60d-57de-4752-8e8b-27c29568d64e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:09.291421 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 840/1659] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:56:08 2022] DELETE /identity/v3/projects/793a7041d8c04cbe9b3117ea8b01c90f => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:09.307132 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371a60d-57de-4752-8e8b-27c29568d64e admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:09.311453 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-5371a60d-57de-4752-8e8b-27c29568d64e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:09.411485 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff74d3-55be-434d-860d-fcd2c41f9496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:09.412257 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff74d3-55be-434d-860d-fcd2c41f9496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:09.413068 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff74d3-55be-434d-860d-fcd2c41f9496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:09.413068 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff74d3-55be-434d-860d-fcd2c41f9496 admin admin] PATH_INFO: `/v3/users/6d2316ba082b42bea5203aea5dc618a6` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:09.414713 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cff74d3-55be-434d-860d-fcd2c41f9496 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d2316ba082b42bea5203aea5dc618a6)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:09.416408 dv-cinder-853315-8-smb devstack@keystone.service[81502]: WARNING py.warnings [None req-1cff74d3-55be-434d-860d-fcd2c41f9496 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 15:56:09.416408 dv-cinder-853315-8-smb devstack@keystone.service[81502]: warnings.warn(msg) Sep 07 15:56:09.416408 dv-cinder-853315-8-smb devstack@keystone.service[81502]: Sep 07 15:56:09.418054 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cff74d3-55be-434d-860d-fcd2c41f9496 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:09.453247 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371a60d-57de-4752-8e8b-27c29568d64e admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:09.464266 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d260b32-1eab-483b-8058-1f249baf19ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:09.464266 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d260b32-1eab-483b-8058-1f249baf19ea admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:09.464266 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d260b32-1eab-483b-8058-1f249baf19ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:09.464266 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d260b32-1eab-483b-8058-1f249baf19ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:09.464732 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d260b32-1eab-483b-8058-1f249baf19ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:09.469741 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d260b32-1eab-483b-8058-1f249baf19ea admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:09.556648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 841/1660] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:56:09 2022] POST /identity/v3/projects => generated 373 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:09.561704 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d260b32-1eab-483b-8058-1f249baf19ea admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:09.566106 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-4d260b32-1eab-483b-8058-1f249baf19ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:09.576234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-1cff74d3-55be-434d-860d-fcd2c41f9496 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d2316ba082b42bea5203aea5dc618a6'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:09.598364 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-1cff74d3-55be-434d-860d-fcd2c41f9496 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d2316ba082b42bea5203aea5dc618a6'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:09.599500 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-1cff74d3-55be-434d-860d-fcd2c41f9496 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d2316ba082b42bea5203aea5dc618a6'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:09.624452 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-1cff74d3-55be-434d-860d-fcd2c41f9496 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d2316ba082b42bea5203aea5dc618a6'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:09.625394 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-1cff74d3-55be-434d-860d-fcd2c41f9496 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d2316ba082b42bea5203aea5dc618a6'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:09.668974 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:09.678130 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 820/1661] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:56:09 2022] DELETE /identity/v3/users/6d2316ba082b42bea5203aea5dc618a6 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:09.679689 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff74d3-55be-434d-860d-fcd2c41f9496 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:09.682880 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-1cff74d3-55be-434d-860d-fcd2c41f9496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:09.709724 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d260b32-1eab-483b-8058-1f249baf19ea admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:09.770115 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:09.863334 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2757ff-47d8-4b4d-bdb5-fc9fe5c8974a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:09.864015 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2757ff-47d8-4b4d-bdb5-fc9fe5c8974a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:09.864304 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2757ff-47d8-4b4d-bdb5-fc9fe5c8974a admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:09.864584 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2757ff-47d8-4b4d-bdb5-fc9fe5c8974a admin admin] PATH_INFO: `/v3/users/f433d2fb33f64e8a893b134477a3596d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:09.865825 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff74d3-55be-434d-860d-fcd2c41f9496 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:09.867135 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2757ff-47d8-4b4d-bdb5-fc9fe5c8974a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f433d2fb33f64e8a893b134477a3596d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:09.871282 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2757ff-47d8-4b4d-bdb5-fc9fe5c8974a admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:09.871779 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31cb6a-493e-4791-95df-d3cc6b18687c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:09.872962 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31cb6a-493e-4791-95df-d3cc6b18687c admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:09.873356 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31cb6a-493e-4791-95df-d3cc6b18687c admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:09.873654 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31cb6a-493e-4791-95df-d3cc6b18687c admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:09.874687 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf31cb6a-493e-4791-95df-d3cc6b18687c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:09.877636 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf31cb6a-493e-4791-95df-d3cc6b18687c admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:09.916938 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 821/1662] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:56:09 2022] POST /identity/v3/users => generated 287 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:09.918638 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288398e7-d197-41f1-88f1-f41b0847b55a None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:09.918927 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288398e7-d197-41f1-88f1-f41b0847b55a None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:09.919202 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288398e7-d197-41f1-88f1-f41b0847b55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:09.952614 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-288398e7-d197-41f1-88f1-f41b0847b55a None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:09.955227 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-288398e7-d197-41f1-88f1-f41b0847b55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:09.974791 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 822/1663] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:09.976138 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288398e7-d197-41f1-88f1-f41b0847b55a None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:09.993385 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288398e7-d197-41f1-88f1-f41b0847b55a None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:09.997842 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-4d2757ff-47d8-4b4d-bdb5-fc9fe5c8974a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f433d2fb33f64e8a893b134477a3596d'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:10.003760 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c4b9d-7433-431c-9f4e-81e008067f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:10.004448 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c4b9d-7433-431c-9f4e-81e008067f77 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:10.005989 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c4b9d-7433-431c-9f4e-81e008067f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:10.006311 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c4b9d-7433-431c-9f4e-81e008067f77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:10.007316 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58c4b9d-7433-431c-9f4e-81e008067f77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:10.010341 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58c4b9d-7433-431c-9f4e-81e008067f77 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:10.013769 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-4d2757ff-47d8-4b4d-bdb5-fc9fe5c8974a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f433d2fb33f64e8a893b134477a3596d'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:10.014667 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-4d2757ff-47d8-4b4d-bdb5-fc9fe5c8974a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f433d2fb33f64e8a893b134477a3596d'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:10.032257 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 823/1664] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:10.034402 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c4b9d-7433-431c-9f4e-81e008067f77 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:10.038126 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-c58c4b9d-7433-431c-9f4e-81e008067f77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:10.044034 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-4d2757ff-47d8-4b4d-bdb5-fc9fe5c8974a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f433d2fb33f64e8a893b134477a3596d'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:10.045226 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-4d2757ff-47d8-4b4d-bdb5-fc9fe5c8974a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f433d2fb33f64e8a893b134477a3596d'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:10.053927 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c4b9d-7433-431c-9f4e-81e008067f77 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:10.063319 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47fc4b9-bfb0-4e32-841f-17b44d663ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:10.064027 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fc4b9-bfb0-4e32-841f-17b44d663ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:10.064381 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fc4b9-bfb0-4e32-841f-17b44d663ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:10.064733 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fc4b9-bfb0-4e32-841f-17b44d663ef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:10.065454 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47fc4b9-bfb0-4e32-841f-17b44d663ef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:10.067228 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47fc4b9-bfb0-4e32-841f-17b44d663ef7 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:10.074556 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 842/1665] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:56:09 2022] DELETE /identity/v3/users/f433d2fb33f64e8a893b134477a3596d => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:10.089132 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 824/1666] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:10.093734 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2757ff-47d8-4b4d-bdb5-fc9fe5c8974a admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:10.111632 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47fc4b9-bfb0-4e32-841f-17b44d663ef7 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:10.113568 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-f47fc4b9-bfb0-4e32-841f-17b44d663ef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:10.231427 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2757ff-47d8-4b4d-bdb5-fc9fe5c8974a admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:10.252806 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519eb57d-3109-4d0a-ab50-ddcfd5488cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:10.255423 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519eb57d-3109-4d0a-ab50-ddcfd5488cf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:10.256522 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519eb57d-3109-4d0a-ab50-ddcfd5488cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:10.256974 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519eb57d-3109-4d0a-ab50-ddcfd5488cf1 admin admin] PATH_INFO: `/v3/projects/1e8cbbbc9bce4153956d6d5f64726a91/users/c0826425c2bd48c2b2408e95688ef0e5/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:10.257483 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47fc4b9-bfb0-4e32-841f-17b44d663ef7 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:10.299156 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:10.307485 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519eb57d-3109-4d0a-ab50-ddcfd5488cf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e8cbbbc9bce4153956d6d5f64726a91, user_id=c0826425c2bd48c2b2408e95688ef0e5, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:10.316911 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519eb57d-3109-4d0a-ab50-ddcfd5488cf1 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:10.353018 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 843/1667] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:10 2022] PUT /identity/v3/projects/1e8cbbbc9bce4153956d6d5f64726a91/users/c0826425c2bd48c2b2408e95688ef0e5/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:10.367269 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78a68b-5e7f-461b-9754-49cdbb4b5c18 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:10.367563 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78a68b-5e7f-461b-9754-49cdbb4b5c18 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:10.367843 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78a68b-5e7f-461b-9754-49cdbb4b5c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:10.434479 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee4094-06de-4f64-82da-5f22bc6d0512 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:10.435136 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee4094-06de-4f64-82da-5f22bc6d0512 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:10.435536 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee4094-06de-4f64-82da-5f22bc6d0512 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:10.435815 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee4094-06de-4f64-82da-5f22bc6d0512 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:10.444822 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-47ee4094-06de-4f64-82da-5f22bc6d0512 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:10.449684 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-ac78a68b-5e7f-461b-9754-49cdbb4b5c18 None None] MFA Rules not processed for user `c0826425c2bd48c2b2408e95688ef0e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:10.453802 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-ac78a68b-5e7f-461b-9754-49cdbb4b5c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:10.487382 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ee4094-06de-4f64-82da-5f22bc6d0512 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:10.488901 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ee4094-06de-4f64-82da-5f22bc6d0512 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:10.527515 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 825/1668] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:10.528401 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee4094-06de-4f64-82da-5f22bc6d0512 service neutron] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:10.546334 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-47ee4094-06de-4f64-82da-5f22bc6d0512 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:10.576989 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee4094-06de-4f64-82da-5f22bc6d0512 service neutron] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:10.694240 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 844/1669] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:10.701790 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78a68b-5e7f-461b-9754-49cdbb4b5c18 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:10.720068 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:10.743379 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980d856-848d-4314-827c-482c31ca42db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:10.744144 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980d856-848d-4314-827c-482c31ca42db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:10.744672 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980d856-848d-4314-827c-482c31ca42db admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:10.745206 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980d856-848d-4314-827c-482c31ca42db admin admin] PATH_INFO: `/v3/projects/b690dc1429a44dabb7ab61bd5bb25e6b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:10.746662 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9980d856-848d-4314-827c-482c31ca42db admin admin] RBAC: Authorizing `identity:delete_project(project_id=b690dc1429a44dabb7ab61bd5bb25e6b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:10.749183 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9980d856-848d-4314-827c-482c31ca42db admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:10.813444 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78a68b-5e7f-461b-9754-49cdbb4b5c18 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:10.830170 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-9980d856-848d-4314-827c-482c31ca42db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b690dc1429a44dabb7ab61bd5bb25e6b', 'request_id': 'req-9980d856-848d-4314-827c-482c31ca42db'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:10.841259 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-9980d856-848d-4314-827c-482c31ca42db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b690dc1429a44dabb7ab61bd5bb25e6b', 'request_id': 'req-9980d856-848d-4314-827c-482c31ca42db'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:10.857562 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-9980d856-848d-4314-827c-482c31ca42db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b690dc1429a44dabb7ab61bd5bb25e6b', 'request_id': 'req-9980d856-848d-4314-827c-482c31ca42db'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:10.878633 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-9980d856-848d-4314-827c-482c31ca42db admin admin] The token cache is being invalidate because project b690dc1429a44dabb7ab61bd5bb25e6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:56:10.878937 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-9980d856-848d-4314-827c-482c31ca42db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:10.879681 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-9980d856-848d-4314-827c-482c31ca42db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:10.886204 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 826/1670] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:56:10 2022] DELETE /identity/v3/projects/b690dc1429a44dabb7ab61bd5bb25e6b => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:10.888079 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c51b2-f7b3-41b5-85dc-5b460a545bda None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:10.888378 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c51b2-f7b3-41b5-85dc-5b460a545bda None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:10.888670 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c51b2-f7b3-41b5-85dc-5b460a545bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:10.915282 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-d89c51b2-f7b3-41b5-85dc-5b460a545bda None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:10.918595 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-d89c51b2-f7b3-41b5-85dc-5b460a545bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:10.974221 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dae768-f159-4a25-a634-f2fa7c9fd7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:10.975035 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dae768-f159-4a25-a634-f2fa7c9fd7cd admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:10.975462 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dae768-f159-4a25-a634-f2fa7c9fd7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:10.975916 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dae768-f159-4a25-a634-f2fa7c9fd7cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:10.976772 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dae768-f159-4a25-a634-f2fa7c9fd7cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:10.987542 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dae768-f159-4a25-a634-f2fa7c9fd7cd admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:11.047180 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 827/1671] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:11.059902 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3909961-3552-496c-ac85-028e65028435 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:11.060887 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3909961-3552-496c-ac85-028e65028435 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:11.061089 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 845/1672] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:56:10 2022] POST /identity/v3/projects => generated 373 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 15:56:11.061637 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3909961-3552-496c-ac85-028e65028435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:11.064889 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dae768-f159-4a25-a634-f2fa7c9fd7cd admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:11.069226 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-24dae768-f159-4a25-a634-f2fa7c9fd7cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:11.106331 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-a3909961-3552-496c-ac85-028e65028435 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:11.108053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-a3909961-3552-496c-ac85-028e65028435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:11.110596 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:11.251210 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 828/1673] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:11.252403 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3909961-3552-496c-ac85-028e65028435 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:11.265286 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3909961-3552-496c-ac85-028e65028435 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:11.269391 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dae768-f159-4a25-a634-f2fa7c9fd7cd admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:11.273004 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec040749-17b2-414a-90ba-97f3cde0f76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:11.274213 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec040749-17b2-414a-90ba-97f3cde0f76e admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:11.274213 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec040749-17b2-414a-90ba-97f3cde0f76e admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:11.274368 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec040749-17b2-414a-90ba-97f3cde0f76e admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:11.275003 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec040749-17b2-414a-90ba-97f3cde0f76e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:11.275679 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec040749-17b2-414a-90ba-97f3cde0f76e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:11.276625 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff40254-8529-439e-a626-1f704ca2fdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:11.277449 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec040749-17b2-414a-90ba-97f3cde0f76e admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:11.277678 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff40254-8529-439e-a626-1f704ca2fdec admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:11.278158 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff40254-8529-439e-a626-1f704ca2fdec admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:11.278719 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff40254-8529-439e-a626-1f704ca2fdec admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:11.279670 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff40254-8529-439e-a626-1f704ca2fdec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:11.284924 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff40254-8529-439e-a626-1f704ca2fdec admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:11.288393 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:11.302614 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 829/1674] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 15:56:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:11.303696 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec040749-17b2-414a-90ba-97f3cde0f76e admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:11.320345 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec040749-17b2-414a-90ba-97f3cde0f76e admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:11.333588 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 846/1675] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:56:11 2022] POST /identity/v3/users => generated 293 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:11.344832 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40924d3f-9a77-420a-9923-daf30c0aa690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:11.345274 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff40254-8529-439e-a626-1f704ca2fdec admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:11.345869 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40924d3f-9a77-420a-9923-daf30c0aa690 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:11.346866 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40924d3f-9a77-420a-9923-daf30c0aa690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:11.347250 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40924d3f-9a77-420a-9923-daf30c0aa690 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:11.348171 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40924d3f-9a77-420a-9923-daf30c0aa690 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:11.358397 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40924d3f-9a77-420a-9923-daf30c0aa690 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:11.417695 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff40254-8529-439e-a626-1f704ca2fdec admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:11.437432 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d945a-a0a9-4ab5-aefe-0388358f870d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:11.438352 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d945a-a0a9-4ab5-aefe-0388358f870d admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:11.440721 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 830/1676] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:56:11 2022] POST /identity/v3/projects => generated 367 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:11.440871 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d945a-a0a9-4ab5-aefe-0388358f870d admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:11.441267 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d945a-a0a9-4ab5-aefe-0388358f870d admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:11.444727 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3d945a-a0a9-4ab5-aefe-0388358f870d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:11.445861 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40924d3f-9a77-420a-9923-daf30c0aa690 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:11.447762 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3d945a-a0a9-4ab5-aefe-0388358f870d admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:11.497113 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 847/1677] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:11.498857 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d945a-a0a9-4ab5-aefe-0388358f870d admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:11.524056 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d945a-a0a9-4ab5-aefe-0388358f870d admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:11.639430 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f8f60-caaf-46af-ba78-64dd6303d4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:11.640076 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40924d3f-9a77-420a-9923-daf30c0aa690 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:11.640555 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f8f60-caaf-46af-ba78-64dd6303d4e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:11.640555 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f8f60-caaf-46af-ba78-64dd6303d4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:11.643722 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f8f60-caaf-46af-ba78-64dd6303d4e1 admin admin] PATH_INFO: `/v3/projects/efb80e7c401c423aa54ea1bdc990558a/users/b16296f04b8a43829c3ff882dfd0b8c2/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:11.649575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298b665-f28c-4989-8c53-56ddc315323c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:11.650651 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298b665-f28c-4989-8c53-56ddc315323c admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:11.651156 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298b665-f28c-4989-8c53-56ddc315323c admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:11.651634 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298b665-f28c-4989-8c53-56ddc315323c admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:11.652488 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298b665-f28c-4989-8c53-56ddc315323c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:11.654683 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298b665-f28c-4989-8c53-56ddc315323c admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:11.704267 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9f8f60-caaf-46af-ba78-64dd6303d4e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efb80e7c401c423aa54ea1bdc990558a, user_id=b16296f04b8a43829c3ff882dfd0b8c2, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:11.712798 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9f8f60-caaf-46af-ba78-64dd6303d4e1 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:11.728128 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 831/1678] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:56:11 2022] POST /identity/v3/users => generated 284 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:11.732419 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298b665-f28c-4989-8c53-56ddc315323c admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:11.766898 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298b665-f28c-4989-8c53-56ddc315323c admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:11.768988 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 848/1679] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:11 2022] PUT /identity/v3/projects/efb80e7c401c423aa54ea1bdc990558a/users/b16296f04b8a43829c3ff882dfd0b8c2/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:11.773447 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f8f60-caaf-46af-ba78-64dd6303d4e1 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:11.901822 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f514c-504b-404c-af2c-6d6ecf7c483f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:11.902673 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f514c-504b-404c-af2c-6d6ecf7c483f admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:11.903057 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f514c-504b-404c-af2c-6d6ecf7c483f admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:11.903459 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f514c-504b-404c-af2c-6d6ecf7c483f admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:11.904225 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24f514c-504b-404c-af2c-6d6ecf7c483f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:11.906207 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24f514c-504b-404c-af2c-6d6ecf7c483f admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:11.939159 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 832/1680] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:11.943314 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f514c-504b-404c-af2c-6d6ecf7c483f admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:11.949933 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-a24f514c-504b-404c-af2c-6d6ecf7c483f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:11.979909 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f8f60-caaf-46af-ba78-64dd6303d4e1 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:11.984630 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f514c-504b-404c-af2c-6d6ecf7c483f admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:12.000680 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1326fa-948a-438a-b383-e7162596dae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:12.001325 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1326fa-948a-438a-b383-e7162596dae2 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:12.001610 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1326fa-948a-438a-b383-e7162596dae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:12.001888 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1326fa-948a-438a-b383-e7162596dae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:12.002508 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3cab2-fa46-4a5b-9f88-33a09b3096b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:12.003061 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1326fa-948a-438a-b383-e7162596dae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:12.003618 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3cab2-fa46-4a5b-9f88-33a09b3096b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:12.004006 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3cab2-fa46-4a5b-9f88-33a09b3096b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:12.004401 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3cab2-fa46-4a5b-9f88-33a09b3096b6 admin admin] PATH_INFO: `/v3/projects/139e5822bdfa467e8e43c5cae505fd07` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:12.005777 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b3cab2-fa46-4a5b-9f88-33a09b3096b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=139e5822bdfa467e8e43c5cae505fd07)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:12.006300 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1326fa-948a-438a-b383-e7162596dae2 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:12.007909 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b3cab2-fa46-4a5b-9f88-33a09b3096b6 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:12.038473 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 849/1681] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:12.039347 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1326fa-948a-438a-b383-e7162596dae2 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:12.067795 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1326fa-948a-438a-b383-e7162596dae2 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:12.080817 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464513f8-7f2d-4c54-926e-734923ec89f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:12.081751 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464513f8-7f2d-4c54-926e-734923ec89f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:12.082078 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464513f8-7f2d-4c54-926e-734923ec89f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:12.082479 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464513f8-7f2d-4c54-926e-734923ec89f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:12.083163 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464513f8-7f2d-4c54-926e-734923ec89f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:12.087091 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464513f8-7f2d-4c54-926e-734923ec89f5 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:12.102534 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:12.109223 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-c3b3cab2-fa46-4a5b-9f88-33a09b3096b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '139e5822bdfa467e8e43c5cae505fd07', 'request_id': 'req-c3b3cab2-fa46-4a5b-9f88-33a09b3096b6'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:12.122264 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 850/1682] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:12.123246 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-c3b3cab2-fa46-4a5b-9f88-33a09b3096b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '139e5822bdfa467e8e43c5cae505fd07', 'request_id': 'req-c3b3cab2-fa46-4a5b-9f88-33a09b3096b6'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:12.123911 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464513f8-7f2d-4c54-926e-734923ec89f5 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:12.124950 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:12.137448 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-c3b3cab2-fa46-4a5b-9f88-33a09b3096b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '139e5822bdfa467e8e43c5cae505fd07', 'request_id': 'req-c3b3cab2-fa46-4a5b-9f88-33a09b3096b6'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:12.160689 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-c3b3cab2-fa46-4a5b-9f88-33a09b3096b6 admin admin] The token cache is being invalidate because project 139e5822bdfa467e8e43c5cae505fd07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:56:12.161138 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-c3b3cab2-fa46-4a5b-9f88-33a09b3096b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:12.162355 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-c3b3cab2-fa46-4a5b-9f88-33a09b3096b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:12.163286 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464513f8-7f2d-4c54-926e-734923ec89f5 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:12.165033 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 833/1683] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:56:11 2022] DELETE /identity/v3/projects/139e5822bdfa467e8e43c5cae505fd07 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:12.166294 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3cab2-fa46-4a5b-9f88-33a09b3096b6 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:12.171727 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-c3b3cab2-fa46-4a5b-9f88-33a09b3096b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:12.335116 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29493423-a9d3-489c-bb48-73e040d2b409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:12.336230 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29493423-a9d3-489c-bb48-73e040d2b409 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:12.336488 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29493423-a9d3-489c-bb48-73e040d2b409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:12.339065 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29493423-a9d3-489c-bb48-73e040d2b409 admin admin] PATH_INFO: `/v3/projects/efb80e7c401c423aa54ea1bdc990558a/users/b16296f04b8a43829c3ff882dfd0b8c2/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:12.343500 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29493423-a9d3-489c-bb48-73e040d2b409 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efb80e7c401c423aa54ea1bdc990558a, user_id=b16296f04b8a43829c3ff882dfd0b8c2, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:12.352672 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29493423-a9d3-489c-bb48-73e040d2b409 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:12.370204 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3cab2-fa46-4a5b-9f88-33a09b3096b6 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:12.397050 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 851/1684] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:12 2022] PUT /identity/v3/projects/efb80e7c401c423aa54ea1bdc990558a/users/b16296f04b8a43829c3ff882dfd0b8c2/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:12.399342 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdacd31-cca2-4a84-a0a5-33f55b16f492 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:12.399638 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdacd31-cca2-4a84-a0a5-33f55b16f492 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:12.399923 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdacd31-cca2-4a84-a0a5-33f55b16f492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:12.435165 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-5fdacd31-cca2-4a84-a0a5-33f55b16f492 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:12.436868 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-5fdacd31-cca2-4a84-a0a5-33f55b16f492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:12.536498 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df715b-19fe-47a0-90c4-00cf29f6d4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:12.537546 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df715b-19fe-47a0-90c4-00cf29f6d4c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:12.539113 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df715b-19fe-47a0-90c4-00cf29f6d4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:12.539611 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df715b-19fe-47a0-90c4-00cf29f6d4c6 admin admin] PATH_INFO: `/v3/projects/ef28cfa6139f4ee8a8a280b26ad4d18b/users/5ba021e12eca402289ded11cee40429f/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:12.560399 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 852/1685] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:12.562121 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a49af-f0ef-4ce0-8276-db28e0ea2a13 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:12.562471 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a49af-f0ef-4ce0-8276-db28e0ea2a13 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:12.562773 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a49af-f0ef-4ce0-8276-db28e0ea2a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:12.584694 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33df715b-19fe-47a0-90c4-00cf29f6d4c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef28cfa6139f4ee8a8a280b26ad4d18b, user_id=5ba021e12eca402289ded11cee40429f, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:12.591733 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33df715b-19fe-47a0-90c4-00cf29f6d4c6 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:12.614511 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-7e1a49af-f0ef-4ce0-8276-db28e0ea2a13 None None] MFA Rules not processed for user `b16296f04b8a43829c3ff882dfd0b8c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:12.617127 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-7e1a49af-f0ef-4ce0-8276-db28e0ea2a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:12.646970 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 834/1686] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:12 2022] PUT /identity/v3/projects/ef28cfa6139f4ee8a8a280b26ad4d18b/users/5ba021e12eca402289ded11cee40429f/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:12.652448 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b9900-7426-45b0-b5f8-9b110beb483a None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:12.653791 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b9900-7426-45b0-b5f8-9b110beb483a None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:12.654359 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b9900-7426-45b0-b5f8-9b110beb483a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:12.711478 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-621b9900-7426-45b0-b5f8-9b110beb483a None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:12.714120 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-621b9900-7426-45b0-b5f8-9b110beb483a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:12.798528 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 853/1687] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:12.799460 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a49af-f0ef-4ce0-8276-db28e0ea2a13 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:12.803007 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-7e1a49af-f0ef-4ce0-8276-db28e0ea2a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:12.838582 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a49af-f0ef-4ce0-8276-db28e0ea2a13 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:12.851592 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 835/1688] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:12.854223 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de20226-60aa-4ee0-9d6b-762a5dc67f23 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:12.854626 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de20226-60aa-4ee0-9d6b-762a5dc67f23 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:12.855575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de20226-60aa-4ee0-9d6b-762a5dc67f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:12.868077 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07134db1-0579-4e27-bc50-32bed586ce61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:12.869455 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07134db1-0579-4e27-bc50-32bed586ce61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:12.870205 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07134db1-0579-4e27-bc50-32bed586ce61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:12.870680 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07134db1-0579-4e27-bc50-32bed586ce61 admin admin] PATH_INFO: `/v3/projects/ee018095c240480bbb2f698b21540e54` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:12.876283 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07134db1-0579-4e27-bc50-32bed586ce61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee018095c240480bbb2f698b21540e54)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:12.885221 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07134db1-0579-4e27-bc50-32bed586ce61 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:12.906515 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-5de20226-60aa-4ee0-9d6b-762a5dc67f23 None None] MFA Rules not processed for user `5ba021e12eca402289ded11cee40429f`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:12.908256 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-5de20226-60aa-4ee0-9d6b-762a5dc67f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:12.916789 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:12.944377 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:13.051863 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-07134db1-0579-4e27-bc50-32bed586ce61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee018095c240480bbb2f698b21540e54', 'request_id': 'req-07134db1-0579-4e27-bc50-32bed586ce61'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:13.074138 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-07134db1-0579-4e27-bc50-32bed586ce61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee018095c240480bbb2f698b21540e54', 'request_id': 'req-07134db1-0579-4e27-bc50-32bed586ce61'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:13.088554 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 836/1689] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:13.089729 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de20226-60aa-4ee0-9d6b-762a5dc67f23 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:13.091275 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-5de20226-60aa-4ee0-9d6b-762a5dc67f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:13.098140 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-07134db1-0579-4e27-bc50-32bed586ce61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee018095c240480bbb2f698b21540e54', 'request_id': 'req-07134db1-0579-4e27-bc50-32bed586ce61'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:13.135808 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-07134db1-0579-4e27-bc50-32bed586ce61 admin admin] The token cache is being invalidate because project ee018095c240480bbb2f698b21540e54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:56:13.136299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-07134db1-0579-4e27-bc50-32bed586ce61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:13.145330 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-07134db1-0579-4e27-bc50-32bed586ce61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:13.147580 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 854/1690] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:56:12 2022] DELETE /identity/v3/projects/ee018095c240480bbb2f698b21540e54 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:13.151745 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07134db1-0579-4e27-bc50-32bed586ce61 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:13.159375 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-07134db1-0579-4e27-bc50-32bed586ce61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:13.218903 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de20226-60aa-4ee0-9d6b-762a5dc67f23 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:13.299644 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07134db1-0579-4e27-bc50-32bed586ce61 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:13.314815 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6333b780-0c3f-41d7-a0d4-fe6e5befba1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:13.315200 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333b780-0c3f-41d7-a0d4-fe6e5befba1f admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:13.315313 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333b780-0c3f-41d7-a0d4-fe6e5befba1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:13.315589 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333b780-0c3f-41d7-a0d4-fe6e5befba1f admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:13.316261 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6333b780-0c3f-41d7-a0d4-fe6e5befba1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:13.316646 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6333b780-0c3f-41d7-a0d4-fe6e5befba1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:13.318626 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6333b780-0c3f-41d7-a0d4-fe6e5befba1f admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:13.348597 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d85f95-7c8b-43b8-a6d5-48be839c1433 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:13.349235 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d85f95-7c8b-43b8-a6d5-48be839c1433 service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:13.349520 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d85f95-7c8b-43b8-a6d5-48be839c1433 service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:13.349791 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d85f95-7c8b-43b8-a6d5-48be839c1433 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:13.354453 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 855/1691] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 15:56:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:13.355036 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-95d85f95-7c8b-43b8-a6d5-48be839c1433 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:13.355413 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6333b780-0c3f-41d7-a0d4-fe6e5befba1f admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:13.357144 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-6333b780-0c3f-41d7-a0d4-fe6e5befba1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:13.380345 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6333b780-0c3f-41d7-a0d4-fe6e5befba1f admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:13.394836 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f099b2e-e5a6-46e5-943e-845edb9373b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:13.395475 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f099b2e-e5a6-46e5-943e-845edb9373b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:13.395759 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f099b2e-e5a6-46e5-943e-845edb9373b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:13.396040 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f099b2e-e5a6-46e5-943e-845edb9373b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:13.396690 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f099b2e-e5a6-46e5-943e-845edb9373b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:13.399131 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f099b2e-e5a6-46e5-943e-845edb9373b6 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:13.470218 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 856/1692] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:56:13 2022] POST /identity/v3/projects => generated 367 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:13.471604 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf8738-74a7-4707-b0de-8c89ec6590a9 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:13.471896 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf8738-74a7-4707-b0de-8c89ec6590a9 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:13.472192 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf8738-74a7-4707-b0de-8c89ec6590a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:13.484882 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d85f95-7c8b-43b8-a6d5-48be839c1433 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:13.486570 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d85f95-7c8b-43b8-a6d5-48be839c1433 service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:13.512037 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 837/1693] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:13 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:13.513260 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d85f95-7c8b-43b8-a6d5-48be839c1433 service cinder] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:13.513760 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-02bf8738-74a7-4707-b0de-8c89ec6590a9 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:13.515103 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-02bf8738-74a7-4707-b0de-8c89ec6590a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:13.536272 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d85f95-7c8b-43b8-a6d5-48be839c1433 service cinder] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:13.574129 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:13.694930 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 857/1694] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:13.696046 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf8738-74a7-4707-b0de-8c89ec6590a9 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:13.730803 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf8738-74a7-4707-b0de-8c89ec6590a9 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:13.753752 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659f2f3-05d8-48e4-a6fe-74ea0070144c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:13.755004 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659f2f3-05d8-48e4-a6fe-74ea0070144c admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:13.756975 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659f2f3-05d8-48e4-a6fe-74ea0070144c admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:13.756975 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659f2f3-05d8-48e4-a6fe-74ea0070144c admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:13.757419 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9659f2f3-05d8-48e4-a6fe-74ea0070144c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:13.759698 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9659f2f3-05d8-48e4-a6fe-74ea0070144c admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:13.775972 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999674ad-51f8-4cfc-b7bf-62667598f1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:13.776881 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999674ad-51f8-4cfc-b7bf-62667598f1cb admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:13.777147 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999674ad-51f8-4cfc-b7bf-62667598f1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:13.777428 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999674ad-51f8-4cfc-b7bf-62667598f1cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:13.778105 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999674ad-51f8-4cfc-b7bf-62667598f1cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:13.780232 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999674ad-51f8-4cfc-b7bf-62667598f1cb admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:13.825359 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:13.845378 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 858/1695] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:56:13 2022] POST /identity/v3/users => generated 290 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:13.847325 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27d85e-607f-4488-ad23-b6c8de9950df None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:13.847460 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27d85e-607f-4488-ad23-b6c8de9950df None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:13.847737 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27d85e-607f-4488-ad23-b6c8de9950df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:13.875642 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 838/1696] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:56:13 2022] POST /identity/v3/projects => generated 369 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:13.876615 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999674ad-51f8-4cfc-b7bf-62667598f1cb admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:13.895280 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-7e27d85e-607f-4488-ad23-b6c8de9950df None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:13.896572 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-7e27d85e-607f-4488-ad23-b6c8de9950df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:14.044502 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999674ad-51f8-4cfc-b7bf-62667598f1cb admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:14.054593 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 859/1697] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:14.054890 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27d85e-607f-4488-ad23-b6c8de9950df None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:14.062749 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea4ca9-278c-4486-b9b3-fd18ab8425a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:14.063426 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea4ca9-278c-4486-b9b3-fd18ab8425a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:14.063748 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea4ca9-278c-4486-b9b3-fd18ab8425a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:14.064052 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea4ca9-278c-4486-b9b3-fd18ab8425a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:14.064737 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea4ca9-278c-4486-b9b3-fd18ab8425a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:14.066494 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea4ca9-278c-4486-b9b3-fd18ab8425a9 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:14.078532 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27d85e-607f-4488-ad23-b6c8de9950df None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:14.095663 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 839/1698] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:14.096417 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea4ca9-278c-4486-b9b3-fd18ab8425a9 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:14.097599 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7599f2-6854-4835-be34-c184fa6613d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:14.098274 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7599f2-6854-4835-be34-c184fa6613d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:14.098559 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7599f2-6854-4835-be34-c184fa6613d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:14.098838 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7599f2-6854-4835-be34-c184fa6613d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:14.099483 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7599f2-6854-4835-be34-c184fa6613d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:14.106932 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7599f2-6854-4835-be34-c184fa6613d0 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:14.108138 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea4ca9-278c-4486-b9b3-fd18ab8425a9 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:14.113210 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954bbf55-cf46-4e7a-900b-3514aae4a38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:14.113977 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bbf55-cf46-4e7a-900b-3514aae4a38c admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:14.114084 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bbf55-cf46-4e7a-900b-3514aae4a38c admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:14.114374 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bbf55-cf46-4e7a-900b-3514aae4a38c admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:14.115019 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954bbf55-cf46-4e7a-900b-3514aae4a38c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:14.115320 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954bbf55-cf46-4e7a-900b-3514aae4a38c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:14.116917 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954bbf55-cf46-4e7a-900b-3514aae4a38c admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:14.136571 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 840/1699] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 15:56:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:14.141682 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954bbf55-cf46-4e7a-900b-3514aae4a38c admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:14.155835 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954bbf55-cf46-4e7a-900b-3514aae4a38c admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:14.162092 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bafbea-9152-4f6e-9fb5-4d90fae19554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:14.162902 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bafbea-9152-4f6e-9fb5-4d90fae19554 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:14.163831 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bafbea-9152-4f6e-9fb5-4d90fae19554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:14.166234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bafbea-9152-4f6e-9fb5-4d90fae19554 admin admin] PATH_INFO: `/v3/projects/fcd26adccc6b48839441d62008b84c4f/users/37ce605ad07f4a9cbe774ea434dfdafa/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:14.168547 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 860/1700] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:56:14 2022] POST /identity/v3/users => generated 285 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:14.169347 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7599f2-6854-4835-be34-c184fa6613d0 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:14.187698 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7599f2-6854-4835-be34-c184fa6613d0 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:14.201000 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa29ff-9926-4aa9-b6db-d0246ce04f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:14.201635 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa29ff-9926-4aa9-b6db-d0246ce04f0a admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:14.201993 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa29ff-9926-4aa9-b6db-d0246ce04f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:14.202203 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa29ff-9926-4aa9-b6db-d0246ce04f0a admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:14.205359 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aa29ff-9926-4aa9-b6db-d0246ce04f0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:14.207340 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aa29ff-9926-4aa9-b6db-d0246ce04f0a admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:14.208355 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bafbea-9152-4f6e-9fb5-4d90fae19554 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcd26adccc6b48839441d62008b84c4f, user_id=37ce605ad07f4a9cbe774ea434dfdafa, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:14.213919 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bafbea-9152-4f6e-9fb5-4d90fae19554 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:14.240574 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 841/1701] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:14 2022] PUT /identity/v3/projects/fcd26adccc6b48839441d62008b84c4f/users/37ce605ad07f4a9cbe774ea434dfdafa/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:14.244519 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bafbea-9152-4f6e-9fb5-4d90fae19554 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:14.285419 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 861/1702] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:56:14 2022] POST /identity/v3/projects => generated 403 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:14.286767 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa29ff-9926-4aa9-b6db-d0246ce04f0a admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:14.404246 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa29ff-9926-4aa9-b6db-d0246ce04f0a admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:14.409751 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f09775-72ff-4213-8e9f-ae4cfd32be62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:14.410704 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f09775-72ff-4213-8e9f-ae4cfd32be62 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:14.411060 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f09775-72ff-4213-8e9f-ae4cfd32be62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:14.411409 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f09775-72ff-4213-8e9f-ae4cfd32be62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:14.412126 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:14.413472 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f09775-72ff-4213-8e9f-ae4cfd32be62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:14.415516 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f09775-72ff-4213-8e9f-ae4cfd32be62 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:14.423452 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bafbea-9152-4f6e-9fb5-4d90fae19554 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:14.436522 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 862/1703] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:14.438348 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f09775-72ff-4213-8e9f-ae4cfd32be62 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:14.439914 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1717eec9-a093-41e0-b6bb-36929379d61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:14.440620 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717eec9-a093-41e0-b6bb-36929379d61b admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:14.440970 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717eec9-a093-41e0-b6bb-36929379d61b admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:14.441309 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717eec9-a093-41e0-b6bb-36929379d61b admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:14.446927 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1717eec9-a093-41e0-b6bb-36929379d61b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:14.450954 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1717eec9-a093-41e0-b6bb-36929379d61b admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:14.454707 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f09775-72ff-4213-8e9f-ae4cfd32be62 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:14.461517 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba82805-69e1-495f-928f-dc210f81a2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:14.463509 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba82805-69e1-495f-928f-dc210f81a2a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:14.464013 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba82805-69e1-495f-928f-dc210f81a2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:14.464571 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba82805-69e1-495f-928f-dc210f81a2a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:14.465493 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba82805-69e1-495f-928f-dc210f81a2a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:14.468866 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba82805-69e1-495f-928f-dc210f81a2a2 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:14.490035 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 842/1704] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:14.490916 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1717eec9-a093-41e0-b6bb-36929379d61b admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:14.492827 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-1717eec9-a093-41e0-b6bb-36929379d61b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:14.506641 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 863/1705] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:56:14 2022] POST /identity/v3/users => generated 302 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:14.513252 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba82805-69e1-495f-928f-dc210f81a2a2 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:14.521065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1717eec9-a093-41e0-b6bb-36929379d61b admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:14.540402 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32c198-1b1b-43b3-a6ff-c0e1d2ee207f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:14.541315 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32c198-1b1b-43b3-a6ff-c0e1d2ee207f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:14.541712 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32c198-1b1b-43b3-a6ff-c0e1d2ee207f admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:14.542301 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32c198-1b1b-43b3-a6ff-c0e1d2ee207f admin admin] PATH_INFO: `/v3/users/c0826425c2bd48c2b2408e95688ef0e5` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:14.543798 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a32c198-1b1b-43b3-a6ff-c0e1d2ee207f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0826425c2bd48c2b2408e95688ef0e5)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:14.545853 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a32c198-1b1b-43b3-a6ff-c0e1d2ee207f admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:14.548924 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba82805-69e1-495f-928f-dc210f81a2a2 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:14.563365 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb0b690-7f97-47a6-b540-c536bcca7e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:14.567328 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0b690-7f97-47a6-b540-c536bcca7e2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:14.567666 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0b690-7f97-47a6-b540-c536bcca7e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:14.568014 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0b690-7f97-47a6-b540-c536bcca7e2d admin admin] PATH_INFO: `/v3/projects/fcd26adccc6b48839441d62008b84c4f/users/37ce605ad07f4a9cbe774ea434dfdafa/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:14.574792 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb0b690-7f97-47a6-b540-c536bcca7e2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcd26adccc6b48839441d62008b84c4f, user_id=37ce605ad07f4a9cbe774ea434dfdafa, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:14.580257 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb0b690-7f97-47a6-b540-c536bcca7e2d admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:14.626264 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 864/1706] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:14 2022] PUT /identity/v3/projects/fcd26adccc6b48839441d62008b84c4f/users/37ce605ad07f4a9cbe774ea434dfdafa/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:14.628791 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb0b690-7f97-47a6-b540-c536bcca7e2d admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:14.670284 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-0a32c198-1b1b-43b3-a6ff-c0e1d2ee207f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0826425c2bd48c2b2408e95688ef0e5'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:14.684853 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-0a32c198-1b1b-43b3-a6ff-c0e1d2ee207f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0826425c2bd48c2b2408e95688ef0e5'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:14.685984 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-0a32c198-1b1b-43b3-a6ff-c0e1d2ee207f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0826425c2bd48c2b2408e95688ef0e5'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:14.706530 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:14.708860 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-0a32c198-1b1b-43b3-a6ff-c0e1d2ee207f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0826425c2bd48c2b2408e95688ef0e5'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:14.709764 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-0a32c198-1b1b-43b3-a6ff-c0e1d2ee207f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0826425c2bd48c2b2408e95688ef0e5'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:14.757089 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 843/1707] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:56:14 2022] DELETE /identity/v3/users/c0826425c2bd48c2b2408e95688ef0e5 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:14.761838 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32c198-1b1b-43b3-a6ff-c0e1d2ee207f admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:14.766986 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-0a32c198-1b1b-43b3-a6ff-c0e1d2ee207f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:14.782350 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb0b690-7f97-47a6-b540-c536bcca7e2d admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:14.878340 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32c198-1b1b-43b3-a6ff-c0e1d2ee207f admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:14.883834 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee7ce1-cd04-4e18-825f-27421ef21900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:14.885491 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee7ce1-cd04-4e18-825f-27421ef21900 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:14.886005 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee7ce1-cd04-4e18-825f-27421ef21900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:14.886412 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee7ce1-cd04-4e18-825f-27421ef21900 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:14.887170 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ee7ce1-cd04-4e18-825f-27421ef21900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:14.889029 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ee7ce1-cd04-4e18-825f-27421ef21900 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:14.902369 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 844/1708] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:14.903876 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383e7bb-2a41-4d52-9d49-4b7bf6f78cc9 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:14.904269 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383e7bb-2a41-4d52-9d49-4b7bf6f78cc9 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:14.905164 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383e7bb-2a41-4d52-9d49-4b7bf6f78cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:14.919281 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d393e61-9e84-40b2-a93f-786ccc1c8ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:14.921036 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d393e61-9e84-40b2-a93f-786ccc1c8ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:14.922772 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d393e61-9e84-40b2-a93f-786ccc1c8ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:14.923252 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d393e61-9e84-40b2-a93f-786ccc1c8ea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:14.924303 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d393e61-9e84-40b2-a93f-786ccc1c8ea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:14.929287 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d393e61-9e84-40b2-a93f-786ccc1c8ea5 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:14.965705 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 865/1709] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:14.968893 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-b383e7bb-2a41-4d52-9d49-4b7bf6f78cc9 None None] MFA Rules not processed for user `37ce605ad07f4a9cbe774ea434dfdafa`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:14.970217 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b383e7bb-2a41-4d52-9d49-4b7bf6f78cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:14.970615 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69967de-385a-460f-803f-3bf81d687b85 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:14.971226 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69967de-385a-460f-803f-3bf81d687b85 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:14.971696 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69967de-385a-460f-803f-3bf81d687b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:15.034799 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-a69967de-385a-460f-803f-3bf81d687b85 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:15.044234 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-a69967de-385a-460f-803f-3bf81d687b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:15.064073 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 866/1710] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:15.065118 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69967de-385a-460f-803f-3bf81d687b85 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:15.092040 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69967de-385a-460f-803f-3bf81d687b85 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:15.099844 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:15.106969 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e403907-e3ef-434b-979e-9e9fa3033592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:15.110046 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e403907-e3ef-434b-979e-9e9fa3033592 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:15.110574 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e403907-e3ef-434b-979e-9e9fa3033592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:15.112884 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e403907-e3ef-434b-979e-9e9fa3033592 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:15.114668 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e403907-e3ef-434b-979e-9e9fa3033592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:15.120032 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e403907-e3ef-434b-979e-9e9fa3033592 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:15.151743 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 867/1711] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:15.154112 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e403907-e3ef-434b-979e-9e9fa3033592 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:15.158210 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 845/1712] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:14 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:15.158210 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383e7bb-2a41-4d52-9d49-4b7bf6f78cc9 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:15.158457 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-8e403907-e3ef-434b-979e-9e9fa3033592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:15.185006 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383e7bb-2a41-4d52-9d49-4b7bf6f78cc9 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:15.192911 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598457d5-5abe-4ec5-afbe-fff64b7b8648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:15.193747 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598457d5-5abe-4ec5-afbe-fff64b7b8648 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:15.194895 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598457d5-5abe-4ec5-afbe-fff64b7b8648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:15.194895 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598457d5-5abe-4ec5-afbe-fff64b7b8648 admin admin] PATH_INFO: `/v3/projects/12919490d5c2430a8642bc38efc731a5/users/beff7acf048b4cfba2d872853d973a93/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:15.206250 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e403907-e3ef-434b-979e-9e9fa3033592 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:15.223340 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f47d0c-3666-40a1-81b0-604f378af337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:15.227450 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f47d0c-3666-40a1-81b0-604f378af337 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:15.227777 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f47d0c-3666-40a1-81b0-604f378af337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:15.231767 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f47d0c-3666-40a1-81b0-604f378af337 admin admin] PATH_INFO: `/v3/projects/108fd0267b46498ca13a12766aa9e973/users/6fa23550b44b4618ac90dd0b2fae03bb/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:15.236941 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598457d5-5abe-4ec5-afbe-fff64b7b8648 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12919490d5c2430a8642bc38efc731a5, user_id=beff7acf048b4cfba2d872853d973a93, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:15.240512 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598457d5-5abe-4ec5-afbe-fff64b7b8648 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:15.262738 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 846/1713] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:15 2022] PUT /identity/v3/projects/12919490d5c2430a8642bc38efc731a5/users/beff7acf048b4cfba2d872853d973a93/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:15.264423 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598457d5-5abe-4ec5-afbe-fff64b7b8648 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:15.266781 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-598457d5-5abe-4ec5-afbe-fff64b7b8648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:15.295602 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f47d0c-3666-40a1-81b0-604f378af337 admin admin] RBAC: Authorizing `identity:create_grant(project_id=108fd0267b46498ca13a12766aa9e973, user_id=6fa23550b44b4618ac90dd0b2fae03bb, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:15.298109 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f47d0c-3666-40a1-81b0-604f378af337 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:15.325748 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 868/1714] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:15 2022] PUT /identity/v3/projects/108fd0267b46498ca13a12766aa9e973/users/6fa23550b44b4618ac90dd0b2fae03bb/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:15.327714 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f47d0c-3666-40a1-81b0-604f378af337 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:15.331297 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-00f47d0c-3666-40a1-81b0-604f378af337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:15.363879 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598457d5-5abe-4ec5-afbe-fff64b7b8648 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:15.490765 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f47d0c-3666-40a1-81b0-604f378af337 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:15.502131 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c9ff84-617a-4b8c-a3ab-c9b356e4d403 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:15.503376 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9ff84-617a-4b8c-a3ab-c9b356e4d403 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:15.503637 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9ff84-617a-4b8c-a3ab-c9b356e4d403 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:15.503922 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9ff84-617a-4b8c-a3ab-c9b356e4d403 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:15.512770 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a34a3-a38c-4e0a-8ff4-bbc282cb8f4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:15.513848 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a34a3-a38c-4e0a-8ff4-bbc282cb8f4f service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:15.513848 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a34a3-a38c-4e0a-8ff4-bbc282cb8f4f service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:15.514121 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a34a3-a38c-4e0a-8ff4-bbc282cb8f4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:15.602846 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:15.655952 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c9ff84-617a-4b8c-a3ab-c9b356e4d403 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:15.657693 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c9ff84-617a-4b8c-a3ab-c9b356e4d403 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:15.684067 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a34a3-a38c-4e0a-8ff4-bbc282cb8f4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:15.685542 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a34a3-a38c-4e0a-8ff4-bbc282cb8f4f service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:15.698459 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 869/1715] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:15.702761 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bb530-22ed-4d8a-bea6-21c163547dc9 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:15.703050 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bb530-22ed-4d8a-bea6-21c163547dc9 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:15.703328 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bb530-22ed-4d8a-bea6-21c163547dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:15.724850 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 847/1716] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:15 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:15.726372 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f65f1-81fb-4ef2-a0e7-2bac9ab64c7e None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:15.726660 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f65f1-81fb-4ef2-a0e7-2bac9ab64c7e None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:15.726939 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f65f1-81fb-4ef2-a0e7-2bac9ab64c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:15.819026 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-b91bb530-22ed-4d8a-bea6-21c163547dc9 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:15.820331 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-b91bb530-22ed-4d8a-bea6-21c163547dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:15.827680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-b29f65f1-81fb-4ef2-a0e7-2bac9ab64c7e None None] MFA Rules not processed for user `6fa23550b44b4618ac90dd0b2fae03bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:15.829030 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b29f65f1-81fb-4ef2-a0e7-2bac9ab64c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:15.867784 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 870/1717] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:15.877841 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:16.020360 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 848/1718] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:16.026575 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91bb530-22ed-4d8a-bea6-21c163547dc9 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:16.051505 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91bb530-22ed-4d8a-bea6-21c163547dc9 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:16.080475 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a35921a-b234-4219-96de-d48d6c8d7ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:16.081163 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35921a-b234-4219-96de-d48d6c8d7ae0 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:16.081450 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35921a-b234-4219-96de-d48d6c8d7ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:16.081760 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35921a-b234-4219-96de-d48d6c8d7ae0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:16.082458 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a35921a-b234-4219-96de-d48d6c8d7ae0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:16.084730 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a35921a-b234-4219-96de-d48d6c8d7ae0 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:16.112350 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f65f1-81fb-4ef2-a0e7-2bac9ab64c7e None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:16.115009 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b29f65f1-81fb-4ef2-a0e7-2bac9ab64c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:16.153128 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f65f1-81fb-4ef2-a0e7-2bac9ab64c7e None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:16.164789 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05801473-475d-4e9f-b071-3a2418963c91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:16.167914 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05801473-475d-4e9f-b071-3a2418963c91 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:16.169743 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05801473-475d-4e9f-b071-3a2418963c91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:16.170040 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05801473-475d-4e9f-b071-3a2418963c91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:16.191332 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 871/1719] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:56:16 2022] POST /identity/v3/projects => generated 369 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:16.196346 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a35921a-b234-4219-96de-d48d6c8d7ae0 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:16.202542 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-7a35921a-b234-4219-96de-d48d6c8d7ae0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:16.207975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05801473-475d-4e9f-b071-3a2418963c91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:16.209464 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05801473-475d-4e9f-b071-3a2418963c91 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:16.253672 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 849/1720] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 15:56:16.254612 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05801473-475d-4e9f-b071-3a2418963c91 service neutron] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:16.281947 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05801473-475d-4e9f-b071-3a2418963c91 service neutron] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:16.422689 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a35921a-b234-4219-96de-d48d6c8d7ae0 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:16.429416 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca31e34-0f62-4e57-a2a5-a06492874bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:16.430714 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca31e34-0f62-4e57-a2a5-a06492874bf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:16.432302 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca31e34-0f62-4e57-a2a5-a06492874bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:16.432560 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca31e34-0f62-4e57-a2a5-a06492874bf0 admin admin] PATH_INFO: `/v3/users/d86ab83462f0429794ad9b2f571e879b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:16.433983 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca31e34-0f62-4e57-a2a5-a06492874bf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d86ab83462f0429794ad9b2f571e879b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:16.443588 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca31e34-0f62-4e57-a2a5-a06492874bf0 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:16.444887 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb67ae-ed3b-433c-9deb-d8acf2b661ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:16.445521 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb67ae-ed3b-433c-9deb-d8acf2b661ce admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:16.445800 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb67ae-ed3b-433c-9deb-d8acf2b661ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:16.446075 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb67ae-ed3b-433c-9deb-d8acf2b661ce admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:16.446843 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bb67ae-ed3b-433c-9deb-d8acf2b661ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:16.449451 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bb67ae-ed3b-433c-9deb-d8acf2b661ce admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:16.499344 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 850/1721] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:56:16 2022] POST /identity/v3/users => generated 291 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:16.502432 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb67ae-ed3b-433c-9deb-d8acf2b661ce admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:16.529112 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb67ae-ed3b-433c-9deb-d8acf2b661ce admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:16.545903 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaaa433-e349-4945-ba68-2727214d00be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:16.546577 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaaa433-e349-4945-ba68-2727214d00be admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:16.546857 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaaa433-e349-4945-ba68-2727214d00be admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:16.547339 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaaa433-e349-4945-ba68-2727214d00be admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:16.550447 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaaa433-e349-4945-ba68-2727214d00be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:16.559849 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaaa433-e349-4945-ba68-2727214d00be admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:16.591044 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 851/1722] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:16.599135 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaaa433-e349-4945-ba68-2727214d00be admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:16.602232 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2ca31e34-0f62-4e57-a2a5-a06492874bf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd86ab83462f0429794ad9b2f571e879b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:16.637495 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2ca31e34-0f62-4e57-a2a5-a06492874bf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd86ab83462f0429794ad9b2f571e879b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:16.641160 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2ca31e34-0f62-4e57-a2a5-a06492874bf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd86ab83462f0429794ad9b2f571e879b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:16.650444 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaaa433-e349-4945-ba68-2727214d00be admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:16.674510 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a98199-62b3-4f7d-b872-893c375c3b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:16.676264 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a98199-62b3-4f7d-b872-893c375c3b13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:16.677210 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a98199-62b3-4f7d-b872-893c375c3b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:16.677503 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a98199-62b3-4f7d-b872-893c375c3b13 admin admin] PATH_INFO: `/v3/projects/1129c7b8c3d0414da3880decc5258301/users/f762573928fb40b9a63c143aecd33225/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:16.698610 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2ca31e34-0f62-4e57-a2a5-a06492874bf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd86ab83462f0429794ad9b2f571e879b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:16.699505 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2ca31e34-0f62-4e57-a2a5-a06492874bf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd86ab83462f0429794ad9b2f571e879b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:16.741163 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a98199-62b3-4f7d-b872-893c375c3b13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1129c7b8c3d0414da3880decc5258301, user_id=f762573928fb40b9a63c143aecd33225, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:16.744881 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a98199-62b3-4f7d-b872-893c375c3b13 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:16.755487 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 872/1723] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:56:16 2022] DELETE /identity/v3/users/d86ab83462f0429794ad9b2f571e879b => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:16.767542 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64224931-0fd0-4fdf-a7b4-abc97eb037a3 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:16.767916 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64224931-0fd0-4fdf-a7b4-abc97eb037a3 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:16.771041 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64224931-0fd0-4fdf-a7b4-abc97eb037a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:16.788711 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 852/1724] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:16 2022] PUT /identity/v3/projects/1129c7b8c3d0414da3880decc5258301/users/f762573928fb40b9a63c143aecd33225/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:16.801809 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05698675-c0d3-46a5-8410-10489d517209 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:16.809124 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05698675-c0d3-46a5-8410-10489d517209 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:16.809556 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05698675-c0d3-46a5-8410-10489d517209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:16.880976 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-05698675-c0d3-46a5-8410-10489d517209 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:16.882700 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-05698675-c0d3-46a5-8410-10489d517209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:16.945652 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-64224931-0fd0-4fdf-a7b4-abc97eb037a3 None None] MFA Rules not processed for user `1eec1d820efc467a8e5856e6302a1885`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:16.955111 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-64224931-0fd0-4fdf-a7b4-abc97eb037a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:17.002218 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:17.029972 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:17.049938 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 853/1725] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:17.051114 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05698675-c0d3-46a5-8410-10489d517209 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:17.076106 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-05698675-c0d3-46a5-8410-10489d517209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:17.101864 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05698675-c0d3-46a5-8410-10489d517209 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:17.118068 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e77dcf-2708-4d3a-a745-67131fcd8811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:17.118821 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e77dcf-2708-4d3a-a745-67131fcd8811 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:17.119110 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e77dcf-2708-4d3a-a745-67131fcd8811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:17.119390 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e77dcf-2708-4d3a-a745-67131fcd8811 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:17.120056 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e77dcf-2708-4d3a-a745-67131fcd8811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:17.121756 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e77dcf-2708-4d3a-a745-67131fcd8811 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:17.154539 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 854/1726] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:17.155769 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e77dcf-2708-4d3a-a745-67131fcd8811 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:17.179388 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-66e77dcf-2708-4d3a-a745-67131fcd8811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:17.198277 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 873/1727] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 442 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:17.199529 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64224931-0fd0-4fdf-a7b4-abc97eb037a3 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:17.203066 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-64224931-0fd0-4fdf-a7b4-abc97eb037a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:17.207907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e77dcf-2708-4d3a-a745-67131fcd8811 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:17.236252 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a5915-e8ad-4f1b-89bb-c54a4824cdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:17.237036 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a5915-e8ad-4f1b-89bb-c54a4824cdc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:17.237321 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a5915-e8ad-4f1b-89bb-c54a4824cdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:17.237598 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a5915-e8ad-4f1b-89bb-c54a4824cdc6 admin admin] PATH_INFO: `/v3/projects/1e8cbbbc9bce4153956d6d5f64726a91` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:17.241179 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a5915-e8ad-4f1b-89bb-c54a4824cdc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e8cbbbc9bce4153956d6d5f64726a91)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:17.244753 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a5915-e8ad-4f1b-89bb-c54a4824cdc6 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:17.407277 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64224931-0fd0-4fdf-a7b4-abc97eb037a3 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:17.445719 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-152a5915-e8ad-4f1b-89bb-c54a4824cdc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e8cbbbc9bce4153956d6d5f64726a91', 'request_id': 'req-152a5915-e8ad-4f1b-89bb-c54a4824cdc6'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:17.452815 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-152a5915-e8ad-4f1b-89bb-c54a4824cdc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e8cbbbc9bce4153956d6d5f64726a91', 'request_id': 'req-152a5915-e8ad-4f1b-89bb-c54a4824cdc6'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:17.462639 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-152a5915-e8ad-4f1b-89bb-c54a4824cdc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e8cbbbc9bce4153956d6d5f64726a91', 'request_id': 'req-152a5915-e8ad-4f1b-89bb-c54a4824cdc6'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:17.501626 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-152a5915-e8ad-4f1b-89bb-c54a4824cdc6 admin admin] The token cache is being invalidate because project 1e8cbbbc9bce4153956d6d5f64726a91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:56:17.505823 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-152a5915-e8ad-4f1b-89bb-c54a4824cdc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:17.508844 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-152a5915-e8ad-4f1b-89bb-c54a4824cdc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:17.514464 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 855/1728] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:56:17 2022] DELETE /identity/v3/projects/1e8cbbbc9bce4153956d6d5f64726a91 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:17.523247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a5915-e8ad-4f1b-89bb-c54a4824cdc6 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:17.526346 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-152a5915-e8ad-4f1b-89bb-c54a4824cdc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:17.626673 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e87a6-8ae4-4796-861c-4be79dccfc93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:17.627833 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e87a6-8ae4-4796-861c-4be79dccfc93 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:17.628420 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e87a6-8ae4-4796-861c-4be79dccfc93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:17.629211 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e87a6-8ae4-4796-861c-4be79dccfc93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:17.636552 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-673e87a6-8ae4-4796-861c-4be79dccfc93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:17.776991 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a5915-e8ad-4f1b-89bb-c54a4824cdc6 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:17.788510 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7925cb8d-f640-4831-b799-828913286241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:17.789298 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925cb8d-f640-4831-b799-828913286241 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:17.789579 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925cb8d-f640-4831-b799-828913286241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:17.789876 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925cb8d-f640-4831-b799-828913286241 admin admin] PATH_INFO: `/v3/projects/1129c7b8c3d0414da3880decc5258301/users/f762573928fb40b9a63c143aecd33225/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:17.800011 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7925cb8d-f640-4831-b799-828913286241 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1129c7b8c3d0414da3880decc5258301, user_id=f762573928fb40b9a63c143aecd33225, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:17.802820 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7925cb8d-f640-4831-b799-828913286241 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:17.811256 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673e87a6-8ae4-4796-861c-4be79dccfc93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:17.814365 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673e87a6-8ae4-4796-861c-4be79dccfc93 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:17.830229 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 856/1729] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:17 2022] PUT /identity/v3/projects/1129c7b8c3d0414da3880decc5258301/users/f762573928fb40b9a63c143aecd33225/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:17.830229 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7925cb8d-f640-4831-b799-828913286241 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:17.832449 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-7925cb8d-f640-4831-b799-828913286241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:17.834161 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 874/1730] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 635 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:17.835284 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e87a6-8ae4-4796-861c-4be79dccfc93 service neutron] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:17.837083 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-673e87a6-8ae4-4796-861c-4be79dccfc93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:17.866723 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e87a6-8ae4-4796-861c-4be79dccfc93 service neutron] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:17.900214 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:18.019650 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:18.033863 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa0a6e-f246-42ea-9169-a9f03c9b0660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:18.035276 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa0a6e-f246-42ea-9169-a9f03c9b0660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:18.035662 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa0a6e-f246-42ea-9169-a9f03c9b0660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:18.036048 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa0a6e-f246-42ea-9169-a9f03c9b0660 admin admin] PATH_INFO: `/v3/users/b16296f04b8a43829c3ff882dfd0b8c2` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:18.037710 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa0a6e-f246-42ea-9169-a9f03c9b0660 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b16296f04b8a43829c3ff882dfd0b8c2)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:18.039420 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7925cb8d-f640-4831-b799-828913286241 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:18.043400 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa0a6e-f246-42ea-9169-a9f03c9b0660 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:18.104309 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff277a1-0674-41ac-9936-980474368a77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:18.105422 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff277a1-0674-41ac-9936-980474368a77 service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:18.107584 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff277a1-0674-41ac-9936-980474368a77 service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:18.110364 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff277a1-0674-41ac-9936-980474368a77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:18.120222 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-0ff277a1-0674-41ac-9936-980474368a77 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:18.187488 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-efaa0a6e-f246-42ea-9169-a9f03c9b0660 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b16296f04b8a43829c3ff882dfd0b8c2'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:18.206600 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-efaa0a6e-f246-42ea-9169-a9f03c9b0660 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b16296f04b8a43829c3ff882dfd0b8c2'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:18.207380 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-efaa0a6e-f246-42ea-9169-a9f03c9b0660 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b16296f04b8a43829c3ff882dfd0b8c2'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:18.236609 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-efaa0a6e-f246-42ea-9169-a9f03c9b0660 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b16296f04b8a43829c3ff882dfd0b8c2'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:18.237737 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-efaa0a6e-f246-42ea-9169-a9f03c9b0660 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b16296f04b8a43829c3ff882dfd0b8c2'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:18.255672 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff277a1-0674-41ac-9936-980474368a77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:18.257393 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff277a1-0674-41ac-9936-980474368a77 service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:18.263775 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 875/1731] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:56:17 2022] DELETE /identity/v3/users/b16296f04b8a43829c3ff882dfd0b8c2 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:18.266056 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26343908-6e6c-4c70-b178-3dde0186e521 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:18.267415 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26343908-6e6c-4c70-b178-3dde0186e521 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:18.267867 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26343908-6e6c-4c70-b178-3dde0186e521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:18.269291 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 857/1732] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:18.411292 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-26343908-6e6c-4c70-b178-3dde0186e521 None None] MFA Rules not processed for user `f762573928fb40b9a63c143aecd33225`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:18.415061 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-26343908-6e6c-4c70-b178-3dde0186e521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:18.722859 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 876/1733] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:18 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:18.735833 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff277a1-0674-41ac-9936-980474368a77 service nova] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:18.740254 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-0ff277a1-0674-41ac-9936-980474368a77 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:18.958581 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff277a1-0674-41ac-9936-980474368a77 service nova] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:19.115195 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae5237-f54f-405e-a2ef-68665d22bd48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:19.117724 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae5237-f54f-405e-a2ef-68665d22bd48 service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:19.118085 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae5237-f54f-405e-a2ef-68665d22bd48 service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:19.119473 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae5237-f54f-405e-a2ef-68665d22bd48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:19.144832 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae5237-f54f-405e-a2ef-68665d22bd48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:19.146388 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae5237-f54f-405e-a2ef-68665d22bd48 service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:19.187191 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 858/1734] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:18 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:19.300964 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26343908-6e6c-4c70-b178-3dde0186e521 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:19.302682 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-26343908-6e6c-4c70-b178-3dde0186e521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:19.351885 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26343908-6e6c-4c70-b178-3dde0186e521 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:19.363648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc9c0c-cc00-49ca-84bc-a0179ffc3504 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:19.365090 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc9c0c-cc00-49ca-84bc-a0179ffc3504 service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:19.365415 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc9c0c-cc00-49ca-84bc-a0179ffc3504 service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:19.365699 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc9c0c-cc00-49ca-84bc-a0179ffc3504 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:19.370985 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-13fc9c0c-cc00-49ca-84bc-a0179ffc3504 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:19.436216 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:19.507681 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae5237-f54f-405e-a2ef-68665d22bd48 service cinder] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:19.509861 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-8bae5237-f54f-405e-a2ef-68665d22bd48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:19.554477 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc9c0c-cc00-49ca-84bc-a0179ffc3504 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:19.564952 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc9c0c-cc00-49ca-84bc-a0179ffc3504 service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:19.604478 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 877/1735] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:19 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:19.640141 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc9c0c-cc00-49ca-84bc-a0179ffc3504 service cinder] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:19.642160 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-13fc9c0c-cc00-49ca-84bc-a0179ffc3504 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:19.741764 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae5237-f54f-405e-a2ef-68665d22bd48 service cinder] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:19.761543 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a6eb3-98ce-4f72-93a4-97a099d49d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:19.762251 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a6eb3-98ce-4f72-93a4-97a099d49d16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:19.764502 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a6eb3-98ce-4f72-93a4-97a099d49d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:19.765558 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a6eb3-98ce-4f72-93a4-97a099d49d16 admin admin] PATH_INFO: `/v3/users/5ba021e12eca402289ded11cee40429f` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:19.770325 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a6eb3-98ce-4f72-93a4-97a099d49d16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ba021e12eca402289ded11cee40429f)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:19.776415 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a6eb3-98ce-4f72-93a4-97a099d49d16 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:19.784214 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:19.864994 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc9c0c-cc00-49ca-84bc-a0179ffc3504 service cinder] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:19.881398 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad2c8f-5c92-4c97-8f71-89ca42a3d13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:19.882089 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad2c8f-5c92-4c97-8f71-89ca42a3d13b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:19.882370 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad2c8f-5c92-4c97-8f71-89ca42a3d13b admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:19.882646 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad2c8f-5c92-4c97-8f71-89ca42a3d13b admin admin] PATH_INFO: `/v3/projects/e269f0a3936a43e989d734cab743f9f8` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:19.884989 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-e86a6eb3-98ce-4f72-93a4-97a099d49d16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ba021e12eca402289ded11cee40429f'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:19.893039 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad2c8f-5c92-4c97-8f71-89ca42a3d13b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e269f0a3936a43e989d734cab743f9f8)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:19.896061 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-e86a6eb3-98ce-4f72-93a4-97a099d49d16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ba021e12eca402289ded11cee40429f'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:19.897202 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-e86a6eb3-98ce-4f72-93a4-97a099d49d16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ba021e12eca402289ded11cee40429f'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:19.906747 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad2c8f-5c92-4c97-8f71-89ca42a3d13b admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:19.917754 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-e86a6eb3-98ce-4f72-93a4-97a099d49d16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ba021e12eca402289ded11cee40429f'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:19.920645 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-e86a6eb3-98ce-4f72-93a4-97a099d49d16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ba021e12eca402289ded11cee40429f'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:19.980320 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 859/1736] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:56:19 2022] DELETE /identity/v3/users/5ba021e12eca402289ded11cee40429f => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:19.990301 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898b131-20d0-492d-af67-c8ef4682143c None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:19.990599 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898b131-20d0-492d-af67-c8ef4682143c None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:19.990903 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898b131-20d0-492d-af67-c8ef4682143c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:20.068982 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-3898b131-20d0-492d-af67-c8ef4682143c None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:20.082434 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-3898b131-20d0-492d-af67-c8ef4682143c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:20.093289 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-e5ad2c8f-5c92-4c97-8f71-89ca42a3d13b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e269f0a3936a43e989d734cab743f9f8', 'request_id': 'req-e5ad2c8f-5c92-4c97-8f71-89ca42a3d13b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:20.111311 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-e5ad2c8f-5c92-4c97-8f71-89ca42a3d13b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e269f0a3936a43e989d734cab743f9f8', 'request_id': 'req-e5ad2c8f-5c92-4c97-8f71-89ca42a3d13b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:20.129070 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-e5ad2c8f-5c92-4c97-8f71-89ca42a3d13b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e269f0a3936a43e989d734cab743f9f8', 'request_id': 'req-e5ad2c8f-5c92-4c97-8f71-89ca42a3d13b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:20.166054 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-e5ad2c8f-5c92-4c97-8f71-89ca42a3d13b admin admin] The token cache is being invalidate because project e269f0a3936a43e989d734cab743f9f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:56:20.167531 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-e5ad2c8f-5c92-4c97-8f71-89ca42a3d13b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:20.170321 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-e5ad2c8f-5c92-4c97-8f71-89ca42a3d13b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:20.174229 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 878/1737] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:56:19 2022] DELETE /identity/v3/projects/e269f0a3936a43e989d734cab743f9f8 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:20.175898 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181a321-274d-4f38-9b58-2ca89c094930 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:20.177732 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181a321-274d-4f38-9b58-2ca89c094930 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:20.179488 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181a321-274d-4f38-9b58-2ca89c094930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:20.257285 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 860/1738] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:20.259987 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad3d76-26d8-4b7a-8558-ef2e5f894732 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:20.260514 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad3d76-26d8-4b7a-8558-ef2e5f894732 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:20.261116 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad3d76-26d8-4b7a-8558-ef2e5f894732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:20.271280 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-7181a321-274d-4f38-9b58-2ca89c094930 None None] MFA Rules not processed for user `20ee77db82594e6da5fe36d155120edd`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:20.271806 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-7181a321-274d-4f38-9b58-2ca89c094930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:20.297526 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-b0ad3d76-26d8-4b7a-8558-ef2e5f894732 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:20.299202 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b0ad3d76-26d8-4b7a-8558-ef2e5f894732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:20.334164 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 861/1739] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:20.335204 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad3d76-26d8-4b7a-8558-ef2e5f894732 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:20.341256 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b0ad3d76-26d8-4b7a-8558-ef2e5f894732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:20.372706 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad3d76-26d8-4b7a-8558-ef2e5f894732 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:20.380912 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2f552-516a-488a-8100-c1eac12e074b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:20.383157 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2f552-516a-488a-8100-c1eac12e074b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:20.383520 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2f552-516a-488a-8100-c1eac12e074b admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:20.386549 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2f552-516a-488a-8100-c1eac12e074b admin admin] PATH_INFO: `/v3/projects/efb80e7c401c423aa54ea1bdc990558a` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:20.388572 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c2f552-516a-488a-8100-c1eac12e074b admin admin] RBAC: Authorizing `identity:delete_project(project_id=efb80e7c401c423aa54ea1bdc990558a)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:20.389381 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:20.391274 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c2f552-516a-488a-8100-c1eac12e074b admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:20.423385 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 879/1740] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:20.424467 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181a321-274d-4f38-9b58-2ca89c094930 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:20.425830 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-7181a321-274d-4f38-9b58-2ca89c094930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:20.528993 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-30c2f552-516a-488a-8100-c1eac12e074b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efb80e7c401c423aa54ea1bdc990558a', 'request_id': 'req-30c2f552-516a-488a-8100-c1eac12e074b'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:20.538396 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181a321-274d-4f38-9b58-2ca89c094930 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:20.543302 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-30c2f552-516a-488a-8100-c1eac12e074b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efb80e7c401c423aa54ea1bdc990558a', 'request_id': 'req-30c2f552-516a-488a-8100-c1eac12e074b'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:20.562028 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-30c2f552-516a-488a-8100-c1eac12e074b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efb80e7c401c423aa54ea1bdc990558a', 'request_id': 'req-30c2f552-516a-488a-8100-c1eac12e074b'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:20.589474 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:20.596027 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-30c2f552-516a-488a-8100-c1eac12e074b admin admin] The token cache is being invalidate because project efb80e7c401c423aa54ea1bdc990558a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:56:20.597163 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-30c2f552-516a-488a-8100-c1eac12e074b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:20.601113 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-30c2f552-516a-488a-8100-c1eac12e074b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:20.604729 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 862/1741] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:56:20 2022] DELETE /identity/v3/projects/efb80e7c401c423aa54ea1bdc990558a => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:20.606525 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a2290-6167-4025-852d-4c32402ca3fd None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:20.607034 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a2290-6167-4025-852d-4c32402ca3fd None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:20.608088 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a2290-6167-4025-852d-4c32402ca3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:20.642986 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8b91f-7677-4358-9cc5-a265148e8cb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:20.643711 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8b91f-7677-4358-9cc5-a265148e8cb6 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:20.644097 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8b91f-7677-4358-9cc5-a265148e8cb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:20.644691 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8b91f-7677-4358-9cc5-a265148e8cb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:20.647756 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-45a8b91f-7677-4358-9cc5-a265148e8cb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:20.653302 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-833a2290-6167-4025-852d-4c32402ca3fd None None] MFA Rules not processed for user `d7738e76f24f48d4a66a9237ddbc939e`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:20.656142 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-833a2290-6167-4025-852d-4c32402ca3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:20.732056 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a8b91f-7677-4358-9cc5-a265148e8cb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:20.734401 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a8b91f-7677-4358-9cc5-a265148e8cb6 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:20.747179 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 880/1742] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:20.748543 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd70f0-86fd-4932-92f2-87dbae9f6cad None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:20.748827 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd70f0-86fd-4932-92f2-87dbae9f6cad None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:20.749221 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd70f0-86fd-4932-92f2-87dbae9f6cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:20.774977 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-74bd70f0-86fd-4932-92f2-87dbae9f6cad None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:20.776275 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-74bd70f0-86fd-4932-92f2-87dbae9f6cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:20.788824 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 881/1743] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:20.793908 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22e7cd-1339-463b-b163-aa393ad2b545 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:20.793908 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22e7cd-1339-463b-b163-aa393ad2b545 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:20.793908 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22e7cd-1339-463b-b163-aa393ad2b545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:20.827414 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-ae22e7cd-1339-463b-b163-aa393ad2b545 None None] MFA Rules not processed for user `beff7acf048b4cfba2d872853d973a93`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:20.828990 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-ae22e7cd-1339-463b-b163-aa393ad2b545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:20.880204 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 863/1744] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:20 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:20.886394 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a1cf4-4b3e-47ef-ad63-50febf35145a None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:20.887243 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a1cf4-4b3e-47ef-ad63-50febf35145a None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:20.889033 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a1cf4-4b3e-47ef-ad63-50febf35145a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:20.907358 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:20.948882 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-5a6a1cf4-4b3e-47ef-ad63-50febf35145a None None] MFA Rules not processed for user `20ee77db82594e6da5fe36d155120edd`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:20.953105 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-5a6a1cf4-4b3e-47ef-ad63-50febf35145a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:20.995108 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 882/1745] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:20 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:20.996376 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53af89-dd07-40bf-ad91-46bc3b4a9195 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:20.996667 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53af89-dd07-40bf-ad91-46bc3b4a9195 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:20.996950 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53af89-dd07-40bf-ad91-46bc3b4a9195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:21.032517 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-be53af89-dd07-40bf-ad91-46bc3b4a9195 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:21.045367 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-be53af89-dd07-40bf-ad91-46bc3b4a9195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:21.067551 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 883/1746] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:21.068434 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53af89-dd07-40bf-ad91-46bc3b4a9195 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:21.102259 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53af89-dd07-40bf-ad91-46bc3b4a9195 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:21.119834 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6cc082-faf6-4f07-b628-f939c2ab61a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:21.121715 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6cc082-faf6-4f07-b628-f939c2ab61a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:21.122107 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6cc082-faf6-4f07-b628-f939c2ab61a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:21.123490 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6cc082-faf6-4f07-b628-f939c2ab61a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:21.125179 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6cc082-faf6-4f07-b628-f939c2ab61a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:21.125584 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6cc082-faf6-4f07-b628-f939c2ab61a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:21.132983 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6cc082-faf6-4f07-b628-f939c2ab61a4 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:21.159422 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 864/1747] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:21.166722 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b411cf2-37a3-415f-b495-bcb9c69f11de None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:21.167106 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b411cf2-37a3-415f-b495-bcb9c69f11de None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:21.167388 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b411cf2-37a3-415f-b495-bcb9c69f11de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:21.175778 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 884/1748] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 15:56:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:21.177648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6cc082-faf6-4f07-b628-f939c2ab61a4 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:21.182744 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-0c6cc082-faf6-4f07-b628-f939c2ab61a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:21.207487 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6cc082-faf6-4f07-b628-f939c2ab61a4 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:21.209109 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-2b411cf2-37a3-415f-b495-bcb9c69f11de None None] MFA Rules not processed for user `d7738e76f24f48d4a66a9237ddbc939e`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:21.210527 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-2b411cf2-37a3-415f-b495-bcb9c69f11de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:21.221175 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657951a-39a5-4f44-98c8-72ad4b9a59e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:21.223320 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657951a-39a5-4f44-98c8-72ad4b9a59e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:21.223603 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657951a-39a5-4f44-98c8-72ad4b9a59e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:21.223878 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657951a-39a5-4f44-98c8-72ad4b9a59e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:21.224561 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4657951a-39a5-4f44-98c8-72ad4b9a59e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:21.226610 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4657951a-39a5-4f44-98c8-72ad4b9a59e4 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:21.231423 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 865/1749] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:21 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:21.236747 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09945f-5660-4e70-87fc-355f90b985c4 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:21.236747 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09945f-5660-4e70-87fc-355f90b985c4 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:21.236747 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09945f-5660-4e70-87fc-355f90b985c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:21.274601 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-6c09945f-5660-4e70-87fc-355f90b985c4 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:21.276083 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-6c09945f-5660-4e70-87fc-355f90b985c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:21.292037 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 885/1750] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:56:21 2022] POST /identity/v3/projects => generated 403 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:21.292949 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657951a-39a5-4f44-98c8-72ad4b9a59e4 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:21.299360 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-4657951a-39a5-4f44-98c8-72ad4b9a59e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:21.399641 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 866/1751] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:21.400561 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09945f-5660-4e70-87fc-355f90b985c4 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:21.414813 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09945f-5660-4e70-87fc-355f90b985c4 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:21.420877 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c838a1-cbbc-4d30-ac34-69c520593298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:21.421508 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c838a1-cbbc-4d30-ac34-69c520593298 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:21.421847 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c838a1-cbbc-4d30-ac34-69c520593298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:21.422131 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c838a1-cbbc-4d30-ac34-69c520593298 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:21.422831 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c838a1-cbbc-4d30-ac34-69c520593298 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:21.425008 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c838a1-cbbc-4d30-ac34-69c520593298 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:21.464328 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657951a-39a5-4f44-98c8-72ad4b9a59e4 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:21.467596 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 867/1752] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:56:21 2022] POST /identity/v3/projects => generated 381 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:21.471482 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c838a1-cbbc-4d30-ac34-69c520593298 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:21.473637 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5639a73-14b0-4f03-9910-9ca094db9eed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:21.474336 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5639a73-14b0-4f03-9910-9ca094db9eed service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:21.474783 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5639a73-14b0-4f03-9910-9ca094db9eed service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:21.475067 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5639a73-14b0-4f03-9910-9ca094db9eed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:21.475351 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-49c838a1-cbbc-4d30-ac34-69c520593298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:21.477215 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-d5639a73-14b0-4f03-9910-9ca094db9eed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:21.489152 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:21.577486 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5639a73-14b0-4f03-9910-9ca094db9eed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:21.579336 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5639a73-14b0-4f03-9910-9ca094db9eed service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:21.610510 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 886/1753] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:21.611487 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5639a73-14b0-4f03-9910-9ca094db9eed service nova] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:21.622271 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c838a1-cbbc-4d30-ac34-69c520593298 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:21.627982 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6f1c0-76e9-4141-a445-f0a3e2ecf548 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:21.628797 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6f1c0-76e9-4141-a445-f0a3e2ecf548 service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:21.629080 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6f1c0-76e9-4141-a445-f0a3e2ecf548 service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:21.629357 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6f1c0-76e9-4141-a445-f0a3e2ecf548 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:21.641054 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5639a73-14b0-4f03-9910-9ca094db9eed service nova] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:21.719132 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:21.773626 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55523ba-7d30-488e-ae19-5e3ee0fe87c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:21.774276 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55523ba-7d30-488e-ae19-5e3ee0fe87c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:21.774554 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55523ba-7d30-488e-ae19-5e3ee0fe87c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:21.779721 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55523ba-7d30-488e-ae19-5e3ee0fe87c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:21.780569 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55523ba-7d30-488e-ae19-5e3ee0fe87c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:21.784419 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55523ba-7d30-488e-ae19-5e3ee0fe87c8 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:21.791561 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e6f1c0-76e9-4141-a445-f0a3e2ecf548 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:21.808387 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e6f1c0-76e9-4141-a445-f0a3e2ecf548 service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:21.831772 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 887/1754] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:56:21 2022] POST /identity/v3/users => generated 308 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:21.833079 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55523ba-7d30-488e-ae19-5e3ee0fe87c8 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:21.836824 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 868/1755] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:21 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:21.838676 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6f1c0-76e9-4141-a445-f0a3e2ecf548 service nova] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:21.851858 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6f1c0-76e9-4141-a445-f0a3e2ecf548 service nova] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:21.855698 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55523ba-7d30-488e-ae19-5e3ee0fe87c8 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:21.858530 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61838fa6-97fa-4083-8acf-e87581d051c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:21.859326 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61838fa6-97fa-4083-8acf-e87581d051c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:21.859615 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61838fa6-97fa-4083-8acf-e87581d051c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:21.859896 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61838fa6-97fa-4083-8acf-e87581d051c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:21.860589 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61838fa6-97fa-4083-8acf-e87581d051c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:21.862736 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61838fa6-97fa-4083-8acf-e87581d051c7 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:21.869403 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e77cf-4fbf-4354-b04a-9b6c79b656bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:21.870147 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e77cf-4fbf-4354-b04a-9b6c79b656bf admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:21.871630 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e77cf-4fbf-4354-b04a-9b6c79b656bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:21.872067 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e77cf-4fbf-4354-b04a-9b6c79b656bf admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:21.873481 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e77cf-4fbf-4354-b04a-9b6c79b656bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:21.875817 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e77cf-4fbf-4354-b04a-9b6c79b656bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:21.877696 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e77cf-4fbf-4354-b04a-9b6c79b656bf admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:21.888582 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 869/1756] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:56:21 2022] POST /identity/v3/users => generated 291 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:21.890750 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61838fa6-97fa-4083-8acf-e87581d051c7 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:21.914466 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 888/1757] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 15:56:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:21.917612 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61838fa6-97fa-4083-8acf-e87581d051c7 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:21.917774 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e77cf-4fbf-4354-b04a-9b6c79b656bf admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:21.923246 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-f69e77cf-4fbf-4354-b04a-9b6c79b656bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:21.932327 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08195dc8-81bc-4e13-8b64-1b784787fef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:21.933198 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08195dc8-81bc-4e13-8b64-1b784787fef6 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:21.933652 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08195dc8-81bc-4e13-8b64-1b784787fef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:21.934287 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08195dc8-81bc-4e13-8b64-1b784787fef6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:21.935176 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08195dc8-81bc-4e13-8b64-1b784787fef6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:21.937260 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08195dc8-81bc-4e13-8b64-1b784787fef6 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:21.964458 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e77cf-4fbf-4354-b04a-9b6c79b656bf admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:21.972709 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 870/1758] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:21.973777 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08195dc8-81bc-4e13-8b64-1b784787fef6 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:21.982392 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec39b86b-76c2-4406-8e6e-a81ebb976017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:21.984637 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39b86b-76c2-4406-8e6e-a81ebb976017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:21.986896 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39b86b-76c2-4406-8e6e-a81ebb976017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:21.988442 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39b86b-76c2-4406-8e6e-a81ebb976017 admin admin] PATH_INFO: `/v3/projects/ef28cfa6139f4ee8a8a280b26ad4d18b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:21.994540 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec39b86b-76c2-4406-8e6e-a81ebb976017 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef28cfa6139f4ee8a8a280b26ad4d18b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:21.998635 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08195dc8-81bc-4e13-8b64-1b784787fef6 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:21.998819 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec39b86b-76c2-4406-8e6e-a81ebb976017 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:22.051466 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67970322-c602-42dd-93b5-9238941a5592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:22.053698 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67970322-c602-42dd-93b5-9238941a5592 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:22.055154 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67970322-c602-42dd-93b5-9238941a5592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:22.055617 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67970322-c602-42dd-93b5-9238941a5592 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:22.059204 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67970322-c602-42dd-93b5-9238941a5592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:22.067115 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67970322-c602-42dd-93b5-9238941a5592 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:22.136076 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 871/1759] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:22.137126 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67970322-c602-42dd-93b5-9238941a5592 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:22.160849 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-ec39b86b-76c2-4406-8e6e-a81ebb976017 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef28cfa6139f4ee8a8a280b26ad4d18b', 'request_id': 'req-ec39b86b-76c2-4406-8e6e-a81ebb976017'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:22.189958 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67970322-c602-42dd-93b5-9238941a5592 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:22.197894 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-ec39b86b-76c2-4406-8e6e-a81ebb976017 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef28cfa6139f4ee8a8a280b26ad4d18b', 'request_id': 'req-ec39b86b-76c2-4406-8e6e-a81ebb976017'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:22.234121 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-ec39b86b-76c2-4406-8e6e-a81ebb976017 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef28cfa6139f4ee8a8a280b26ad4d18b', 'request_id': 'req-ec39b86b-76c2-4406-8e6e-a81ebb976017'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:22.279371 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-ec39b86b-76c2-4406-8e6e-a81ebb976017 admin admin] The token cache is being invalidate because project ef28cfa6139f4ee8a8a280b26ad4d18b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:56:22.279713 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-ec39b86b-76c2-4406-8e6e-a81ebb976017 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:22.285261 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-ec39b86b-76c2-4406-8e6e-a81ebb976017 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:22.294029 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 889/1760] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:56:21 2022] DELETE /identity/v3/projects/ef28cfa6139f4ee8a8a280b26ad4d18b => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:22.294839 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec39b86b-76c2-4406-8e6e-a81ebb976017 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:22.308007 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-ec39b86b-76c2-4406-8e6e-a81ebb976017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:22.354316 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8eb7c2-31ca-47ec-87b9-913a10c45678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:22.354987 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8eb7c2-31ca-47ec-87b9-913a10c45678 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:22.355229 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8eb7c2-31ca-47ec-87b9-913a10c45678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:22.355708 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8eb7c2-31ca-47ec-87b9-913a10c45678 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:22.356566 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8eb7c2-31ca-47ec-87b9-913a10c45678 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:22.359308 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8eb7c2-31ca-47ec-87b9-913a10c45678 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:22.367585 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:22.415160 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 872/1761] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:56:22 2022] POST /identity/v3/projects => generated 385 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:22.416517 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8eb7c2-31ca-47ec-87b9-913a10c45678 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:22.422312 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-6a8eb7c2-31ca-47ec-87b9-913a10c45678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:22.557037 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec39b86b-76c2-4406-8e6e-a81ebb976017 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:22.637386 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8eb7c2-31ca-47ec-87b9-913a10c45678 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:22.643074 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12403c53-e973-4ef0-8e5c-fee3536d69ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:22.643706 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12403c53-e973-4ef0-8e5c-fee3536d69ca admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:22.643987 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12403c53-e973-4ef0-8e5c-fee3536d69ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:22.644260 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12403c53-e973-4ef0-8e5c-fee3536d69ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:22.644903 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12403c53-e973-4ef0-8e5c-fee3536d69ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:22.647129 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12403c53-e973-4ef0-8e5c-fee3536d69ca admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:22.656234 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:22.661326 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 873/1762] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:22.665641 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12403c53-e973-4ef0-8e5c-fee3536d69ca admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:22.676455 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-12403c53-e973-4ef0-8e5c-fee3536d69ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:22.694001 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12403c53-e973-4ef0-8e5c-fee3536d69ca admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:22.700000 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ba602-75a7-4005-81e8-fda84aaa3ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:22.700722 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ba602-75a7-4005-81e8-fda84aaa3ea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:22.701574 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ba602-75a7-4005-81e8-fda84aaa3ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:22.701931 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ba602-75a7-4005-81e8-fda84aaa3ea3 admin admin] PATH_INFO: `/v3/users/37ce605ad07f4a9cbe774ea434dfdafa` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:22.703335 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ba602-75a7-4005-81e8-fda84aaa3ea3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37ce605ad07f4a9cbe774ea434dfdafa)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:22.705357 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ba602-75a7-4005-81e8-fda84aaa3ea3 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:22.719111 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fcc7f4-e8f9-46ec-aeba-99e3f7c19aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:22.719817 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fcc7f4-e8f9-46ec-aeba-99e3f7c19aeb admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:22.720103 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fcc7f4-e8f9-46ec-aeba-99e3f7c19aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:22.720380 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fcc7f4-e8f9-46ec-aeba-99e3f7c19aeb admin admin] PATH_INFO: `/v3/projects/32a0513f777845a888669970262ab57d/users/4385d03b56624600b4c00bf0b942d598/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:22.756522 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fcc7f4-e8f9-46ec-aeba-99e3f7c19aeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=32a0513f777845a888669970262ab57d, user_id=4385d03b56624600b4c00bf0b942d598, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:22.761580 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fcc7f4-e8f9-46ec-aeba-99e3f7c19aeb admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:22.800667 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 890/1763] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:22 2022] PUT /identity/v3/projects/32a0513f777845a888669970262ab57d/users/4385d03b56624600b4c00bf0b942d598/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:22.801786 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fcc7f4-e8f9-46ec-aeba-99e3f7c19aeb admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:22.805176 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-f1fcc7f4-e8f9-46ec-aeba-99e3f7c19aeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:22.811013 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-300ba602-75a7-4005-81e8-fda84aaa3ea3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37ce605ad07f4a9cbe774ea434dfdafa'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:22.830871 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-300ba602-75a7-4005-81e8-fda84aaa3ea3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37ce605ad07f4a9cbe774ea434dfdafa'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:22.831725 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-300ba602-75a7-4005-81e8-fda84aaa3ea3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37ce605ad07f4a9cbe774ea434dfdafa'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:22.848023 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-300ba602-75a7-4005-81e8-fda84aaa3ea3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37ce605ad07f4a9cbe774ea434dfdafa'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:22.851497 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-300ba602-75a7-4005-81e8-fda84aaa3ea3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37ce605ad07f4a9cbe774ea434dfdafa'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:22.914448 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 874/1764] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:56:22 2022] DELETE /identity/v3/users/37ce605ad07f4a9cbe774ea434dfdafa => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:22.917268 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ba602-75a7-4005-81e8-fda84aaa3ea3 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:22.920706 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-300ba602-75a7-4005-81e8-fda84aaa3ea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:22.966621 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fcc7f4-e8f9-46ec-aeba-99e3f7c19aeb admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:23.119461 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:23.126265 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ba602-75a7-4005-81e8-fda84aaa3ea3 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:23.131733 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edaabe6-14af-4c88-8493-2bba907f8be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:23.132374 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edaabe6-14af-4c88-8493-2bba907f8be0 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:23.132654 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edaabe6-14af-4c88-8493-2bba907f8be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:23.132927 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edaabe6-14af-4c88-8493-2bba907f8be0 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:23.135164 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edaabe6-14af-4c88-8493-2bba907f8be0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:23.136337 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fedee-ee5f-4c7c-aabd-480188196e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:23.136994 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edaabe6-14af-4c88-8493-2bba907f8be0 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:23.137112 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fedee-ee5f-4c7c-aabd-480188196e3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:23.137357 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fedee-ee5f-4c7c-aabd-480188196e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:23.137671 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fedee-ee5f-4c7c-aabd-480188196e3b admin admin] PATH_INFO: `/v3/projects/b402d2e9744c461fb698a053955f3b98/users/1ca0855c29054b768449056e3eee10ba/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:23.164872 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7fedee-ee5f-4c7c-aabd-480188196e3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b402d2e9744c461fb698a053955f3b98, user_id=1ca0855c29054b768449056e3eee10ba, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:23.168858 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7fedee-ee5f-4c7c-aabd-480188196e3b admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:23.191105 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 875/1765] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:22 2022] PUT /identity/v3/projects/b402d2e9744c461fb698a053955f3b98/users/1ca0855c29054b768449056e3eee10ba/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:23.204664 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fedee-ee5f-4c7c-aabd-480188196e3b admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:23.207014 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-8c7fedee-ee5f-4c7c-aabd-480188196e3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:23.216813 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 891/1766] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:56:22 2022] POST /identity/v3/users => generated 293 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:23.219350 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b400d2e-2122-455b-a71d-5c74ce043515 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:23.220626 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b400d2e-2122-455b-a71d-5c74ce043515 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:23.221471 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b400d2e-2122-455b-a71d-5c74ce043515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:23.300201 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-8b400d2e-2122-455b-a71d-5c74ce043515 None None] MFA Rules not processed for user `1ca0855c29054b768449056e3eee10ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:23.302076 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fedee-ee5f-4c7c-aabd-480188196e3b admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:23.304985 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-8b400d2e-2122-455b-a71d-5c74ce043515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:23.308150 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e22b08-e125-49cb-bcf3-9dffd5884fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:23.308776 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e22b08-e125-49cb-bcf3-9dffd5884fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:23.309213 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e22b08-e125-49cb-bcf3-9dffd5884fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:23.309531 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e22b08-e125-49cb-bcf3-9dffd5884fe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:23.310438 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e22b08-e125-49cb-bcf3-9dffd5884fe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:23.312382 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e22b08-e125-49cb-bcf3-9dffd5884fe3 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:23.333915 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 876/1767] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:23.335098 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e22b08-e125-49cb-bcf3-9dffd5884fe3 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:23.338364 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-50e22b08-e125-49cb-bcf3-9dffd5884fe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:23.361821 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e22b08-e125-49cb-bcf3-9dffd5884fe3 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:23.373584 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab1b5d-8d36-44e2-a4c6-077dd261db4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:23.376167 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab1b5d-8d36-44e2-a4c6-077dd261db4a admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:23.376510 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab1b5d-8d36-44e2-a4c6-077dd261db4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:23.376789 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab1b5d-8d36-44e2-a4c6-077dd261db4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:23.378957 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ab1b5d-8d36-44e2-a4c6-077dd261db4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:23.391755 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ab1b5d-8d36-44e2-a4c6-077dd261db4a admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:23.420354 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 877/1768] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:23.422455 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437905cc-2778-4b17-926d-9841aa0e423c None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:23.422790 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437905cc-2778-4b17-926d-9841aa0e423c None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:23.423072 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437905cc-2778-4b17-926d-9841aa0e423c None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:23.425228 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 878/1769] 10.222.0.16 () {54 vars in 912 bytes} [Wed Sep 7 15:56:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:23.430876 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437905cc-2778-4b17-926d-9841aa0e423c None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:23.439675 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:23.475244 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437905cc-2778-4b17-926d-9841aa0e423c None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:23.488540 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6f29d-affb-4bfb-a095-d86577792f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:23.492860 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6f29d-affb-4bfb-a095-d86577792f0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:23.493783 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6f29d-affb-4bfb-a095-d86577792f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:23.494474 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6f29d-affb-4bfb-a095-d86577792f0b admin admin] PATH_INFO: `/v3/projects/32a0513f777845a888669970262ab57d/users/4385d03b56624600b4c00bf0b942d598/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:23.507831 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e6f29d-affb-4bfb-a095-d86577792f0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=32a0513f777845a888669970262ab57d, user_id=4385d03b56624600b4c00bf0b942d598, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:23.511786 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 892/1770] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:23.516395 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b400d2e-2122-455b-a71d-5c74ce043515 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:23.518163 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e6f29d-affb-4bfb-a095-d86577792f0b admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:23.544362 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b400d2e-2122-455b-a71d-5c74ce043515 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:23.552984 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 879/1771] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:23 2022] PUT /identity/v3/projects/32a0513f777845a888669970262ab57d/users/4385d03b56624600b4c00bf0b942d598/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:23.554478 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7264c-9fd9-42cc-9523-cb101279d627 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:23.558510 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7264c-9fd9-42cc-9523-cb101279d627 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:23.559249 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7264c-9fd9-42cc-9523-cb101279d627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:23.747166 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a00c5-7601-4581-af80-e36ef056e189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:23.748074 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a00c5-7601-4581-af80-e36ef056e189 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:23.748550 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a00c5-7601-4581-af80-e36ef056e189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:23.749122 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a00c5-7601-4581-af80-e36ef056e189 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:23.750043 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2a00c5-7601-4581-af80-e36ef056e189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:23.757916 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2a00c5-7601-4581-af80-e36ef056e189 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:23.764742 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-0ba7264c-9fd9-42cc-9523-cb101279d627 None None] MFA Rules not processed for user `3195fa62961c4d64972b88449d013380`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:23.766247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-0ba7264c-9fd9-42cc-9523-cb101279d627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:23.815921 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 893/1772] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:23.817760 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a00c5-7601-4581-af80-e36ef056e189 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:23.859129 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a00c5-7601-4581-af80-e36ef056e189 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:23.872034 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c223f8-51c0-4f46-a8c1-d2c7a3dafc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:23.872730 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c223f8-51c0-4f46-a8c1-d2c7a3dafc3c admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:23.873038 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c223f8-51c0-4f46-a8c1-d2c7a3dafc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:23.875434 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c223f8-51c0-4f46-a8c1-d2c7a3dafc3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:23.876196 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c223f8-51c0-4f46-a8c1-d2c7a3dafc3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:23.882674 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c223f8-51c0-4f46-a8c1-d2c7a3dafc3c admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:23.933872 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 880/1773] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Sep 7 15:56:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:23.935978 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7264c-9fd9-42cc-9523-cb101279d627 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:23.964246 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7264c-9fd9-42cc-9523-cb101279d627 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:23.967660 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 894/1774] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:56:23 2022] POST /identity/v3/projects => generated 379 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:23.969136 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5dc011-f716-4d9f-9735-0c2ca539747b None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:23.969420 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5dc011-f716-4d9f-9735-0c2ca539747b None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:23.969699 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5dc011-f716-4d9f-9735-0c2ca539747b None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:23.975213 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 895/1775] 10.222.0.16 () {54 vars in 912 bytes} [Wed Sep 7 15:56:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:23.976254 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5dc011-f716-4d9f-9735-0c2ca539747b None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:24.096213 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:24.132436 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75756806-f839-4f6b-859a-1fa44bc46ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:24.133162 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75756806-f839-4f6b-859a-1fa44bc46ac2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:24.133450 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75756806-f839-4f6b-859a-1fa44bc46ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:24.133860 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75756806-f839-4f6b-859a-1fa44bc46ac2 admin admin] PATH_INFO: `/v3/projects/84be9af1e39d4c80b8b8ae4e86e7a1cc/users/a9826fc308fa47c1b4c858fb70d8aa3b/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:24.176250 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75756806-f839-4f6b-859a-1fa44bc46ac2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84be9af1e39d4c80b8b8ae4e86e7a1cc, user_id=a9826fc308fa47c1b4c858fb70d8aa3b, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:24.183760 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75756806-f839-4f6b-859a-1fa44bc46ac2 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:24.209222 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 881/1776] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:23 2022] PUT /identity/v3/projects/84be9af1e39d4c80b8b8ae4e86e7a1cc/users/a9826fc308fa47c1b4c858fb70d8aa3b/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:24.215406 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c3f60-54a4-46bf-9b04-67520b51ff8d None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:24.216959 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c3f60-54a4-46bf-9b04-67520b51ff8d None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:24.217886 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c3f60-54a4-46bf-9b04-67520b51ff8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:24.228076 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5dc011-f716-4d9f-9735-0c2ca539747b None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:24.272309 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-599c3f60-54a4-46bf-9b04-67520b51ff8d None None] MFA Rules not processed for user `3195fa62961c4d64972b88449d013380`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:24.275363 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-599c3f60-54a4-46bf-9b04-67520b51ff8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:24.360283 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcc58d4-6d0f-4104-befb-fc8bd6903363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:24.361112 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc58d4-6d0f-4104-befb-fc8bd6903363 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:24.362730 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc58d4-6d0f-4104-befb-fc8bd6903363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:24.363039 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc58d4-6d0f-4104-befb-fc8bd6903363 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:24.369003 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcc58d4-6d0f-4104-befb-fc8bd6903363 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:24.375929 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcc58d4-6d0f-4104-befb-fc8bd6903363 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:24.408600 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 882/1777] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Sep 7 15:56:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:24.409443 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c3f60-54a4-46bf-9b04-67520b51ff8d None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:24.410105 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:24.412664 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-599c3f60-54a4-46bf-9b04-67520b51ff8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:24.433216 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 896/1778] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:56:23 2022] POST /identity/v3/users => generated 296 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:24.434761 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb5caf-d29d-47e2-b407-f483d2a2059f None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:24.435513 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c3f60-54a4-46bf-9b04-67520b51ff8d None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:24.436980 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb5caf-d29d-47e2-b407-f483d2a2059f None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:24.438711 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb5caf-d29d-47e2-b407-f483d2a2059f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:24.440800 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee054c1-ead6-4ee2-9034-179c444b3430 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:24.441598 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee054c1-ead6-4ee2-9034-179c444b3430 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:24.443666 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee054c1-ead6-4ee2-9034-179c444b3430 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:24.444092 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee054c1-ead6-4ee2-9034-179c444b3430 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:24.454917 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee054c1-ead6-4ee2-9034-179c444b3430 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:24.458542 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee054c1-ead6-4ee2-9034-179c444b3430 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:24.470697 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 883/1779] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:24.471752 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee054c1-ead6-4ee2-9034-179c444b3430 service neutron] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:24.487488 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee054c1-ead6-4ee2-9034-179c444b3430 service neutron] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:24.496499 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916bb52-5121-401f-af51-3372948fd42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:24.498324 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916bb52-5121-401f-af51-3372948fd42b admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:24.499388 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916bb52-5121-401f-af51-3372948fd42b admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:24.499766 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916bb52-5121-401f-af51-3372948fd42b admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:24.502228 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a916bb52-5121-401f-af51-3372948fd42b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:24.505305 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a916bb52-5121-401f-af51-3372948fd42b admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:24.512130 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-cafb5caf-d29d-47e2-b407-f483d2a2059f None None] MFA Rules not processed for user `a9826fc308fa47c1b4c858fb70d8aa3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:24.513745 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-cafb5caf-d29d-47e2-b407-f483d2a2059f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:24.535632 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 884/1780] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:24 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:24.536677 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916bb52-5121-401f-af51-3372948fd42b admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:24.544336 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-a916bb52-5121-401f-af51-3372948fd42b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:24.570304 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916bb52-5121-401f-af51-3372948fd42b admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:24.583058 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50946d86-e24e-4157-908b-e9403c165b15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:24.588986 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50946d86-e24e-4157-908b-e9403c165b15 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:24.589284 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50946d86-e24e-4157-908b-e9403c165b15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:24.589568 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50946d86-e24e-4157-908b-e9403c165b15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:24.620620 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50946d86-e24e-4157-908b-e9403c165b15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:24.622394 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50946d86-e24e-4157-908b-e9403c165b15 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:24.646087 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 885/1781] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:24.654315 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50946d86-e24e-4157-908b-e9403c165b15 service neutron] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:24.700515 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50946d86-e24e-4157-908b-e9403c165b15 service neutron] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:24.714374 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ad53a-68b1-409a-a6e5-4b3a4024f42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:24.719145 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ad53a-68b1-409a-a6e5-4b3a4024f42f admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:24.719488 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ad53a-68b1-409a-a6e5-4b3a4024f42f admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:24.719779 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ad53a-68b1-409a-a6e5-4b3a4024f42f admin admin] PATH_INFO: `/v3/projects/3f33f490279b4cbfae45141b856e8f94/users/9ba6cb86b97a404dad0423eccea03102/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:24.768969 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8ad53a-68b1-409a-a6e5-4b3a4024f42f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f33f490279b4cbfae45141b856e8f94, user_id=9ba6cb86b97a404dad0423eccea03102, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:24.777472 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 897/1782] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:24.780932 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc9434-eccc-47d0-8fc4-46f3716ee046 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:24.783795 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc9434-eccc-47d0-8fc4-46f3716ee046 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:24.784547 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc9434-eccc-47d0-8fc4-46f3716ee046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:24.785619 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8ad53a-68b1-409a-a6e5-4b3a4024f42f admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:24.827017 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 886/1783] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:24 2022] PUT /identity/v3/projects/3f33f490279b4cbfae45141b856e8f94/users/9ba6cb86b97a404dad0423eccea03102/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:24.827516 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ad53a-68b1-409a-a6e5-4b3a4024f42f admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:24.827627 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-44bc9434-eccc-47d0-8fc4-46f3716ee046 None None] MFA Rules not processed for user `1eec1d820efc467a8e5856e6302a1885`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:24.830680 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-44bc9434-eccc-47d0-8fc4-46f3716ee046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:24.978542 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 898/1784] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:24.985822 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc9434-eccc-47d0-8fc4-46f3716ee046 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:25.019719 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ad53a-68b1-409a-a6e5-4b3a4024f42f admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:25.027299 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad5c5ab-0756-453e-a5bd-fb7e57b0e360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:25.029214 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad5c5ab-0756-453e-a5bd-fb7e57b0e360 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:25.029666 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad5c5ab-0756-453e-a5bd-fb7e57b0e360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:25.030141 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad5c5ab-0756-453e-a5bd-fb7e57b0e360 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:25.047495 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad5c5ab-0756-453e-a5bd-fb7e57b0e360 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:25.054976 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad5c5ab-0756-453e-a5bd-fb7e57b0e360 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:25.083461 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc9434-eccc-47d0-8fc4-46f3716ee046 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:25.099488 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555208f-fed2-41fb-a312-65aa1dcdd681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:25.100508 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555208f-fed2-41fb-a312-65aa1dcdd681 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:25.100972 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555208f-fed2-41fb-a312-65aa1dcdd681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:25.101937 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555208f-fed2-41fb-a312-65aa1dcdd681 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:25.105040 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9555208f-fed2-41fb-a312-65aa1dcdd681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:25.107553 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9555208f-fed2-41fb-a312-65aa1dcdd681 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:25.122285 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 887/1785] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:56:24 2022] POST /identity/v3/projects => generated 385 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:25.126474 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad5c5ab-0756-453e-a5bd-fb7e57b0e360 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:25.132164 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-4ad5c5ab-0756-453e-a5bd-fb7e57b0e360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:25.133535 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 899/1786] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:24 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:25.136178 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555208f-fed2-41fb-a312-65aa1dcdd681 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:25.138380 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:25.140547 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-9555208f-fed2-41fb-a312-65aa1dcdd681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:25.161813 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555208f-fed2-41fb-a312-65aa1dcdd681 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:25.205267 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:25.280546 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaee7f2-a2c7-4380-bf44-194c4855268c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:25.283645 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaee7f2-a2c7-4380-bf44-194c4855268c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:25.284377 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaee7f2-a2c7-4380-bf44-194c4855268c admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:25.285106 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaee7f2-a2c7-4380-bf44-194c4855268c admin admin] PATH_INFO: `/v3/projects/fcd26adccc6b48839441d62008b84c4f` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:25.286639 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaee7f2-a2c7-4380-bf44-194c4855268c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcd26adccc6b48839441d62008b84c4f)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:25.289304 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaee7f2-a2c7-4380-bf44-194c4855268c admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:25.324686 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad5c5ab-0756-453e-a5bd-fb7e57b0e360 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:25.337911 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8c24c-c25c-46cc-b348-2b82ce26a55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:25.338678 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8c24c-c25c-46cc-b348-2b82ce26a55a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:25.339025 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8c24c-c25c-46cc-b348-2b82ce26a55a admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:25.339391 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8c24c-c25c-46cc-b348-2b82ce26a55a admin admin] PATH_INFO: `/v3/users/6fa23550b44b4618ac90dd0b2fae03bb` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:25.341039 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df8c24c-c25c-46cc-b348-2b82ce26a55a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fa23550b44b4618ac90dd0b2fae03bb)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:25.344517 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df8c24c-c25c-46cc-b348-2b82ce26a55a admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:25.366067 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-ecaee7f2-a2c7-4380-bf44-194c4855268c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcd26adccc6b48839441d62008b84c4f', 'request_id': 'req-ecaee7f2-a2c7-4380-bf44-194c4855268c'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:25.394871 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-ecaee7f2-a2c7-4380-bf44-194c4855268c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcd26adccc6b48839441d62008b84c4f', 'request_id': 'req-ecaee7f2-a2c7-4380-bf44-194c4855268c'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:25.418935 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-ecaee7f2-a2c7-4380-bf44-194c4855268c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcd26adccc6b48839441d62008b84c4f', 'request_id': 'req-ecaee7f2-a2c7-4380-bf44-194c4855268c'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:25.455728 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-ecaee7f2-a2c7-4380-bf44-194c4855268c admin admin] The token cache is being invalidate because project fcd26adccc6b48839441d62008b84c4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:56:25.456032 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-ecaee7f2-a2c7-4380-bf44-194c4855268c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:25.457761 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-ecaee7f2-a2c7-4380-bf44-194c4855268c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:25.459932 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-5df8c24c-c25c-46cc-b348-2b82ce26a55a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fa23550b44b4618ac90dd0b2fae03bb'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:25.460622 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 900/1787] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:56:25 2022] DELETE /identity/v3/projects/fcd26adccc6b48839441d62008b84c4f => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:25.461451 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaee7f2-a2c7-4380-bf44-194c4855268c admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:25.471381 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-ecaee7f2-a2c7-4380-bf44-194c4855268c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:25.478852 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-5df8c24c-c25c-46cc-b348-2b82ce26a55a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fa23550b44b4618ac90dd0b2fae03bb'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:25.479567 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-5df8c24c-c25c-46cc-b348-2b82ce26a55a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fa23550b44b4618ac90dd0b2fae03bb'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:25.503287 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-5df8c24c-c25c-46cc-b348-2b82ce26a55a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fa23550b44b4618ac90dd0b2fae03bb'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:25.504424 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-5df8c24c-c25c-46cc-b348-2b82ce26a55a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fa23550b44b4618ac90dd0b2fae03bb'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:25.567182 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 888/1788] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:56:25 2022] DELETE /identity/v3/users/6fa23550b44b4618ac90dd0b2fae03bb => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:25.568808 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8c24c-c25c-46cc-b348-2b82ce26a55a admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:25.573730 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-5df8c24c-c25c-46cc-b348-2b82ce26a55a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:25.688508 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaee7f2-a2c7-4380-bf44-194c4855268c admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:25.741634 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8c24c-c25c-46cc-b348-2b82ce26a55a admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:25.751394 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67cafb9-d486-4c59-af56-01ebef19484f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:25.752298 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67cafb9-d486-4c59-af56-01ebef19484f admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:25.752727 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67cafb9-d486-4c59-af56-01ebef19484f admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:25.753151 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67cafb9-d486-4c59-af56-01ebef19484f admin admin] PATH_INFO: `/v3/projects/3f33f490279b4cbfae45141b856e8f94/users/9ba6cb86b97a404dad0423eccea03102/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:25.761471 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67cafb9-d486-4c59-af56-01ebef19484f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f33f490279b4cbfae45141b856e8f94, user_id=9ba6cb86b97a404dad0423eccea03102, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:25.767477 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67cafb9-d486-4c59-af56-01ebef19484f admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:25.799961 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 889/1789] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:25 2022] PUT /identity/v3/projects/3f33f490279b4cbfae45141b856e8f94/users/9ba6cb86b97a404dad0423eccea03102/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:25.802735 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d1c5f-d12e-4af7-b567-a283ea7c2b63 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:25.803237 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d1c5f-d12e-4af7-b567-a283ea7c2b63 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:25.803619 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d1c5f-d12e-4af7-b567-a283ea7c2b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:25.821626 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ba4a1-ae18-4b85-a942-c4e2d54ae0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:25.822383 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ba4a1-ae18-4b85-a942-c4e2d54ae0ed admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:25.822693 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ba4a1-ae18-4b85-a942-c4e2d54ae0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:25.823080 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ba4a1-ae18-4b85-a942-c4e2d54ae0ed admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:25.823736 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312ba4a1-ae18-4b85-a942-c4e2d54ae0ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:25.830497 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312ba4a1-ae18-4b85-a942-c4e2d54ae0ed admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:25.832457 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-384d1c5f-d12e-4af7-b567-a283ea7c2b63 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:25.834170 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-384d1c5f-d12e-4af7-b567-a283ea7c2b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:25.854679 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:25.871275 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:25.901859 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 901/1790] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:56:25 2022] POST /identity/v3/users => generated 299 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:25.905099 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91520ff-a74e-43db-b9b2-f296bf9e91c3 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:25.905692 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91520ff-a74e-43db-b9b2-f296bf9e91c3 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:25.906135 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91520ff-a74e-43db-b9b2-f296bf9e91c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:25.982456 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-d91520ff-a74e-43db-b9b2-f296bf9e91c3 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:25.988245 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-d91520ff-a74e-43db-b9b2-f296bf9e91c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:26.020099 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 890/1791] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:26.021065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d1c5f-d12e-4af7-b567-a283ea7c2b63 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:26.042871 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-384d1c5f-d12e-4af7-b567-a283ea7c2b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:26.181850 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 902/1792] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:26.185183 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081f9dc-65ff-4c3d-93cd-a5a4d38be9d7 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:26.185479 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081f9dc-65ff-4c3d-93cd-a5a4d38be9d7 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:26.185759 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081f9dc-65ff-4c3d-93cd-a5a4d38be9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:26.231530 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-f081f9dc-65ff-4c3d-93cd-a5a4d38be9d7 None None] MFA Rules not processed for user `9ba6cb86b97a404dad0423eccea03102`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:26.233267 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-f081f9dc-65ff-4c3d-93cd-a5a4d38be9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:26.259762 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d1c5f-d12e-4af7-b567-a283ea7c2b63 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:26.274217 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04965d6c-38f4-4979-8547-37ba0f768c86 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c270b488024605af84e52d874474e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:26.275909 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04965d6c-38f4-4979-8547-37ba0f768c86 service placement] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:26.276953 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04965d6c-38f4-4979-8547-37ba0f768c86 service placement] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:26.277275 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04965d6c-38f4-4979-8547-37ba0f768c86 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:26.280841 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-04965d6c-38f4-4979-8547-37ba0f768c86 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:26.305087 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04965d6c-38f4-4979-8547-37ba0f768c86 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:26.307710 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04965d6c-38f4-4979-8547-37ba0f768c86 service placement] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:26.320475 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 891/1793] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:26.322246 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04965d6c-38f4-4979-8547-37ba0f768c86 service placement] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:26.324253 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-04965d6c-38f4-4979-8547-37ba0f768c86 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:26.344273 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04965d6c-38f4-4979-8547-37ba0f768c86 service placement] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:26.351289 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5d575-d152-4a49-bf27-3cfc862100e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:26.352140 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5d575-d152-4a49-bf27-3cfc862100e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:26.352434 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5d575-d152-4a49-bf27-3cfc862100e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:26.353092 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5d575-d152-4a49-bf27-3cfc862100e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:26.353956 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5d575-d152-4a49-bf27-3cfc862100e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:26.356412 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5d575-d152-4a49-bf27-3cfc862100e5 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:26.373748 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 892/1794] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:26.375147 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e749943-5a2d-45f6-81ff-9163a505a079 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:26.375437 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e749943-5a2d-45f6-81ff-9163a505a079 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:26.375800 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e749943-5a2d-45f6-81ff-9163a505a079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:26.403108 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 903/1795] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:26 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:26.403108 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014e37a-b002-4b6c-ab64-7192baa37969 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:26.403108 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014e37a-b002-4b6c-ab64-7192baa37969 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:26.403108 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014e37a-b002-4b6c-ab64-7192baa37969 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:26.410531 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 904/1796] 10.222.0.16 () {54 vars in 961 bytes} [Wed Sep 7 15:56:26 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:26.411619 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3014e37a-b002-4b6c-ab64-7192baa37969 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:26.411922 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-1e749943-5a2d-45f6-81ff-9163a505a079 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:26.413933 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-1e749943-5a2d-45f6-81ff-9163a505a079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:26.420580 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-3014e37a-b002-4b6c-ab64-7192baa37969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:26.425581 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 893/1797] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:26.436489 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53641056-836e-4f6b-94be-d9c84ebb429f None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:26.436750 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53641056-836e-4f6b-94be-d9c84ebb429f None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:26.437053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53641056-836e-4f6b-94be-d9c84ebb429f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:26.512725 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-53641056-836e-4f6b-94be-d9c84ebb429f None None] MFA Rules not processed for user `4385d03b56624600b4c00bf0b942d598`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:26.514145 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-53641056-836e-4f6b-94be-d9c84ebb429f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:26.586264 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3014e37a-b002-4b6c-ab64-7192baa37969 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:26.598081 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2566ec35-a729-4a5e-804d-f8d256fb5764 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:26.602988 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566ec35-a729-4a5e-804d-f8d256fb5764 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:26.603644 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566ec35-a729-4a5e-804d-f8d256fb5764 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:26.604106 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566ec35-a729-4a5e-804d-f8d256fb5764 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:26.638150 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2566ec35-a729-4a5e-804d-f8d256fb5764 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:26.640446 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2566ec35-a729-4a5e-804d-f8d256fb5764 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:26.690163 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 905/1798] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:26.706694 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20012532-ecb3-456f-ac23-d67f2bd0414d None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:26.709481 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20012532-ecb3-456f-ac23-d67f2bd0414d None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:26.710512 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20012532-ecb3-456f-ac23-d67f2bd0414d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:26.726582 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 894/1799] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:26 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:26.726582 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53641056-836e-4f6b-94be-d9c84ebb429f None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:26.757882 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53641056-836e-4f6b-94be-d9c84ebb429f None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:26.773034 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9043373-effa-4cf3-91fb-1151fffa0e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:26.773839 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9043373-effa-4cf3-91fb-1151fffa0e5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:26.776252 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9043373-effa-4cf3-91fb-1151fffa0e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:26.776551 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9043373-effa-4cf3-91fb-1151fffa0e5e admin admin] PATH_INFO: `/v3/projects/acdcad04994a4d5ba46576f222a1558b/users/9bc5ac0622fd4ebb8c41eefd69f0272c/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:26.793365 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-20012532-ecb3-456f-ac23-d67f2bd0414d None None] MFA Rules not processed for user `d7738e76f24f48d4a66a9237ddbc939e`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:26.794928 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-20012532-ecb3-456f-ac23-d67f2bd0414d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:26.810081 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:26.821341 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9043373-effa-4cf3-91fb-1151fffa0e5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=acdcad04994a4d5ba46576f222a1558b, user_id=9bc5ac0622fd4ebb8c41eefd69f0272c, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:26.828539 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9043373-effa-4cf3-91fb-1151fffa0e5e admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:26.870196 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 895/1800] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:26 2022] PUT /identity/v3/projects/acdcad04994a4d5ba46576f222a1558b/users/9bc5ac0622fd4ebb8c41eefd69f0272c/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:26.874970 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf8f38-b038-4a73-af56-6a86fe87f9a8 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:26.875294 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf8f38-b038-4a73-af56-6a86fe87f9a8 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:26.875609 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf8f38-b038-4a73-af56-6a86fe87f9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:26.910815 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:26.979128 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-80bf8f38-b038-4a73-af56-6a86fe87f9a8 None None] MFA Rules not processed for user `66c270b488024605af84e52d874474e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:26.980740 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-80bf8f38-b038-4a73-af56-6a86fe87f9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:27.028496 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 906/1801] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:26 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:27.030076 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20012532-ecb3-456f-ac23-d67f2bd0414d None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:27.049143 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-20012532-ecb3-456f-ac23-d67f2bd0414d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:27.189906 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 896/1802] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Sep 7 15:56:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:27.194428 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf8f38-b038-4a73-af56-6a86fe87f9a8 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:27.285166 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20012532-ecb3-456f-ac23-d67f2bd0414d None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:27.505370 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf8f38-b038-4a73-af56-6a86fe87f9a8 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:27.512012 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a236f5-d1c4-401e-88c3-4923e49ca3ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:27.512713 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a236f5-d1c4-401e-88c3-4923e49ca3ce service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:27.513023 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a236f5-d1c4-401e-88c3-4923e49ca3ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:27.513305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a236f5-d1c4-401e-88c3-4923e49ca3ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:27.514389 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142a280-65bf-48f1-bde5-228cf551630d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:27.519567 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142a280-65bf-48f1-bde5-228cf551630d admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:27.520295 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142a280-65bf-48f1-bde5-228cf551630d admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:27.521218 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142a280-65bf-48f1-bde5-228cf551630d admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:27.523194 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142a280-65bf-48f1-bde5-228cf551630d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:27.523999 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142a280-65bf-48f1-bde5-228cf551630d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:27.529764 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142a280-65bf-48f1-bde5-228cf551630d admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:27.582508 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 897/1803] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 15:56:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:27.586052 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142a280-65bf-48f1-bde5-228cf551630d admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:27.619721 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142a280-65bf-48f1-bde5-228cf551630d admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:27.642624 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e141f93-a900-431c-bbbc-b74fe16cfab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:27.646481 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e141f93-a900-431c-bbbc-b74fe16cfab8 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:27.646481 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e141f93-a900-431c-bbbc-b74fe16cfab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:27.646889 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e141f93-a900-431c-bbbc-b74fe16cfab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:27.647786 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e141f93-a900-431c-bbbc-b74fe16cfab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:27.651944 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e141f93-a900-431c-bbbc-b74fe16cfab8 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:27.682635 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 898/1804] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:27.688331 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e141f93-a900-431c-bbbc-b74fe16cfab8 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:27.717476 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e141f93-a900-431c-bbbc-b74fe16cfab8 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:27.720411 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a236f5-d1c4-401e-88c3-4923e49ca3ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:27.721876 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a236f5-d1c4-401e-88c3-4923e49ca3ce service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:27.745464 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db27a4-3ca2-4986-9714-9ab08c21052e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c270b488024605af84e52d874474e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:27.746290 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db27a4-3ca2-4986-9714-9ab08c21052e service placement] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:27.746854 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 907/1805] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:27 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 718 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:27.747596 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db27a4-3ca2-4986-9714-9ab08c21052e service placement] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:27.747900 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a236f5-d1c4-401e-88c3-4923e49ca3ce service cinder] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:27.748408 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db27a4-3ca2-4986-9714-9ab08c21052e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:27.752983 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-27a236f5-d1c4-401e-88c3-4923e49ca3ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:27.776553 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db27a4-3ca2-4986-9714-9ab08c21052e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:27.783835 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db27a4-3ca2-4986-9714-9ab08c21052e service placement] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:27.795132 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a236f5-d1c4-401e-88c3-4923e49ca3ce service cinder] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:27.803843 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b49626-4f3b-44d2-b98d-898b194727d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:27.804503 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b49626-4f3b-44d2-b98d-898b194727d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:27.804786 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b49626-4f3b-44d2-b98d-898b194727d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:27.805063 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b49626-4f3b-44d2-b98d-898b194727d4 admin admin] PATH_INFO: `/v3/projects/108fd0267b46498ca13a12766aa9e973` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:27.807017 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b49626-4f3b-44d2-b98d-898b194727d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=108fd0267b46498ca13a12766aa9e973)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:27.808945 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b49626-4f3b-44d2-b98d-898b194727d4 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:27.810491 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 899/1806] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:27.812083 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db27a4-3ca2-4986-9714-9ab08c21052e service placement] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:27.824955 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db27a4-3ca2-4986-9714-9ab08c21052e service placement] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:27.831601 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e1e67-9f2d-4251-801a-3413b2845897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:27.833261 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e1e67-9f2d-4251-801a-3413b2845897 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:27.834077 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e1e67-9f2d-4251-801a-3413b2845897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:27.834077 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e1e67-9f2d-4251-801a-3413b2845897 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:27.835033 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e1e67-9f2d-4251-801a-3413b2845897 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:27.840068 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e1e67-9f2d-4251-801a-3413b2845897 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:27.887713 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:27.908159 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 900/1807] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:56:27 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:27.909306 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e1e67-9f2d-4251-801a-3413b2845897 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:27.926722 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-24b49626-4f3b-44d2-b98d-898b194727d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '108fd0267b46498ca13a12766aa9e973', 'request_id': 'req-24b49626-4f3b-44d2-b98d-898b194727d4'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:27.943446 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-24b49626-4f3b-44d2-b98d-898b194727d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '108fd0267b46498ca13a12766aa9e973', 'request_id': 'req-24b49626-4f3b-44d2-b98d-898b194727d4'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:27.958816 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-24b49626-4f3b-44d2-b98d-898b194727d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '108fd0267b46498ca13a12766aa9e973', 'request_id': 'req-24b49626-4f3b-44d2-b98d-898b194727d4'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:27.963151 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:27.979954 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-24b49626-4f3b-44d2-b98d-898b194727d4 admin admin] The token cache is being invalidate because project 108fd0267b46498ca13a12766aa9e973 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:56:27.980480 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-24b49626-4f3b-44d2-b98d-898b194727d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:27.986582 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-24b49626-4f3b-44d2-b98d-898b194727d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:27.988218 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 908/1808] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:56:27 2022] DELETE /identity/v3/projects/108fd0267b46498ca13a12766aa9e973 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:27.989005 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b49626-4f3b-44d2-b98d-898b194727d4 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:27.990393 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-24b49626-4f3b-44d2-b98d-898b194727d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:28.030831 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e1e67-9f2d-4251-801a-3413b2845897 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:28.050717 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690736a7-4d6e-4f74-b9ea-ad841b706606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:28.051837 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690736a7-4d6e-4f74-b9ea-ad841b706606 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:28.052124 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690736a7-4d6e-4f74-b9ea-ad841b706606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:28.052443 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690736a7-4d6e-4f74-b9ea-ad841b706606 admin admin] PATH_INFO: `/v3/projects/acdcad04994a4d5ba46576f222a1558b/users/9bc5ac0622fd4ebb8c41eefd69f0272c/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:28.065292 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690736a7-4d6e-4f74-b9ea-ad841b706606 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acdcad04994a4d5ba46576f222a1558b, user_id=9bc5ac0622fd4ebb8c41eefd69f0272c, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:28.076210 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690736a7-4d6e-4f74-b9ea-ad841b706606 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:28.116522 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 901/1809] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:27 2022] PUT /identity/v3/projects/acdcad04994a4d5ba46576f222a1558b/users/9bc5ac0622fd4ebb8c41eefd69f0272c/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:28.125480 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690736a7-4d6e-4f74-b9ea-ad841b706606 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:28.135260 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-690736a7-4d6e-4f74-b9ea-ad841b706606 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:28.155670 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b49626-4f3b-44d2-b98d-898b194727d4 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:28.292678 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690736a7-4d6e-4f74-b9ea-ad841b706606 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:28.303652 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9b009-4832-4a00-9a4c-b2e87cb34c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:28.304486 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9b009-4832-4a00-9a4c-b2e87cb34c07 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:28.304748 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9b009-4832-4a00-9a4c-b2e87cb34c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:28.305100 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9b009-4832-4a00-9a4c-b2e87cb34c07 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:28.306575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad9b009-4832-4a00-9a4c-b2e87cb34c07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:28.311093 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad9b009-4832-4a00-9a4c-b2e87cb34c07 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:28.357440 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c831a-d8da-4fe7-aa8d-2655d0a85f69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:28.358679 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 902/1810] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:56:28 2022] POST /identity/v3/users => generated 291 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:28.359648 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9b009-4832-4a00-9a4c-b2e87cb34c07 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:28.363026 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-6ad9b009-4832-4a00-9a4c-b2e87cb34c07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:28.368317 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c831a-d8da-4fe7-aa8d-2655d0a85f69 service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:28.368610 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c831a-d8da-4fe7-aa8d-2655d0a85f69 service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:28.368887 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c831a-d8da-4fe7-aa8d-2655d0a85f69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:28.381387 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-6f9c831a-d8da-4fe7-aa8d-2655d0a85f69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:28.399687 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9b009-4832-4a00-9a4c-b2e87cb34c07 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:28.414850 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf00c88a-090e-4573-a008-06f015629d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:28.416649 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00c88a-090e-4573-a008-06f015629d5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:28.417215 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00c88a-090e-4573-a008-06f015629d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:28.417605 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00c88a-090e-4573-a008-06f015629d5d admin admin] PATH_INFO: `/v3/users/f762573928fb40b9a63c143aecd33225` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:28.419752 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf00c88a-090e-4573-a008-06f015629d5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f762573928fb40b9a63c143aecd33225)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:28.422252 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf00c88a-090e-4573-a008-06f015629d5d admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:28.545200 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-bf00c88a-090e-4573-a008-06f015629d5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f762573928fb40b9a63c143aecd33225'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:28.558606 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-bf00c88a-090e-4573-a008-06f015629d5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f762573928fb40b9a63c143aecd33225'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:28.559443 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-bf00c88a-090e-4573-a008-06f015629d5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f762573928fb40b9a63c143aecd33225'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:28.570968 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-bf00c88a-090e-4573-a008-06f015629d5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f762573928fb40b9a63c143aecd33225'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:28.573954 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-bf00c88a-090e-4573-a008-06f015629d5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f762573928fb40b9a63c143aecd33225'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:28.622867 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 903/1811] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:56:28 2022] DELETE /identity/v3/users/f762573928fb40b9a63c143aecd33225 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:28.628423 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8fa111-1179-4d50-96e9-18056e60f59c None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:28.629043 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8fa111-1179-4d50-96e9-18056e60f59c None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:28.629760 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8fa111-1179-4d50-96e9-18056e60f59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:28.732517 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-9c8fa111-1179-4d50-96e9-18056e60f59c None None] MFA Rules not processed for user `9bc5ac0622fd4ebb8c41eefd69f0272c`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:28.741889 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-9c8fa111-1179-4d50-96e9-18056e60f59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:28.749764 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c831a-d8da-4fe7-aa8d-2655d0a85f69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:28.755828 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c831a-d8da-4fe7-aa8d-2655d0a85f69 service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:28.768229 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:28.792080 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 909/1812] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:27 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 803 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:28.793072 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c831a-d8da-4fe7-aa8d-2655d0a85f69 service cinder] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:28.808559 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c831a-d8da-4fe7-aa8d-2655d0a85f69 service cinder] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:28.841570 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 904/1813] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:28 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:28.845854 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:28.853404 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8fa111-1179-4d50-96e9-18056e60f59c None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:28.855969 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-9c8fa111-1179-4d50-96e9-18056e60f59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:28.944452 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89281368-0977-44bf-b141-3bf04a6e553a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:28.947634 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89281368-0977-44bf-b141-3bf04a6e553a admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:28.947940 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89281368-0977-44bf-b141-3bf04a6e553a admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:28.948557 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89281368-0977-44bf-b141-3bf04a6e553a admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:28.949398 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89281368-0977-44bf-b141-3bf04a6e553a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:28.955069 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89281368-0977-44bf-b141-3bf04a6e553a admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:29.011145 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 910/1814] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:29.015407 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89281368-0977-44bf-b141-3bf04a6e553a admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:29.038629 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-89281368-0977-44bf-b141-3bf04a6e553a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:29.045170 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8fa111-1179-4d50-96e9-18056e60f59c None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:29.057932 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc7918-f98c-4d51-ae02-a76672d66396 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:29.059172 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc7918-f98c-4d51-ae02-a76672d66396 service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:29.059785 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc7918-f98c-4d51-ae02-a76672d66396 service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:29.060234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc7918-f98c-4d51-ae02-a76672d66396 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:29.088728 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89281368-0977-44bf-b141-3bf04a6e553a admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:29.097631 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdc7918-f98c-4d51-ae02-a76672d66396 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:29.101967 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdc7918-f98c-4d51-ae02-a76672d66396 service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:29.109774 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70990a78-5956-484e-a5ab-2dde009b4cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:29.112408 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70990a78-5956-484e-a5ab-2dde009b4cff admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:29.114771 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70990a78-5956-484e-a5ab-2dde009b4cff admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:29.115095 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70990a78-5956-484e-a5ab-2dde009b4cff admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:29.119154 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70990a78-5956-484e-a5ab-2dde009b4cff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:29.133443 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70990a78-5956-484e-a5ab-2dde009b4cff admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:29.159648 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 905/1815] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:28 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:29.199280 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc7918-f98c-4d51-ae02-a76672d66396 service cinder] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:29.201031 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 911/1816] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:29.248634 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc7918-f98c-4d51-ae02-a76672d66396 service cinder] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:29.275968 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6007767a-eae3-40b0-a1d4-5ea183912dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:29.277433 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007767a-eae3-40b0-a1d4-5ea183912dc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:29.277836 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007767a-eae3-40b0-a1d4-5ea183912dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:29.288165 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70990a78-5956-484e-a5ab-2dde009b4cff admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:29.293063 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007767a-eae3-40b0-a1d4-5ea183912dc8 admin admin] PATH_INFO: `/v3/projects/b9f4d378c43a410d9b448693cd435da4/users/6f95f220c68c4992b4cd515065f96699/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:29.293656 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-70990a78-5956-484e-a5ab-2dde009b4cff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:29.352851 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70990a78-5956-484e-a5ab-2dde009b4cff admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:29.366950 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c187df2d-6add-4a86-8e04-b5ad21b6df74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:29.369957 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187df2d-6add-4a86-8e04-b5ad21b6df74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:29.371825 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187df2d-6add-4a86-8e04-b5ad21b6df74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:29.372192 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187df2d-6add-4a86-8e04-b5ad21b6df74 admin admin] PATH_INFO: `/v3/users/a9826fc308fa47c1b4c858fb70d8aa3b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:29.373981 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6007767a-eae3-40b0-a1d4-5ea183912dc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9f4d378c43a410d9b448693cd435da4, user_id=6f95f220c68c4992b4cd515065f96699, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:29.376955 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c187df2d-6add-4a86-8e04-b5ad21b6df74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9826fc308fa47c1b4c858fb70d8aa3b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:29.379400 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c187df2d-6add-4a86-8e04-b5ad21b6df74 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:29.382998 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6007767a-eae3-40b0-a1d4-5ea183912dc8 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:29.437540 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 906/1817] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:29 2022] PUT /identity/v3/projects/b9f4d378c43a410d9b448693cd435da4/users/6f95f220c68c4992b4cd515065f96699/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:29.439997 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d4707-e596-4cb5-80cf-c2d8d2d68126 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:29.440215 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d4707-e596-4cb5-80cf-c2d8d2d68126 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:29.440471 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d4707-e596-4cb5-80cf-c2d8d2d68126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:29.516407 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-5e2d4707-e596-4cb5-80cf-c2d8d2d68126 None None] MFA Rules not processed for user `6f95f220c68c4992b4cd515065f96699`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:29.517893 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-5e2d4707-e596-4cb5-80cf-c2d8d2d68126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:29.616783 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-c187df2d-6add-4a86-8e04-b5ad21b6df74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9826fc308fa47c1b4c858fb70d8aa3b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:29.632670 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-c187df2d-6add-4a86-8e04-b5ad21b6df74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9826fc308fa47c1b4c858fb70d8aa3b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:29.636820 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-c187df2d-6add-4a86-8e04-b5ad21b6df74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9826fc308fa47c1b4c858fb70d8aa3b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:29.663179 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 907/1818] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:29.670981 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba86516f-ab5a-4995-af46-394570958077 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:29.671514 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba86516f-ab5a-4995-af46-394570958077 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:29.671633 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba86516f-ab5a-4995-af46-394570958077 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:29.673421 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 908/1819] 10.222.0.16 () {54 vars in 921 bytes} [Wed Sep 7 15:56:29 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:29.674222 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba86516f-ab5a-4995-af46-394570958077 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:29.679589 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-ba86516f-ab5a-4995-af46-394570958077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:29.681634 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-c187df2d-6add-4a86-8e04-b5ad21b6df74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9826fc308fa47c1b4c858fb70d8aa3b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:29.683095 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-c187df2d-6add-4a86-8e04-b5ad21b6df74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9826fc308fa47c1b4c858fb70d8aa3b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:29.709654 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 912/1820] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:56:29 2022] DELETE /identity/v3/users/a9826fc308fa47c1b4c858fb70d8aa3b => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:29.713907 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7af258-0af3-4460-8922-40167dec52fb None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:29.714437 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7af258-0af3-4460-8922-40167dec52fb None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:29.714541 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7af258-0af3-4460-8922-40167dec52fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:29.759857 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:29.769816 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-be7af258-0af3-4460-8922-40167dec52fb None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:29.774941 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-be7af258-0af3-4460-8922-40167dec52fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:29.872892 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba86516f-ab5a-4995-af46-394570958077 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:29.985658 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 913/1821] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 15:56:29.986576 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7af258-0af3-4460-8922-40167dec52fb None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:29.999236 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-be7af258-0af3-4460-8922-40167dec52fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:30.036897 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7af258-0af3-4460-8922-40167dec52fb None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:30.052620 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19085ca7-52d3-4cb8-a5bb-ddd52673b252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:30.053152 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19085ca7-52d3-4cb8-a5bb-ddd52673b252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:30.053433 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19085ca7-52d3-4cb8-a5bb-ddd52673b252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:30.053709 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19085ca7-52d3-4cb8-a5bb-ddd52673b252 admin admin] PATH_INFO: `/v3/projects/1129c7b8c3d0414da3880decc5258301` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:30.055250 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19085ca7-52d3-4cb8-a5bb-ddd52673b252 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1129c7b8c3d0414da3880decc5258301)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:30.058134 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19085ca7-52d3-4cb8-a5bb-ddd52673b252 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:30.063570 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa0b4a-9da3-475a-b93e-384fd2b4c404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:30.064204 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa0b4a-9da3-475a-b93e-384fd2b4c404 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:30.064490 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa0b4a-9da3-475a-b93e-384fd2b4c404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:30.064761 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa0b4a-9da3-475a-b93e-384fd2b4c404 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:30.065397 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fa0b4a-9da3-475a-b93e-384fd2b4c404 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:30.079894 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fa0b4a-9da3-475a-b93e-384fd2b4c404 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:30.149261 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:30.161315 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 909/1822] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:56:29 2022] POST /identity/v3/projects => generated 381 bytes in 487 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:30.162525 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa0b4a-9da3-475a-b93e-384fd2b4c404 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:30.179466 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-87fa0b4a-9da3-475a-b93e-384fd2b4c404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:30.273211 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-19085ca7-52d3-4cb8-a5bb-ddd52673b252 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1129c7b8c3d0414da3880decc5258301', 'request_id': 'req-19085ca7-52d3-4cb8-a5bb-ddd52673b252'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:30.292014 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-19085ca7-52d3-4cb8-a5bb-ddd52673b252 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1129c7b8c3d0414da3880decc5258301', 'request_id': 'req-19085ca7-52d3-4cb8-a5bb-ddd52673b252'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:30.311037 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-19085ca7-52d3-4cb8-a5bb-ddd52673b252 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1129c7b8c3d0414da3880decc5258301', 'request_id': 'req-19085ca7-52d3-4cb8-a5bb-ddd52673b252'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:30.356374 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-19085ca7-52d3-4cb8-a5bb-ddd52673b252 admin admin] The token cache is being invalidate because project 1129c7b8c3d0414da3880decc5258301 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:56:30.356698 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-19085ca7-52d3-4cb8-a5bb-ddd52673b252 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:30.360575 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-19085ca7-52d3-4cb8-a5bb-ddd52673b252 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:30.363393 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa0b4a-9da3-475a-b93e-384fd2b4c404 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:30.368357 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 914/1823] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:56:29 2022] DELETE /identity/v3/projects/1129c7b8c3d0414da3880decc5258301 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:30.368357 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5bad4-87f4-48c3-942f-0c3edf5b8521 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:30.368357 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5bad4-87f4-48c3-942f-0c3edf5b8521 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:30.370454 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5bad4-87f4-48c3-942f-0c3edf5b8521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:30.404689 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-bff5bad4-87f4-48c3-942f-0c3edf5b8521 None None] MFA Rules not processed for user `66c270b488024605af84e52d874474e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:30.406007 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-bff5bad4-87f4-48c3-942f-0c3edf5b8521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:30.507988 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4915858-c564-4b01-963d-dc16e4f53168 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:30.508624 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4915858-c564-4b01-963d-dc16e4f53168 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:30.508948 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4915858-c564-4b01-963d-dc16e4f53168 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:30.509227 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4915858-c564-4b01-963d-dc16e4f53168 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:30.525638 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-d4915858-c564-4b01-963d-dc16e4f53168 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:30.551250 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 915/1824] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Sep 7 15:56:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:30.552384 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5bad4-87f4-48c3-942f-0c3edf5b8521 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:30.553819 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-bff5bad4-87f4-48c3-942f-0c3edf5b8521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:30.628998 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5bad4-87f4-48c3-942f-0c3edf5b8521 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:30.635617 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d48eb6-799c-46e2-8b68-fec04106e7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:30.636264 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:30.638579 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d48eb6-799c-46e2-8b68-fec04106e7f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:30.638733 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d48eb6-799c-46e2-8b68-fec04106e7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:30.639004 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d48eb6-799c-46e2-8b68-fec04106e7f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:30.639652 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d48eb6-799c-46e2-8b68-fec04106e7f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:30.641974 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d48eb6-799c-46e2-8b68-fec04106e7f6 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:30.689377 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 916/1825] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:56:30 2022] POST /identity/v3/users => generated 297 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:30.695249 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3921e4-597d-42ab-a1b9-87c43259d32d None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:30.695530 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3921e4-597d-42ab-a1b9-87c43259d32d None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:30.695804 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3921e4-597d-42ab-a1b9-87c43259d32d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:30.727337 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4915858-c564-4b01-963d-dc16e4f53168 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:30.729249 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4915858-c564-4b01-963d-dc16e4f53168 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:30.741366 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-5c3921e4-597d-42ab-a1b9-87c43259d32d None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:30.743614 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-5c3921e4-597d-42ab-a1b9-87c43259d32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:30.750773 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 910/1826] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:30.752660 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34971a3-4d8b-4df5-a7b8-51abea92bda4 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:30.752944 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34971a3-4d8b-4df5-a7b8-51abea92bda4 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:30.753219 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34971a3-4d8b-4df5-a7b8-51abea92bda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:30.769474 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 917/1827] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:30.769474 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3921e4-597d-42ab-a1b9-87c43259d32d None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:30.769474 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-5c3921e4-597d-42ab-a1b9-87c43259d32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:30.809860 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3921e4-597d-42ab-a1b9-87c43259d32d None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:30.823056 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed62c48-4496-4081-9177-e2bd4c8bebf7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c270b488024605af84e52d874474e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:30.823684 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed62c48-4496-4081-9177-e2bd4c8bebf7 service placement] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:30.823965 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed62c48-4496-4081-9177-e2bd4c8bebf7 service placement] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:30.826283 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed62c48-4496-4081-9177-e2bd4c8bebf7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:30.850021 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed62c48-4496-4081-9177-e2bd4c8bebf7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:30.855546 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed62c48-4496-4081-9177-e2bd4c8bebf7 service placement] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:30.891216 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-b34971a3-4d8b-4df5-a7b8-51abea92bda4 None None] MFA Rules not processed for user `3e20e40a37df4898bfe692535e5e4f25`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:30.893788 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 918/1828] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:30.895605 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed62c48-4496-4081-9177-e2bd4c8bebf7 service placement] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:30.895919 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b34971a3-4d8b-4df5-a7b8-51abea92bda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:30.922064 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed62c48-4496-4081-9177-e2bd4c8bebf7 service placement] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:30.936077 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa74d3-d7b6-4467-8144-ef046ad2cfd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:30.938113 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa74d3-d7b6-4467-8144-ef046ad2cfd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:30.938420 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa74d3-d7b6-4467-8144-ef046ad2cfd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:30.938691 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa74d3-d7b6-4467-8144-ef046ad2cfd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:30.941259 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fa74d3-d7b6-4467-8144-ef046ad2cfd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:30.945793 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fa74d3-d7b6-4467-8144-ef046ad2cfd6 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:30.972445 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 919/1829] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:30.976657 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff341d-abd8-4feb-90e9-f4df5bcb19e2 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:30.976657 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff341d-abd8-4feb-90e9-f4df5bcb19e2 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:30.976657 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff341d-abd8-4feb-90e9-f4df5bcb19e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:31.019392 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:31.081871 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-caff341d-abd8-4feb-90e9-f4df5bcb19e2 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:31.084193 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-caff341d-abd8-4feb-90e9-f4df5bcb19e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:31.130747 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 911/1830] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Sep 7 15:56:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:31.131910 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34971a3-4d8b-4df5-a7b8-51abea92bda4 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:31.139694 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 920/1831] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:31.143651 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff341d-abd8-4feb-90e9-f4df5bcb19e2 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:31.165629 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34971a3-4d8b-4df5-a7b8-51abea92bda4 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:31.168638 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff341d-abd8-4feb-90e9-f4df5bcb19e2 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:31.186592 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19debc1-87e9-4eff-a111-87977846afe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:31.191747 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19debc1-87e9-4eff-a111-87977846afe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:31.192419 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19debc1-87e9-4eff-a111-87977846afe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:31.192551 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19debc1-87e9-4eff-a111-87977846afe7 admin admin] PATH_INFO: `/v3/projects/58425c686bac4320a299337627c44a88/users/a4ae908ab99940689d22bd94563ea511/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:31.193456 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5efc63-ea75-4e01-aef5-b7cfb0fada18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:31.197712 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5efc63-ea75-4e01-aef5-b7cfb0fada18 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:31.197994 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5efc63-ea75-4e01-aef5-b7cfb0fada18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:31.198307 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5efc63-ea75-4e01-aef5-b7cfb0fada18 admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:31.203016 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5efc63-ea75-4e01-aef5-b7cfb0fada18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:31.207631 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5efc63-ea75-4e01-aef5-b7cfb0fada18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:31.209299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5efc63-ea75-4e01-aef5-b7cfb0fada18 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:31.234148 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19debc1-87e9-4eff-a111-87977846afe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58425c686bac4320a299337627c44a88, user_id=a4ae908ab99940689d22bd94563ea511, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:31.238686 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19debc1-87e9-4eff-a111-87977846afe7 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:31.250448 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 921/1832] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 15:56:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:31.251441 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5efc63-ea75-4e01-aef5-b7cfb0fada18 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:31.270256 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5efc63-ea75-4e01-aef5-b7cfb0fada18 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:31.286666 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 912/1833] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:31 2022] PUT /identity/v3/projects/58425c686bac4320a299337627c44a88/users/a4ae908ab99940689d22bd94563ea511/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:31.291615 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19debc1-87e9-4eff-a111-87977846afe7 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:31.474922 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b304d7-0e40-4dcd-a718-55abf7db0586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:31.475558 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b304d7-0e40-4dcd-a718-55abf7db0586 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:31.475839 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b304d7-0e40-4dcd-a718-55abf7db0586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:31.476160 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b304d7-0e40-4dcd-a718-55abf7db0586 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:31.477000 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b304d7-0e40-4dcd-a718-55abf7db0586 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:31.479709 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b304d7-0e40-4dcd-a718-55abf7db0586 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:31.546403 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19debc1-87e9-4eff-a111-87977846afe7 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:31.567949 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 922/1834] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:56:31 2022] POST /identity/v3/projects => generated 381 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:31.567949 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b304d7-0e40-4dcd-a718-55abf7db0586 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:31.572148 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20514a2d-83f3-4a4a-97e5-625571389405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:31.572860 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20514a2d-83f3-4a4a-97e5-625571389405 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:31.573149 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20514a2d-83f3-4a4a-97e5-625571389405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:31.573423 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20514a2d-83f3-4a4a-97e5-625571389405 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:31.576467 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20514a2d-83f3-4a4a-97e5-625571389405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:31.578855 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-22b304d7-0e40-4dcd-a718-55abf7db0586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:31.586589 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20514a2d-83f3-4a4a-97e5-625571389405 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:31.631382 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 913/1835] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:31.644520 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20514a2d-83f3-4a4a-97e5-625571389405 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:31.669612 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:31.684455 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20514a2d-83f3-4a4a-97e5-625571389405 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:31.817816 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b304d7-0e40-4dcd-a718-55abf7db0586 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:31.819785 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad5794-0ef7-4e1f-98bf-d46e60268c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:31.820462 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad5794-0ef7-4e1f-98bf-d46e60268c57 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:31.820754 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad5794-0ef7-4e1f-98bf-d46e60268c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:31.821073 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad5794-0ef7-4e1f-98bf-d46e60268c57 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:31.822001 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad5794-0ef7-4e1f-98bf-d46e60268c57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:31.824767 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad5794-0ef7-4e1f-98bf-d46e60268c57 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:31.839743 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca1afd-d9c0-4e77-87c4-299c25c3c449 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16c4b090a4aa4d56a90ccf090b9caba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:31.840485 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca1afd-d9c0-4e77-87c4-299c25c3c449 service swift] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:31.840953 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca1afd-d9c0-4e77-87c4-299c25c3c449 service swift] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:31.841314 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca1afd-d9c0-4e77-87c4-299c25c3c449 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:31.873444 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 914/1836] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:56:31 2022] POST /identity/v3/users => generated 291 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:31.874961 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad5794-0ef7-4e1f-98bf-d46e60268c57 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:31.899517 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad5794-0ef7-4e1f-98bf-d46e60268c57 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:31.914975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4acdc-f84e-4e97-93e6-8a939056b0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:31.916198 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4acdc-f84e-4e97-93e6-8a939056b0b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:31.916476 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4acdc-f84e-4e97-93e6-8a939056b0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:31.916753 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4acdc-f84e-4e97-93e6-8a939056b0b6 admin admin] PATH_INFO: `/v3/projects/58425c686bac4320a299337627c44a88/users/a4ae908ab99940689d22bd94563ea511/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:31.921530 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd4acdc-f84e-4e97-93e6-8a939056b0b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58425c686bac4320a299337627c44a88, user_id=a4ae908ab99940689d22bd94563ea511, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:31.924488 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd4acdc-f84e-4e97-93e6-8a939056b0b6 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:31.934075 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:31.967943 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 915/1837] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:31 2022] PUT /identity/v3/projects/58425c686bac4320a299337627c44a88/users/a4ae908ab99940689d22bd94563ea511/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:31.969169 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4acdc-f84e-4e97-93e6-8a939056b0b6 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:31.975354 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ca1afd-d9c0-4e77-87c4-299c25c3c449 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:31.977456 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ca1afd-d9c0-4e77-87c4-299c25c3c449 service swift] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:32.001487 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 923/1838] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Sep 7 15:56:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 15:56:32.003014 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385c775-8d03-42ea-af0c-a072de84e78b None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:32.003301 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385c775-8d03-42ea-af0c-a072de84e78b None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:32.003580 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385c775-8d03-42ea-af0c-a072de84e78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:32.076665 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-1385c775-8d03-42ea-af0c-a072de84e78b None None] MFA Rules not processed for user `a4ae908ab99940689d22bd94563ea511`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:32.079977 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-1385c775-8d03-42ea-af0c-a072de84e78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:32.244846 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4acdc-f84e-4e97-93e6-8a939056b0b6 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:32.273141 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f746ff-e4b3-4a81-a72b-86a23337bf73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:32.276283 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f746ff-e4b3-4a81-a72b-86a23337bf73 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:32.276575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f746ff-e4b3-4a81-a72b-86a23337bf73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:32.276879 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f746ff-e4b3-4a81-a72b-86a23337bf73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:32.277548 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f746ff-e4b3-4a81-a72b-86a23337bf73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:32.294149 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f746ff-e4b3-4a81-a72b-86a23337bf73 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:32.355812 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 916/1839] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:32.356650 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f746ff-e4b3-4a81-a72b-86a23337bf73 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:32.367129 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-71f746ff-e4b3-4a81-a72b-86a23337bf73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:32.426026 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 924/1840] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:32 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:32.427586 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1385c775-8d03-42ea-af0c-a072de84e78b None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:32.441879 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f746ff-e4b3-4a81-a72b-86a23337bf73 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:32.469743 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1385c775-8d03-42ea-af0c-a072de84e78b None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:32.470893 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8344c-aecf-45e3-a937-e7fc148b2059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:32.471556 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8344c-aecf-45e3-a937-e7fc148b2059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:32.471826 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8344c-aecf-45e3-a937-e7fc148b2059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:32.472103 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8344c-aecf-45e3-a937-e7fc148b2059 admin admin] PATH_INFO: `/v3/projects/84be9af1e39d4c80b8b8ae4e86e7a1cc` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:32.484185 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2daf93a-11f6-4d5b-ba13-16ee3e18ff0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:32.484869 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2daf93a-11f6-4d5b-ba13-16ee3e18ff0c admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:32.485202 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2daf93a-11f6-4d5b-ba13-16ee3e18ff0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:32.485354 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2daf93a-11f6-4d5b-ba13-16ee3e18ff0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:32.486017 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2daf93a-11f6-4d5b-ba13-16ee3e18ff0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:32.487874 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b8344c-aecf-45e3-a937-e7fc148b2059 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84be9af1e39d4c80b8b8ae4e86e7a1cc)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:32.490560 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2daf93a-11f6-4d5b-ba13-16ee3e18ff0c admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:32.500844 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b8344c-aecf-45e3-a937-e7fc148b2059 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:32.513134 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 925/1841] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:32 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:32.513956 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2daf93a-11f6-4d5b-ba13-16ee3e18ff0c admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:32.526761 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-f2daf93a-11f6-4d5b-ba13-16ee3e18ff0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:32.662153 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2daf93a-11f6-4d5b-ba13-16ee3e18ff0c admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:32.766045 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-04b8344c-aecf-45e3-a937-e7fc148b2059 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84be9af1e39d4c80b8b8ae4e86e7a1cc', 'request_id': 'req-04b8344c-aecf-45e3-a937-e7fc148b2059'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:32.770757 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054722df-7ef7-4648-b44e-f4f592898343 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:32.771498 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054722df-7ef7-4648-b44e-f4f592898343 service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:32.771787 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054722df-7ef7-4648-b44e-f4f592898343 service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:32.772198 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054722df-7ef7-4648-b44e-f4f592898343 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:32.792726 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-04b8344c-aecf-45e3-a937-e7fc148b2059 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84be9af1e39d4c80b8b8ae4e86e7a1cc', 'request_id': 'req-04b8344c-aecf-45e3-a937-e7fc148b2059'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:32.819122 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-04b8344c-aecf-45e3-a937-e7fc148b2059 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84be9af1e39d4c80b8b8ae4e86e7a1cc', 'request_id': 'req-04b8344c-aecf-45e3-a937-e7fc148b2059'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:32.852998 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:32.859255 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:32.880216 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-04b8344c-aecf-45e3-a937-e7fc148b2059 admin admin] The token cache is being invalidate because project 84be9af1e39d4c80b8b8ae4e86e7a1cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:56:32.885249 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-04b8344c-aecf-45e3-a937-e7fc148b2059 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:32.886778 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-04b8344c-aecf-45e3-a937-e7fc148b2059 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:32.890469 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 917/1842] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:56:32 2022] DELETE /identity/v3/projects/84be9af1e39d4c80b8b8ae4e86e7a1cc => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:32.891492 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8344c-aecf-45e3-a937-e7fc148b2059 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:32.901158 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-04b8344c-aecf-45e3-a937-e7fc148b2059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:32.928529 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054722df-7ef7-4648-b44e-f4f592898343 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:32.935761 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054722df-7ef7-4648-b44e-f4f592898343 service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:32.967574 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 926/1843] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:32 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:32.970453 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054722df-7ef7-4648-b44e-f4f592898343 service cinder] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:33.124287 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8344c-aecf-45e3-a937-e7fc148b2059 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:33.138266 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b16ce-05aa-4ccd-ab67-b8f264ecf259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:33.138976 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b16ce-05aa-4ccd-ab67-b8f264ecf259 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:33.139265 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b16ce-05aa-4ccd-ab67-b8f264ecf259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:33.139547 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b16ce-05aa-4ccd-ab67-b8f264ecf259 admin admin] PATH_INFO: `/v3/projects/3b547235a60a422a8a941fddadc97594/users/77ebdb33e3c442e5abfb602ccca8c419/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:33.173898 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054722df-7ef7-4648-b44e-f4f592898343 service cinder] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:33.191556 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4af40-8de4-4cca-8414-b2653ab8232a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:33.192537 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4af40-8de4-4cca-8414-b2653ab8232a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:33.193004 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4af40-8de4-4cca-8414-b2653ab8232a admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:33.193423 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4af40-8de4-4cca-8414-b2653ab8232a admin admin] PATH_INFO: `/v3/users/9bc5ac0622fd4ebb8c41eefd69f0272c` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:33.196607 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd4af40-8de4-4cca-8414-b2653ab8232a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bc5ac0622fd4ebb8c41eefd69f0272c)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:33.202833 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd4af40-8de4-4cca-8414-b2653ab8232a admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:33.212429 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64b16ce-05aa-4ccd-ab67-b8f264ecf259 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b547235a60a422a8a941fddadc97594, user_id=77ebdb33e3c442e5abfb602ccca8c419, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:33.215081 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64b16ce-05aa-4ccd-ab67-b8f264ecf259 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:33.265520 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 918/1844] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:32 2022] PUT /identity/v3/projects/3b547235a60a422a8a941fddadc97594/users/77ebdb33e3c442e5abfb602ccca8c419/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:33.277255 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f26a7-92a9-4e34-8f1e-f0ee9c7e3ac4 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:33.277537 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f26a7-92a9-4e34-8f1e-f0ee9c7e3ac4 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:33.277821 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f26a7-92a9-4e34-8f1e-f0ee9c7e3ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:33.338254 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-8dd4af40-8de4-4cca-8414-b2653ab8232a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bc5ac0622fd4ebb8c41eefd69f0272c'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:33.353371 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-8dd4af40-8de4-4cca-8414-b2653ab8232a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bc5ac0622fd4ebb8c41eefd69f0272c'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:33.353936 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-9b9f26a7-92a9-4e34-8f1e-f0ee9c7e3ac4 None None] MFA Rules not processed for user `77ebdb33e3c442e5abfb602ccca8c419`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:33.354410 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-8dd4af40-8de4-4cca-8414-b2653ab8232a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bc5ac0622fd4ebb8c41eefd69f0272c'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:33.355242 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-9b9f26a7-92a9-4e34-8f1e-f0ee9c7e3ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:33.390629 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-8dd4af40-8de4-4cca-8414-b2653ab8232a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bc5ac0622fd4ebb8c41eefd69f0272c'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:33.391796 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-8dd4af40-8de4-4cca-8414-b2653ab8232a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bc5ac0622fd4ebb8c41eefd69f0272c'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:33.434549 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 927/1845] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:56:32 2022] DELETE /identity/v3/users/9bc5ac0622fd4ebb8c41eefd69f0272c => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:33.597739 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 919/1846] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 15:56:33.597966 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4af40-8de4-4cca-8414-b2653ab8232a admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:33.597966 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-8dd4af40-8de4-4cca-8414-b2653ab8232a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:33.790986 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:33.862612 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4af40-8de4-4cca-8414-b2653ab8232a admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:33.896950 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9440e656-4f61-42a7-bb15-b59dbb4fee93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:33.898203 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440e656-4f61-42a7-bb15-b59dbb4fee93 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:33.898786 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440e656-4f61-42a7-bb15-b59dbb4fee93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:33.899992 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440e656-4f61-42a7-bb15-b59dbb4fee93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:33.906023 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9440e656-4f61-42a7-bb15-b59dbb4fee93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:33.913416 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9440e656-4f61-42a7-bb15-b59dbb4fee93 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:34.001157 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 928/1847] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:56:33 2022] POST /identity/v3/projects => generated 379 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:34.005624 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f26a7-92a9-4e34-8f1e-f0ee9c7e3ac4 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:34.121754 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f26a7-92a9-4e34-8f1e-f0ee9c7e3ac4 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:34.122452 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9440e656-4f61-42a7-bb15-b59dbb4fee93 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:34.124861 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-9440e656-4f61-42a7-bb15-b59dbb4fee93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:34.167403 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:34.229662 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb59d2-bff8-41a1-b702-dc20db621f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:34.230688 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb59d2-bff8-41a1-b702-dc20db621f3f admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:34.231307 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb59d2-bff8-41a1-b702-dc20db621f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:34.232365 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb59d2-bff8-41a1-b702-dc20db621f3f admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:34.234746 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cb59d2-bff8-41a1-b702-dc20db621f3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:34.237004 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cb59d2-bff8-41a1-b702-dc20db621f3f admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:34.280207 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 920/1848] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:56:34 2022] POST /identity/v3/users => generated 296 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:34.284599 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb59d2-bff8-41a1-b702-dc20db621f3f admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:34.301592 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb59d2-bff8-41a1-b702-dc20db621f3f admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:34.309685 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e9062-a22d-4c47-b07f-c86f8991ee4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:34.310410 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e9062-a22d-4c47-b07f-c86f8991ee4c admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:34.310736 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e9062-a22d-4c47-b07f-c86f8991ee4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:34.311060 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e9062-a22d-4c47-b07f-c86f8991ee4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:34.311818 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e9062-a22d-4c47-b07f-c86f8991ee4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:34.313961 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e9062-a22d-4c47-b07f-c86f8991ee4c admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:34.328569 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9440e656-4f61-42a7-bb15-b59dbb4fee93 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:34.331424 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 921/1849] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:34.338046 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e9062-a22d-4c47-b07f-c86f8991ee4c admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:34.346956 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069e3c4-82e2-4a23-ab77-c2721b08a496 tempest-VolumeQuotaClassesTest-1332278305 tempest-VolumeQuotaClassesTest-1332278305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4ae908ab99940689d22bd94563ea511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58425c686bac4320a299337627c44a88', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:34.347676 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069e3c4-82e2-4a23-ab77-c2721b08a496 tempest-VolumeQuotaClassesTest-1332278305 tempest-VolumeQuotaClassesTest-1332278305-project-admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:34.347888 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069e3c4-82e2-4a23-ab77-c2721b08a496 tempest-VolumeQuotaClassesTest-1332278305 tempest-VolumeQuotaClassesTest-1332278305-project-admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:34.348227 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069e3c4-82e2-4a23-ab77-c2721b08a496 tempest-VolumeQuotaClassesTest-1332278305 tempest-VolumeQuotaClassesTest-1332278305-project-admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:34.348823 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6069e3c4-82e2-4a23-ab77-c2721b08a496 tempest-VolumeQuotaClassesTest-1332278305 tempest-VolumeQuotaClassesTest-1332278305-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:34.349227 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6069e3c4-82e2-4a23-ab77-c2721b08a496 tempest-VolumeQuotaClassesTest-1332278305 tempest-VolumeQuotaClassesTest-1332278305-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:34.351104 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6069e3c4-82e2-4a23-ab77-c2721b08a496 tempest-VolumeQuotaClassesTest-1332278305 tempest-VolumeQuotaClassesTest-1332278305-project-admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:34.369869 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e9062-a22d-4c47-b07f-c86f8991ee4c admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:34.380217 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 929/1850] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 15:56:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:34.385754 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069e3c4-82e2-4a23-ab77-c2721b08a496 tempest-VolumeQuotaClassesTest-1332278305 tempest-VolumeQuotaClassesTest-1332278305-project-admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:34.385936 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c31a00-74fc-4415-848b-9f8d7f83d0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:34.386907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c31a00-74fc-4415-848b-9f8d7f83d0f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:34.387188 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c31a00-74fc-4415-848b-9f8d7f83d0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:34.387462 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c31a00-74fc-4415-848b-9f8d7f83d0f0 admin admin] PATH_INFO: `/v3/projects/c9856246c0f146c29846f2734ebff9c0/users/4eda431653284b4a8bbbef0d5b6af7c1/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:34.417717 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069e3c4-82e2-4a23-ab77-c2721b08a496 tempest-VolumeQuotaClassesTest-1332278305 tempest-VolumeQuotaClassesTest-1332278305-project-admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:34.431592 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891fe367-7544-4724-81ca-c4085dcd8eee tempest-VolumeQuotaClassesTest-1332278305 tempest-VolumeQuotaClassesTest-1332278305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4ae908ab99940689d22bd94563ea511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58425c686bac4320a299337627c44a88', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:34.432035 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c31a00-74fc-4415-848b-9f8d7f83d0f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9856246c0f146c29846f2734ebff9c0, user_id=4eda431653284b4a8bbbef0d5b6af7c1, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:34.432401 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fe367-7544-4724-81ca-c4085dcd8eee tempest-VolumeQuotaClassesTest-1332278305 tempest-VolumeQuotaClassesTest-1332278305-project-admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:34.432693 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fe367-7544-4724-81ca-c4085dcd8eee tempest-VolumeQuotaClassesTest-1332278305 tempest-VolumeQuotaClassesTest-1332278305-project-admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:34.432984 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fe367-7544-4724-81ca-c4085dcd8eee tempest-VolumeQuotaClassesTest-1332278305 tempest-VolumeQuotaClassesTest-1332278305-project-admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:34.433738 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891fe367-7544-4724-81ca-c4085dcd8eee tempest-VolumeQuotaClassesTest-1332278305 tempest-VolumeQuotaClassesTest-1332278305-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:34.434666 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c31a00-74fc-4415-848b-9f8d7f83d0f0 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:34.437528 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891fe367-7544-4724-81ca-c4085dcd8eee tempest-VolumeQuotaClassesTest-1332278305 tempest-VolumeQuotaClassesTest-1332278305-project-admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:34.468407 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 922/1851] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:34 2022] PUT /identity/v3/projects/c9856246c0f146c29846f2734ebff9c0/users/4eda431653284b4a8bbbef0d5b6af7c1/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:34.472861 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c31a00-74fc-4415-848b-9f8d7f83d0f0 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:34.497164 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 930/1852] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:56:34 2022] POST /identity/v3/projects => generated 354 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:34.500841 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891fe367-7544-4724-81ca-c4085dcd8eee tempest-VolumeQuotaClassesTest-1332278305 tempest-VolumeQuotaClassesTest-1332278305-project-admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:34.701067 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891fe367-7544-4724-81ca-c4085dcd8eee tempest-VolumeQuotaClassesTest-1332278305 tempest-VolumeQuotaClassesTest-1332278305-project-admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:34.709406 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c31a00-74fc-4415-848b-9f8d7f83d0f0 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:34.712375 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47489aef-e180-42af-be2e-b58a63579fba tempest-VolumeQuotaClassesTest-1332278305 tempest-VolumeQuotaClassesTest-1332278305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4ae908ab99940689d22bd94563ea511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58425c686bac4320a299337627c44a88', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:34.713542 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47489aef-e180-42af-be2e-b58a63579fba tempest-VolumeQuotaClassesTest-1332278305 tempest-VolumeQuotaClassesTest-1332278305-project-admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:34.713949 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47489aef-e180-42af-be2e-b58a63579fba tempest-VolumeQuotaClassesTest-1332278305 tempest-VolumeQuotaClassesTest-1332278305-project-admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:34.716617 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47489aef-e180-42af-be2e-b58a63579fba tempest-VolumeQuotaClassesTest-1332278305 tempest-VolumeQuotaClassesTest-1332278305-project-admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:34.717504 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47489aef-e180-42af-be2e-b58a63579fba tempest-VolumeQuotaClassesTest-1332278305 tempest-VolumeQuotaClassesTest-1332278305-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:34.717872 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47489aef-e180-42af-be2e-b58a63579fba tempest-VolumeQuotaClassesTest-1332278305 tempest-VolumeQuotaClassesTest-1332278305-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:34.719720 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47489aef-e180-42af-be2e-b58a63579fba tempest-VolumeQuotaClassesTest-1332278305 tempest-VolumeQuotaClassesTest-1332278305-project-admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:34.753089 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 931/1853] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 15:56:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:56:34.834393 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47489aef-e180-42af-be2e-b58a63579fba tempest-VolumeQuotaClassesTest-1332278305 tempest-VolumeQuotaClassesTest-1332278305-project-admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:34.844967 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae18c69-40ff-45e5-a8a2-9cfb0732d1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:34.845608 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae18c69-40ff-45e5-a8a2-9cfb0732d1d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:34.845885 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae18c69-40ff-45e5-a8a2-9cfb0732d1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:34.846161 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae18c69-40ff-45e5-a8a2-9cfb0732d1d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:34.846868 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae18c69-40ff-45e5-a8a2-9cfb0732d1d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:34.848756 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae18c69-40ff-45e5-a8a2-9cfb0732d1d3 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:34.853856 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47489aef-e180-42af-be2e-b58a63579fba tempest-VolumeQuotaClassesTest-1332278305 tempest-VolumeQuotaClassesTest-1332278305-project-admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:34.874784 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acdc62f-4131-474f-a58d-0f25b773077a tempest-VolumeQuotaClassesTest-1332278305 tempest-VolumeQuotaClassesTest-1332278305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4ae908ab99940689d22bd94563ea511', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58425c686bac4320a299337627c44a88', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:34.875471 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acdc62f-4131-474f-a58d-0f25b773077a tempest-VolumeQuotaClassesTest-1332278305 tempest-VolumeQuotaClassesTest-1332278305-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:34.875783 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acdc62f-4131-474f-a58d-0f25b773077a tempest-VolumeQuotaClassesTest-1332278305 tempest-VolumeQuotaClassesTest-1332278305-project-admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:34.876184 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acdc62f-4131-474f-a58d-0f25b773077a tempest-VolumeQuotaClassesTest-1332278305 tempest-VolumeQuotaClassesTest-1332278305-project-admin] PATH_INFO: `/v3/projects/4900455c3da1441796430a3c3ea81d2d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:34.880226 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 923/1854] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:34.880496 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acdc62f-4131-474f-a58d-0f25b773077a tempest-VolumeQuotaClassesTest-1332278305 tempest-VolumeQuotaClassesTest-1332278305-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4900455c3da1441796430a3c3ea81d2d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:34.880496 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acdc62f-4131-474f-a58d-0f25b773077a tempest-VolumeQuotaClassesTest-1332278305 tempest-VolumeQuotaClassesTest-1332278305-project-admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:34.881522 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae18c69-40ff-45e5-a8a2-9cfb0732d1d3 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:34.909190 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae18c69-40ff-45e5-a8a2-9cfb0732d1d3 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:34.922251 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02afe47-243c-479c-99ae-79d3201f7688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:34.923020 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02afe47-243c-479c-99ae-79d3201f7688 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:34.923352 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02afe47-243c-479c-99ae-79d3201f7688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:34.923629 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02afe47-243c-479c-99ae-79d3201f7688 admin admin] PATH_INFO: `/v3/projects/c9856246c0f146c29846f2734ebff9c0/users/4eda431653284b4a8bbbef0d5b6af7c1/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:34.932851 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02afe47-243c-479c-99ae-79d3201f7688 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9856246c0f146c29846f2734ebff9c0, user_id=4eda431653284b4a8bbbef0d5b6af7c1, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:34.936761 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02afe47-243c-479c-99ae-79d3201f7688 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:34.967666 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:34.974430 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 924/1855] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:34 2022] PUT /identity/v3/projects/c9856246c0f146c29846f2734ebff9c0/users/4eda431653284b4a8bbbef0d5b6af7c1/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:34.990725 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4ce3f-4567-402a-9a70-65ed2c26199f None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:34.991570 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4ce3f-4567-402a-9a70-65ed2c26199f None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:34.991892 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4ce3f-4567-402a-9a70-65ed2c26199f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:34.999609 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-4acdc62f-4131-474f-a58d-0f25b773077a tempest-VolumeQuotaClassesTest-1332278305 tempest-VolumeQuotaClassesTest-1332278305-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4900455c3da1441796430a3c3ea81d2d', 'request_id': 'req-4acdc62f-4131-474f-a58d-0f25b773077a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:35.006659 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-4acdc62f-4131-474f-a58d-0f25b773077a tempest-VolumeQuotaClassesTest-1332278305 tempest-VolumeQuotaClassesTest-1332278305-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4900455c3da1441796430a3c3ea81d2d', 'request_id': 'req-4acdc62f-4131-474f-a58d-0f25b773077a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:35.019853 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:35.027287 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-4acdc62f-4131-474f-a58d-0f25b773077a tempest-VolumeQuotaClassesTest-1332278305 tempest-VolumeQuotaClassesTest-1332278305-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4900455c3da1441796430a3c3ea81d2d', 'request_id': 'req-4acdc62f-4131-474f-a58d-0f25b773077a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:35.052503 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-4acdc62f-4131-474f-a58d-0f25b773077a tempest-VolumeQuotaClassesTest-1332278305 tempest-VolumeQuotaClassesTest-1332278305-project-admin] The token cache is being invalidate because project 4900455c3da1441796430a3c3ea81d2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:56:35.053078 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-4acdc62f-4131-474f-a58d-0f25b773077a tempest-VolumeQuotaClassesTest-1332278305 tempest-VolumeQuotaClassesTest-1332278305-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:35.053893 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-4acdc62f-4131-474f-a58d-0f25b773077a tempest-VolumeQuotaClassesTest-1332278305 tempest-VolumeQuotaClassesTest-1332278305-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:35.056637 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 932/1856] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:56:34 2022] DELETE /identity/v3/projects/4900455c3da1441796430a3c3ea81d2d => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 15:56:35.065293 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-f4b4ce3f-4567-402a-9a70-65ed2c26199f None None] MFA Rules not processed for user `4eda431653284b4a8bbbef0d5b6af7c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:35.066562 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-f4b4ce3f-4567-402a-9a70-65ed2c26199f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:35.068892 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f792fe0-7677-41cb-b2b9-7238a4c6a588 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:35.069402 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f792fe0-7677-41cb-b2b9-7238a4c6a588 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:35.069833 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f792fe0-7677-41cb-b2b9-7238a4c6a588 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:35.072599 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 933/1857] 10.222.0.16 () {54 vars in 921 bytes} [Wed Sep 7 15:56:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:56:35.169047 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df36b9-b48c-463e-a771-256913868875 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:35.169395 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df36b9-b48c-463e-a771-256913868875 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:35.169707 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df36b9-b48c-463e-a771-256913868875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:35.235832 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 925/1858] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:34 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 15:56:35.251309 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-a8df36b9-b48c-463e-a771-256913868875 None None] MFA Rules not processed for user `66c270b488024605af84e52d874474e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:35.251742 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-a8df36b9-b48c-463e-a771-256913868875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:35.325956 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4ce3f-4567-402a-9a70-65ed2c26199f None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:35.327704 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-f4b4ce3f-4567-402a-9a70-65ed2c26199f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:35.409589 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 934/1859] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Sep 7 15:56:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 15:56:35.410561 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df36b9-b48c-463e-a771-256913868875 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:35.412188 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-a8df36b9-b48c-463e-a771-256913868875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:35.470195 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4ce3f-4567-402a-9a70-65ed2c26199f None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:35.484399 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804f7bc-e6a5-4865-aa02-e9cd88a4e7cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:35.485326 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804f7bc-e6a5-4865-aa02-e9cd88a4e7cf service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:35.485756 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804f7bc-e6a5-4865-aa02-e9cd88a4e7cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:35.486195 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804f7bc-e6a5-4865-aa02-e9cd88a4e7cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:35.507976 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804f7bc-e6a5-4865-aa02-e9cd88a4e7cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:35.513410 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804f7bc-e6a5-4865-aa02-e9cd88a4e7cf service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:35.552733 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 926/1860] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:35 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 15:56:35.556405 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804f7bc-e6a5-4865-aa02-e9cd88a4e7cf service cinder] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:35.561375 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-1804f7bc-e6a5-4865-aa02-e9cd88a4e7cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:35.620556 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804f7bc-e6a5-4865-aa02-e9cd88a4e7cf service cinder] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:35.638148 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ade4a55-ae1c-4fb6-b683-c9495081ce7c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c270b488024605af84e52d874474e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:35.638687 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade4a55-ae1c-4fb6-b683-c9495081ce7c service placement] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:35.639021 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade4a55-ae1c-4fb6-b683-c9495081ce7c service placement] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:35.639301 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade4a55-ae1c-4fb6-b683-c9495081ce7c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:35.658415 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ade4a55-ae1c-4fb6-b683-c9495081ce7c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:35.660041 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ade4a55-ae1c-4fb6-b683-c9495081ce7c service placement] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:35.687774 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df36b9-b48c-463e-a771-256913868875 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:35.694992 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2ce38c-dbdb-43ae-be73-b697b2c5667b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:35.696532 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ce38c-dbdb-43ae-be73-b697b2c5667b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:35.697208 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ce38c-dbdb-43ae-be73-b697b2c5667b admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:35.698021 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ce38c-dbdb-43ae-be73-b697b2c5667b admin admin] PATH_INFO: `/v3/users/beff7acf048b4cfba2d872853d973a93` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:35.699492 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2ce38c-dbdb-43ae-be73-b697b2c5667b admin admin] RBAC: Authorizing `identity:delete_user(user_id=beff7acf048b4cfba2d872853d973a93)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:35.700602 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 927/1861] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:35.701564 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ade4a55-ae1c-4fb6-b683-c9495081ce7c service placement] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:35.702638 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2ce38c-dbdb-43ae-be73-b697b2c5667b admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:35.703740 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-1ade4a55-ae1c-4fb6-b683-c9495081ce7c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:35.767468 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ade4a55-ae1c-4fb6-b683-c9495081ce7c service placement] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:35.785474 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e5636-ddeb-4f34-8afb-4401d9163880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:35.789430 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e5636-ddeb-4f34-8afb-4401d9163880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:35.791659 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e5636-ddeb-4f34-8afb-4401d9163880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:35.791910 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e5636-ddeb-4f34-8afb-4401d9163880 admin admin] PATH_INFO: `/v3/users/6f95f220c68c4992b4cd515065f96699` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:35.795358 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868e5636-ddeb-4f34-8afb-4401d9163880 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f95f220c68c4992b4cd515065f96699)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:35.811237 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868e5636-ddeb-4f34-8afb-4401d9163880 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:35.854850 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2e2ce38c-dbdb-43ae-be73-b697b2c5667b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'beff7acf048b4cfba2d872853d973a93'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:35.872795 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2e2ce38c-dbdb-43ae-be73-b697b2c5667b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'beff7acf048b4cfba2d872853d973a93'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:35.873521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2e2ce38c-dbdb-43ae-be73-b697b2c5667b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'beff7acf048b4cfba2d872853d973a93'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:35.895077 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:35.915544 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2e2ce38c-dbdb-43ae-be73-b697b2c5667b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'beff7acf048b4cfba2d872853d973a93'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:35.917477 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2e2ce38c-dbdb-43ae-be73-b697b2c5667b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'beff7acf048b4cfba2d872853d973a93'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:35.935318 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 935/1862] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:56:35 2022] DELETE /identity/v3/users/beff7acf048b4cfba2d872853d973a93 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:35.936600 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2ce38c-dbdb-43ae-be73-b697b2c5667b admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:35.940526 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-2e2ce38c-dbdb-43ae-be73-b697b2c5667b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:35.955903 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-868e5636-ddeb-4f34-8afb-4401d9163880 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f95f220c68c4992b4cd515065f96699'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:35.967694 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-868e5636-ddeb-4f34-8afb-4401d9163880 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f95f220c68c4992b4cd515065f96699'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:35.968758 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-868e5636-ddeb-4f34-8afb-4401d9163880 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f95f220c68c4992b4cd515065f96699'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:35.990453 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-868e5636-ddeb-4f34-8afb-4401d9163880 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f95f220c68c4992b4cd515065f96699'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:35.991981 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-868e5636-ddeb-4f34-8afb-4401d9163880 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f95f220c68c4992b4cd515065f96699'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:36.062819 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:36.092993 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2ce38c-dbdb-43ae-be73-b697b2c5667b admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:36.094847 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 928/1863] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:56:35 2022] DELETE /identity/v3/users/6f95f220c68c4992b4cd515065f96699 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:36.096544 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc04e2-32bb-4388-bf11-5bd9fc258728 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:36.098811 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc04e2-32bb-4388-bf11-5bd9fc258728 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:36.099331 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc04e2-32bb-4388-bf11-5bd9fc258728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:36.162114 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-9afc04e2-32bb-4388-bf11-5bd9fc258728 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:36.163655 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-9afc04e2-32bb-4388-bf11-5bd9fc258728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:36.253052 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21277008-b9e1-46c7-82f5-6a09b455316f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:36.255275 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21277008-b9e1-46c7-82f5-6a09b455316f service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:36.256183 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21277008-b9e1-46c7-82f5-6a09b455316f service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:36.256600 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21277008-b9e1-46c7-82f5-6a09b455316f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:36.261715 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-21277008-b9e1-46c7-82f5-6a09b455316f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:36.339981 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 929/1864] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:36.472372 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21277008-b9e1-46c7-82f5-6a09b455316f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:36.473906 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21277008-b9e1-46c7-82f5-6a09b455316f service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:36.504352 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 936/1865] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:35 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:36.575163 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc04e2-32bb-4388-bf11-5bd9fc258728 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:36.576948 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-9afc04e2-32bb-4388-bf11-5bd9fc258728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:36.600029 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc04e2-32bb-4388-bf11-5bd9fc258728 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:36.620448 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25d5a3-9378-4287-b39b-fffeba3ab773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:36.627846 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25d5a3-9378-4287-b39b-fffeba3ab773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:36.630979 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25d5a3-9378-4287-b39b-fffeba3ab773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:36.631451 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25d5a3-9378-4287-b39b-fffeba3ab773 admin admin] PATH_INFO: `/v3/projects/acdcad04994a4d5ba46576f222a1558b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:36.633410 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e25d5a3-9378-4287-b39b-fffeba3ab773 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acdcad04994a4d5ba46576f222a1558b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:36.640886 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e25d5a3-9378-4287-b39b-fffeba3ab773 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:36.788210 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-5e25d5a3-9378-4287-b39b-fffeba3ab773 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acdcad04994a4d5ba46576f222a1558b', 'request_id': 'req-5e25d5a3-9378-4287-b39b-fffeba3ab773'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:36.800819 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21277008-b9e1-46c7-82f5-6a09b455316f service cinder] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:36.803047 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-5e25d5a3-9378-4287-b39b-fffeba3ab773 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acdcad04994a4d5ba46576f222a1558b', 'request_id': 'req-5e25d5a3-9378-4287-b39b-fffeba3ab773'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:36.803257 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-21277008-b9e1-46c7-82f5-6a09b455316f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:36.814772 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-5e25d5a3-9378-4287-b39b-fffeba3ab773 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acdcad04994a4d5ba46576f222a1558b', 'request_id': 'req-5e25d5a3-9378-4287-b39b-fffeba3ab773'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:36.840917 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-5e25d5a3-9378-4287-b39b-fffeba3ab773 admin admin] The token cache is being invalidate because project acdcad04994a4d5ba46576f222a1558b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:56:36.841221 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-5e25d5a3-9378-4287-b39b-fffeba3ab773 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:36.842547 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-5e25d5a3-9378-4287-b39b-fffeba3ab773 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:36.846789 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 930/1866] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:56:36 2022] DELETE /identity/v3/projects/acdcad04994a4d5ba46576f222a1558b => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:36.861476 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f39968-93a0-4bfe-9408-0493a3acd206 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:36.863208 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f39968-93a0-4bfe-9408-0493a3acd206 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:36.863938 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f39968-93a0-4bfe-9408-0493a3acd206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:36.933524 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-54f39968-93a0-4bfe-9408-0493a3acd206 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:36.935246 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-54f39968-93a0-4bfe-9408-0493a3acd206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:36.965488 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:36.974001 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21277008-b9e1-46c7-82f5-6a09b455316f service cinder] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:37.113839 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7df081-1f2e-40a3-8943-801989c55fdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:37.114450 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 931/1867] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:37.122026 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7df081-1f2e-40a3-8943-801989c55fdd service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:37.122260 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7df081-1f2e-40a3-8943-801989c55fdd service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:37.122380 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec475f-7abb-4fec-83f5-92e35896143f None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:37.122554 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7df081-1f2e-40a3-8943-801989c55fdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:37.122666 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec475f-7abb-4fec-83f5-92e35896143f None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:37.122941 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec475f-7abb-4fec-83f5-92e35896143f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:37.128231 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-0b7df081-1f2e-40a3-8943-801989c55fdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:37.167280 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-1cec475f-7abb-4fec-83f5-92e35896143f None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:37.168752 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-1cec475f-7abb-4fec-83f5-92e35896143f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:37.177484 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7df081-1f2e-40a3-8943-801989c55fdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:37.186880 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7df081-1f2e-40a3-8943-801989c55fdd service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:37.211120 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 932/1868] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 15:56:37.213482 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac7ab6-e3a3-423b-913c-9d4f6bd95923 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:37.216914 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac7ab6-e3a3-423b-913c-9d4f6bd95923 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:37.217511 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac7ab6-e3a3-423b-913c-9d4f6bd95923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:37.226531 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 937/1869] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 15:56:37.227945 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7df081-1f2e-40a3-8943-801989c55fdd service neutron] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:37.242216 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7df081-1f2e-40a3-8943-801989c55fdd service neutron] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:37.250553 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61426654-f95b-4531-933c-5f7270e75776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:37.251117 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61426654-f95b-4531-933c-5f7270e75776 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:37.251624 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61426654-f95b-4531-933c-5f7270e75776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:37.252698 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61426654-f95b-4531-933c-5f7270e75776 admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:37.253365 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61426654-f95b-4531-933c-5f7270e75776 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:37.253672 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61426654-f95b-4531-933c-5f7270e75776 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:37.256511 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61426654-f95b-4531-933c-5f7270e75776 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:37.266294 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-d5ac7ab6-e3a3-423b-913c-9d4f6bd95923 None None] MFA Rules not processed for user `3195fa62961c4d64972b88449d013380`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:37.282764 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-d5ac7ab6-e3a3-423b-913c-9d4f6bd95923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:37.306628 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 933/1870] 10.222.0.26 () {58 vars in 1015 bytes} [Wed Sep 7 15:56:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:37.308097 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac7ab6-e3a3-423b-913c-9d4f6bd95923 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:37.308348 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 938/1871] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 15:56:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:37.326728 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:37.342398 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac7ab6-e3a3-423b-913c-9d4f6bd95923 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:37.373431 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12296639-dd9f-4d8e-a58d-6f7e7b0c5e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:37.374101 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12296639-dd9f-4d8e-a58d-6f7e7b0c5e15 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:37.374561 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12296639-dd9f-4d8e-a58d-6f7e7b0c5e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:37.374916 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12296639-dd9f-4d8e-a58d-6f7e7b0c5e15 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:37.375818 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12296639-dd9f-4d8e-a58d-6f7e7b0c5e15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:37.378416 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12296639-dd9f-4d8e-a58d-6f7e7b0c5e15 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:37.431334 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 934/1872] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:56:37 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 15:56:37.435841 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61426654-f95b-4531-933c-5f7270e75776 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:37.453972 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61426654-f95b-4531-933c-5f7270e75776 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:37.459276 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12296639-dd9f-4d8e-a58d-6f7e7b0c5e15 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:37.461610 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-12296639-dd9f-4d8e-a58d-6f7e7b0c5e15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:37.656870 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12296639-dd9f-4d8e-a58d-6f7e7b0c5e15 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:37.660274 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090d743-a5db-4f06-9132-5cdf9a3df1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:37.661197 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090d743-a5db-4f06-9132-5cdf9a3df1d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:37.661814 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090d743-a5db-4f06-9132-5cdf9a3df1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:37.662323 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090d743-a5db-4f06-9132-5cdf9a3df1d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:37.664165 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f090d743-a5db-4f06-9132-5cdf9a3df1d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:37.670162 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f090d743-a5db-4f06-9132-5cdf9a3df1d0 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:37.674890 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6318b942-49a3-4d3d-8ca3-c86236f713ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:37.675540 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318b942-49a3-4d3d-8ca3-c86236f713ad service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:37.675806 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318b942-49a3-4d3d-8ca3-c86236f713ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:37.676167 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318b942-49a3-4d3d-8ca3-c86236f713ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:37.691017 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6318b942-49a3-4d3d-8ca3-c86236f713ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:37.693626 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6318b942-49a3-4d3d-8ca3-c86236f713ad service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:37.736050 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 935/1873] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 15:56:37.736903 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6318b942-49a3-4d3d-8ca3-c86236f713ad service neutron] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:37.737591 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 939/1874] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:56:37 2022] POST /identity/v3/users => generated 293 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:37.741338 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090d743-a5db-4f06-9132-5cdf9a3df1d0 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:37.759235 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6318b942-49a3-4d3d-8ca3-c86236f713ad service neutron] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:37.764129 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090d743-a5db-4f06-9132-5cdf9a3df1d0 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:37.770404 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d5850-f10d-4d49-9659-389e818081e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:37.771830 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d5850-f10d-4d49-9659-389e818081e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:37.772836 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d5850-f10d-4d49-9659-389e818081e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:37.773638 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d5850-f10d-4d49-9659-389e818081e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:37.778335 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19860c8b-073c-4377-93fb-d3937c082314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:37.779232 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19860c8b-073c-4377-93fb-d3937c082314 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:37.780443 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19860c8b-073c-4377-93fb-d3937c082314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:37.785113 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19860c8b-073c-4377-93fb-d3937c082314 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:37.786414 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19860c8b-073c-4377-93fb-d3937c082314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:37.788605 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19860c8b-073c-4377-93fb-d3937c082314 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:37.798508 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568d5850-f10d-4d49-9659-389e818081e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:37.800320 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568d5850-f10d-4d49-9659-389e818081e3 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:37.813509 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 940/1875] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 15:56:37.833747 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19860c8b-073c-4377-93fb-d3937c082314 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:37.839319 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 936/1876] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:37.856479 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19860c8b-073c-4377-93fb-d3937c082314 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:37.874693 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610567a7-30bb-4bf5-af69-8673df4f6517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:37.875578 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610567a7-30bb-4bf5-af69-8673df4f6517 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:37.876187 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610567a7-30bb-4bf5-af69-8673df4f6517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:37.876703 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610567a7-30bb-4bf5-af69-8673df4f6517 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:37.879780 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610567a7-30bb-4bf5-af69-8673df4f6517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:37.883430 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610567a7-30bb-4bf5-af69-8673df4f6517 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:37.931889 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 941/1877] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:37.933144 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d5850-f10d-4d49-9659-389e818081e3 service neutron] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:37.957965 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d5850-f10d-4d49-9659-389e818081e3 service neutron] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:37.976633 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2210e755-d32b-4de1-91bb-6206f30d82dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:37.981115 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210e755-d32b-4de1-91bb-6206f30d82dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:37.984071 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210e755-d32b-4de1-91bb-6206f30d82dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:37.986213 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210e755-d32b-4de1-91bb-6206f30d82dc admin admin] PATH_INFO: `/v3/projects/46c08fab9afe464a8f2684e1cc7f44fc/users/6274aac07a7b4352a0e00a589991e88b/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:38.061131 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2210e755-d32b-4de1-91bb-6206f30d82dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=46c08fab9afe464a8f2684e1cc7f44fc, user_id=6274aac07a7b4352a0e00a589991e88b, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:38.064013 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2210e755-d32b-4de1-91bb-6206f30d82dc admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:38.084070 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 937/1878] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:37 2022] PUT /identity/v3/projects/46c08fab9afe464a8f2684e1cc7f44fc/users/6274aac07a7b4352a0e00a589991e88b/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:38.098638 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a94cc1-e153-458a-977b-1f6ebd3af840 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:38.098958 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a94cc1-e153-458a-977b-1f6ebd3af840 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:38.099153 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a94cc1-e153-458a-977b-1f6ebd3af840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:38.158489 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-63a94cc1-e153-458a-977b-1f6ebd3af840 None None] MFA Rules not processed for user `6274aac07a7b4352a0e00a589991e88b`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:38.160048 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-63a94cc1-e153-458a-977b-1f6ebd3af840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:38.388735 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:38.454426 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 942/1879] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:38.466820 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2210e755-d32b-4de1-91bb-6206f30d82dc admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:38.676823 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2210e755-d32b-4de1-91bb-6206f30d82dc admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:38.706802 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c1e79-367c-43e2-8535-ac8ace52893b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:38.707756 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c1e79-367c-43e2-8535-ac8ace52893b admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:38.708353 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c1e79-367c-43e2-8535-ac8ace52893b admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:38.709311 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c1e79-367c-43e2-8535-ac8ace52893b admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:38.715067 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c1e79-367c-43e2-8535-ac8ace52893b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:38.717156 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c1e79-367c-43e2-8535-ac8ace52893b admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:38.839991 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 938/1880] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:56:38 2022] POST /identity/v3/projects => generated 383 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:38.842932 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a94cc1-e153-458a-977b-1f6ebd3af840 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:38.877828 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a94cc1-e153-458a-977b-1f6ebd3af840 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:38.879787 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c1e79-367c-43e2-8535-ac8ace52893b admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:38.884599 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-a51c1e79-367c-43e2-8535-ac8ace52893b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:39.026983 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c53291-7215-4968-a01a-991ca8d707ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:39.027732 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c53291-7215-4968-a01a-991ca8d707ba admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:39.028046 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c53291-7215-4968-a01a-991ca8d707ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:39.028408 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c53291-7215-4968-a01a-991ca8d707ba admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:39.029445 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c53291-7215-4968-a01a-991ca8d707ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:39.034072 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c53291-7215-4968-a01a-991ca8d707ba admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:39.058082 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:39.089426 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 943/1881] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:56:38 2022] POST /identity/v3/users => generated 298 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:39.091235 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c53291-7215-4968-a01a-991ca8d707ba admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:39.096842 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-15c53291-7215-4968-a01a-991ca8d707ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:39.157448 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c1e79-367c-43e2-8535-ac8ace52893b admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:39.167890 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c53291-7215-4968-a01a-991ca8d707ba admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:39.175051 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63668a21-7225-49c2-9326-733a60788507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:39.176072 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63668a21-7225-49c2-9326-733a60788507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:39.176404 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63668a21-7225-49c2-9326-733a60788507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:39.176783 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63668a21-7225-49c2-9326-733a60788507 admin admin] PATH_INFO: `/v3/users/1ca0855c29054b768449056e3eee10ba` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:39.178819 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63668a21-7225-49c2-9326-733a60788507 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ca0855c29054b768449056e3eee10ba)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:39.181519 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3904e-2024-48b1-b8d8-cff58436abd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:39.181790 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63668a21-7225-49c2-9326-733a60788507 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:39.182867 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3904e-2024-48b1-b8d8-cff58436abd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:39.183544 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3904e-2024-48b1-b8d8-cff58436abd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:39.185426 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3904e-2024-48b1-b8d8-cff58436abd8 admin admin] PATH_INFO: `/v3/projects/12919490d5c2430a8642bc38efc731a5` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:39.189312 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c3904e-2024-48b1-b8d8-cff58436abd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12919490d5c2430a8642bc38efc731a5)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:39.214571 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c3904e-2024-48b1-b8d8-cff58436abd8 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:39.288554 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-63668a21-7225-49c2-9326-733a60788507 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ca0855c29054b768449056e3eee10ba'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:39.310066 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-63668a21-7225-49c2-9326-733a60788507 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ca0855c29054b768449056e3eee10ba'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:39.311207 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-63668a21-7225-49c2-9326-733a60788507 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ca0855c29054b768449056e3eee10ba'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:39.339132 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-63668a21-7225-49c2-9326-733a60788507 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ca0855c29054b768449056e3eee10ba'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:39.340034 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-63668a21-7225-49c2-9326-733a60788507 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ca0855c29054b768449056e3eee10ba'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:39.364423 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-46c3904e-2024-48b1-b8d8-cff58436abd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12919490d5c2430a8642bc38efc731a5', 'request_id': 'req-46c3904e-2024-48b1-b8d8-cff58436abd8'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:39.375378 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-46c3904e-2024-48b1-b8d8-cff58436abd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12919490d5c2430a8642bc38efc731a5', 'request_id': 'req-46c3904e-2024-48b1-b8d8-cff58436abd8'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:39.387513 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 944/1882] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:56:39 2022] DELETE /identity/v3/users/1ca0855c29054b768449056e3eee10ba => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:39.387700 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-46c3904e-2024-48b1-b8d8-cff58436abd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12919490d5c2430a8642bc38efc731a5', 'request_id': 'req-46c3904e-2024-48b1-b8d8-cff58436abd8'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:39.388695 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63668a21-7225-49c2-9326-733a60788507 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:39.391145 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-63668a21-7225-49c2-9326-733a60788507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:39.411520 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-46c3904e-2024-48b1-b8d8-cff58436abd8 admin admin] The token cache is being invalidate because project 12919490d5c2430a8642bc38efc731a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:56:39.411827 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-46c3904e-2024-48b1-b8d8-cff58436abd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:39.412865 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-46c3904e-2024-48b1-b8d8-cff58436abd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:39.416955 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 939/1883] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:56:38 2022] DELETE /identity/v3/projects/12919490d5c2430a8642bc38efc731a5 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:39.418528 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde2b72-4981-42d1-bdd4-f614aa2d8f66 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:39.419035 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde2b72-4981-42d1-bdd4-f614aa2d8f66 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:39.419704 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde2b72-4981-42d1-bdd4-f614aa2d8f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:39.497667 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-cdde2b72-4981-42d1-bdd4-f614aa2d8f66 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:39.500011 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-cdde2b72-4981-42d1-bdd4-f614aa2d8f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:39.586056 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:39.609778 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 940/1884] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:39.610747 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde2b72-4981-42d1-bdd4-f614aa2d8f66 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:39.613021 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63668a21-7225-49c2-9326-733a60788507 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:39.615356 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-cdde2b72-4981-42d1-bdd4-f614aa2d8f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:39.624134 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ed459-410f-476b-b695-455ad4ae12b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:39.626292 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ed459-410f-476b-b695-455ad4ae12b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:39.629169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ed459-410f-476b-b695-455ad4ae12b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:39.630171 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ed459-410f-476b-b695-455ad4ae12b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:39.632165 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ed459-410f-476b-b695-455ad4ae12b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:39.635132 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ed459-410f-476b-b695-455ad4ae12b5 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:39.647966 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde2b72-4981-42d1-bdd4-f614aa2d8f66 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:39.657992 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 945/1885] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:39.659500 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ed459-410f-476b-b695-455ad4ae12b5 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:39.661600 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d55aa-3401-4a2a-9886-dda3ab9fdb58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:39.662356 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d55aa-3401-4a2a-9886-dda3ab9fdb58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:39.662631 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d55aa-3401-4a2a-9886-dda3ab9fdb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:39.662846 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d55aa-3401-4a2a-9886-dda3ab9fdb58 admin admin] PATH_INFO: `/v3/users/4385d03b56624600b4c00bf0b942d598` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:39.663784 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-bf7ed459-410f-476b-b695-455ad4ae12b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:39.665524 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959d55aa-3401-4a2a-9886-dda3ab9fdb58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4385d03b56624600b4c00bf0b942d598)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:39.673868 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959d55aa-3401-4a2a-9886-dda3ab9fdb58 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:39.771067 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-959d55aa-3401-4a2a-9886-dda3ab9fdb58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4385d03b56624600b4c00bf0b942d598'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:39.807418 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-959d55aa-3401-4a2a-9886-dda3ab9fdb58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4385d03b56624600b4c00bf0b942d598'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:39.816054 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-959d55aa-3401-4a2a-9886-dda3ab9fdb58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4385d03b56624600b4c00bf0b942d598'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:39.820624 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:39.834744 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-959d55aa-3401-4a2a-9886-dda3ab9fdb58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4385d03b56624600b4c00bf0b942d598'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:39.835610 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-959d55aa-3401-4a2a-9886-dda3ab9fdb58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4385d03b56624600b4c00bf0b942d598'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:39.844048 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ed459-410f-476b-b695-455ad4ae12b5 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:39.862226 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd97d5-5802-48bb-9962-336ffe26e5f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:39.863310 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd97d5-5802-48bb-9962-336ffe26e5f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:39.863696 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd97d5-5802-48bb-9962-336ffe26e5f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:39.864014 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd97d5-5802-48bb-9962-336ffe26e5f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:39.866640 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-27bd97d5-5802-48bb-9962-336ffe26e5f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:39.885859 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 941/1886] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:56:39 2022] DELETE /identity/v3/users/4385d03b56624600b4c00bf0b942d598 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:39.886923 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d55aa-3401-4a2a-9886-dda3ab9fdb58 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:39.907362 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd97d5-5802-48bb-9962-336ffe26e5f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:39.909718 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd97d5-5802-48bb-9962-336ffe26e5f8 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:39.911582 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-959d55aa-3401-4a2a-9886-dda3ab9fdb58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:39.941983 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 946/1887] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:40.142002 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d55aa-3401-4a2a-9886-dda3ab9fdb58 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:40.147995 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceedc9a-56b3-4643-a0c9-6921aec3de2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:40.150867 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceedc9a-56b3-4643-a0c9-6921aec3de2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:40.151697 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceedc9a-56b3-4643-a0c9-6921aec3de2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:40.152556 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceedc9a-56b3-4643-a0c9-6921aec3de2e admin admin] PATH_INFO: `/v3/projects/21e3a288ffbb4e2ebbae3333d3f543db/users/95553b3335834967a730cc8aa3e91098/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:40.174282 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceedc9a-56b3-4643-a0c9-6921aec3de2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=21e3a288ffbb4e2ebbae3333d3f543db, user_id=95553b3335834967a730cc8aa3e91098, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:40.177706 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceedc9a-56b3-4643-a0c9-6921aec3de2e admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:40.198744 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 942/1888] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:39 2022] PUT /identity/v3/projects/21e3a288ffbb4e2ebbae3333d3f543db/users/95553b3335834967a730cc8aa3e91098/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:40.202456 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd97d5-5802-48bb-9962-336ffe26e5f8 service neutron] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:40.220230 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd97d5-5802-48bb-9962-336ffe26e5f8 service neutron] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:40.264341 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceedc9a-56b3-4643-a0c9-6921aec3de2e admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:40.268562 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-0ceedc9a-56b3-4643-a0c9-6921aec3de2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:40.388705 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc51970-7f6e-4db6-b674-3feb4bccfbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:40.392156 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc51970-7f6e-4db6-b674-3feb4bccfbc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:40.392553 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc51970-7f6e-4db6-b674-3feb4bccfbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:40.394638 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc51970-7f6e-4db6-b674-3feb4bccfbc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:40.395762 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc51970-7f6e-4db6-b674-3feb4bccfbc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:40.398431 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceedc9a-56b3-4643-a0c9-6921aec3de2e admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:40.400283 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc51970-7f6e-4db6-b674-3feb4bccfbc5 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:40.412522 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b9be5-07a3-45f6-a0d8-1e1ad0424e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:40.413192 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b9be5-07a3-45f6-a0d8-1e1ad0424e1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:40.413476 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b9be5-07a3-45f6-a0d8-1e1ad0424e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:40.413754 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b9be5-07a3-45f6-a0d8-1e1ad0424e1c admin admin] PATH_INFO: `/v3/users/77ebdb33e3c442e5abfb602ccca8c419` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:40.416724 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9b9be5-07a3-45f6-a0d8-1e1ad0424e1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=77ebdb33e3c442e5abfb602ccca8c419)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:40.421144 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9b9be5-07a3-45f6-a0d8-1e1ad0424e1c admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:40.432805 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 947/1889] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:40.434666 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc51970-7f6e-4db6-b674-3feb4bccfbc5 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:40.465734 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc51970-7f6e-4db6-b674-3feb4bccfbc5 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:40.479078 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ca149-86ea-4358-9500-b34c950a4e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:40.481541 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ca149-86ea-4358-9500-b34c950a4e0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:40.481894 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ca149-86ea-4358-9500-b34c950a4e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:40.483515 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ca149-86ea-4358-9500-b34c950a4e0f admin admin] PATH_INFO: `/v3/projects/21e3a288ffbb4e2ebbae3333d3f543db/users/95553b3335834967a730cc8aa3e91098/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:40.488533 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ca149-86ea-4358-9500-b34c950a4e0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=21e3a288ffbb4e2ebbae3333d3f543db, user_id=95553b3335834967a730cc8aa3e91098, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:40.496828 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ca149-86ea-4358-9500-b34c950a4e0f admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:40.530911 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 948/1890] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:40 2022] PUT /identity/v3/projects/21e3a288ffbb4e2ebbae3333d3f543db/users/95553b3335834967a730cc8aa3e91098/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:40.545882 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79294c4-6a1c-4746-b74b-ae0f87e45ccd None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:40.548658 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79294c4-6a1c-4746-b74b-ae0f87e45ccd None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:40.549513 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79294c4-6a1c-4746-b74b-ae0f87e45ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:40.566131 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-ea9b9be5-07a3-45f6-a0d8-1e1ad0424e1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77ebdb33e3c442e5abfb602ccca8c419'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:40.586897 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-ea9b9be5-07a3-45f6-a0d8-1e1ad0424e1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77ebdb33e3c442e5abfb602ccca8c419'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:40.591801 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-ea9b9be5-07a3-45f6-a0d8-1e1ad0424e1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77ebdb33e3c442e5abfb602ccca8c419'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:40.601766 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:40.610552 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-ea9b9be5-07a3-45f6-a0d8-1e1ad0424e1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77ebdb33e3c442e5abfb602ccca8c419'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:40.612388 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-ea9b9be5-07a3-45f6-a0d8-1e1ad0424e1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77ebdb33e3c442e5abfb602ccca8c419'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:40.622348 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-f79294c4-6a1c-4746-b74b-ae0f87e45ccd None None] MFA Rules not processed for user `95553b3335834967a730cc8aa3e91098`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:40.623721 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-f79294c4-6a1c-4746-b74b-ae0f87e45ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:40.653772 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 943/1891] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:56:40 2022] DELETE /identity/v3/users/77ebdb33e3c442e5abfb602ccca8c419 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:40.658865 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9398c-3eec-407a-a014-f3c8efec53e3 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:40.660680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9398c-3eec-407a-a014-f3c8efec53e3 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:40.662849 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9398c-3eec-407a-a014-f3c8efec53e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:40.700400 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-c0a9398c-3eec-407a-a014-f3c8efec53e3 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:40.702928 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-c0a9398c-3eec-407a-a014-f3c8efec53e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:40.714120 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:40.722115 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 949/1892] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:40 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:40.735106 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79294c4-6a1c-4746-b74b-ae0f87e45ccd None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:40.736847 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-f79294c4-6a1c-4746-b74b-ae0f87e45ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:40.794272 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 944/1893] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:40.822567 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79294c4-6a1c-4746-b74b-ae0f87e45ccd None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:40.869774 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9398c-3eec-407a-a014-f3c8efec53e3 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:40.876846 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-c0a9398c-3eec-407a-a014-f3c8efec53e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:41.040493 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347a3b6-ff02-4fd4-81eb-aac8e5e4b030 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:41.043577 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347a3b6-ff02-4fd4-81eb-aac8e5e4b030 service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:41.044418 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347a3b6-ff02-4fd4-81eb-aac8e5e4b030 service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:41.044418 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347a3b6-ff02-4fd4-81eb-aac8e5e4b030 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:41.052494 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-d347a3b6-ff02-4fd4-81eb-aac8e5e4b030 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:41.070296 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9398c-3eec-407a-a014-f3c8efec53e3 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:41.079055 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5736c-45ad-4e7d-bd78-c26ea9edb01c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:41.079744 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5736c-45ad-4e7d-bd78-c26ea9edb01c service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:41.080027 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5736c-45ad-4e7d-bd78-c26ea9edb01c service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:41.080355 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5736c-45ad-4e7d-bd78-c26ea9edb01c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:41.109125 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d5736c-45ad-4e7d-bd78-c26ea9edb01c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:41.110883 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d5736c-45ad-4e7d-bd78-c26ea9edb01c service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:41.163161 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 945/1894] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 15:56:41.237573 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5736c-45ad-4e7d-bd78-c26ea9edb01c service neutron] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:41.239169 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-f9d5736c-45ad-4e7d-bd78-c26ea9edb01c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:41.264390 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5736c-45ad-4e7d-bd78-c26ea9edb01c service neutron] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:41.281958 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c92bf-d8e4-444a-bee4-1ad5399226fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:41.282742 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c92bf-d8e4-444a-bee4-1ad5399226fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:41.283005 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c92bf-d8e4-444a-bee4-1ad5399226fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:41.283324 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c92bf-d8e4-444a-bee4-1ad5399226fa admin admin] PATH_INFO: `/v3/projects/32a0513f777845a888669970262ab57d` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:41.284625 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572c92bf-d8e4-444a-bee4-1ad5399226fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=32a0513f777845a888669970262ab57d)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:41.286784 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572c92bf-d8e4-444a-bee4-1ad5399226fa admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:41.300883 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d347a3b6-ff02-4fd4-81eb-aac8e5e4b030 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:41.310261 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d347a3b6-ff02-4fd4-81eb-aac8e5e4b030 service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:41.331598 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 950/1895] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:41.424672 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-572c92bf-d8e4-444a-bee4-1ad5399226fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32a0513f777845a888669970262ab57d', 'request_id': 'req-572c92bf-d8e4-444a-bee4-1ad5399226fa'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:41.460778 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-572c92bf-d8e4-444a-bee4-1ad5399226fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32a0513f777845a888669970262ab57d', 'request_id': 'req-572c92bf-d8e4-444a-bee4-1ad5399226fa'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:41.502731 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-572c92bf-d8e4-444a-bee4-1ad5399226fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32a0513f777845a888669970262ab57d', 'request_id': 'req-572c92bf-d8e4-444a-bee4-1ad5399226fa'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:41.508093 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90065dc-d98c-4b0d-b4d2-2af212f418d5 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:41.508369 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90065dc-d98c-4b0d-b4d2-2af212f418d5 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:41.508682 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90065dc-d98c-4b0d-b4d2-2af212f418d5 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:41.510674 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 951/1896] 10.222.0.16 () {54 vars in 921 bytes} [Wed Sep 7 15:56:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:41.540940 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-572c92bf-d8e4-444a-bee4-1ad5399226fa admin admin] The token cache is being invalidate because project 32a0513f777845a888669970262ab57d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:56:41.541345 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-572c92bf-d8e4-444a-bee4-1ad5399226fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:41.543395 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-572c92bf-d8e4-444a-bee4-1ad5399226fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:41.568381 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570acd3-0789-45d0-9eb7-8a12a95629a2 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:41.568667 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570acd3-0789-45d0-9eb7-8a12a95629a2 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:41.568949 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570acd3-0789-45d0-9eb7-8a12a95629a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:41.574817 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 946/1897] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:56:41 2022] DELETE /identity/v3/projects/32a0513f777845a888669970262ab57d => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 15:56:41.580559 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8dcff-2213-4a91-a8dc-56c7a3047e58 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:41.587654 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8dcff-2213-4a91-a8dc-56c7a3047e58 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:41.588137 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8dcff-2213-4a91-a8dc-56c7a3047e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:41.621630 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-1570acd3-0789-45d0-9eb7-8a12a95629a2 None None] MFA Rules not processed for user `f9b13331a5fd48f5a2521ed1600f9f35`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:41.622895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-1570acd3-0789-45d0-9eb7-8a12a95629a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:41.644909 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:41.704496 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-88a8dcff-2213-4a91-a8dc-56c7a3047e58 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:41.708680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-88a8dcff-2213-4a91-a8dc-56c7a3047e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:41.813467 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 952/1898] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Sep 7 15:56:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 15:56:41.844587 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570acd3-0789-45d0-9eb7-8a12a95629a2 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:41.846271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-1570acd3-0789-45d0-9eb7-8a12a95629a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:41.878843 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:41.893559 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570acd3-0789-45d0-9eb7-8a12a95629a2 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:41.909077 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98634c92-60af-41c7-8b4c-3020ae2203c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:41.910773 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98634c92-60af-41c7-8b4c-3020ae2203c1 service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:41.911061 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98634c92-60af-41c7-8b4c-3020ae2203c1 service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:41.912923 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98634c92-60af-41c7-8b4c-3020ae2203c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:41.933469 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 947/1899] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:41.945613 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8923ff8-024d-467d-9efc-3bcef8f74f02 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:41.946103 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8923ff8-024d-467d-9efc-3bcef8f74f02 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:41.946469 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8923ff8-024d-467d-9efc-3bcef8f74f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:41.956317 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98634c92-60af-41c7-8b4c-3020ae2203c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:41.958770 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98634c92-60af-41c7-8b4c-3020ae2203c1 service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:42.023330 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 953/1900] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:42.044698 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-f8923ff8-024d-467d-9efc-3bcef8f74f02 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:42.047610 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-f8923ff8-024d-467d-9efc-3bcef8f74f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:42.089919 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 948/1901] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:42.091654 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98634c92-60af-41c7-8b4c-3020ae2203c1 service nova] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:42.109848 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98634c92-60af-41c7-8b4c-3020ae2203c1 service nova] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:42.130999 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b5f19-382a-4ff4-a179-687d5c8b6e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:42.131648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b5f19-382a-4ff4-a179-687d5c8b6e42 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:42.131938 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b5f19-382a-4ff4-a179-687d5c8b6e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:42.132209 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b5f19-382a-4ff4-a179-687d5c8b6e42 admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:42.132925 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b5f19-382a-4ff4-a179-687d5c8b6e42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:42.133274 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b5f19-382a-4ff4-a179-687d5c8b6e42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:42.135700 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b5f19-382a-4ff4-a179-687d5c8b6e42 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:42.176448 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 954/1902] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 15:56:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:42.182979 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8923ff8-024d-467d-9efc-3bcef8f74f02 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:42.199483 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8923ff8-024d-467d-9efc-3bcef8f74f02 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:42.209661 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51c492-1f57-4b9a-a2a0-a1929451b222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:42.210323 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51c492-1f57-4b9a-a2a0-a1929451b222 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:42.210810 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51c492-1f57-4b9a-a2a0-a1929451b222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:42.211092 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51c492-1f57-4b9a-a2a0-a1929451b222 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:42.212328 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f51c492-1f57-4b9a-a2a0-a1929451b222 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:42.216267 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f51c492-1f57-4b9a-a2a0-a1929451b222 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:42.273653 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 949/1903] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:56:42 2022] POST /identity/v3/projects => generated 373 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:42.278769 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b5f19-382a-4ff4-a179-687d5c8b6e42 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:42.292417 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b5f19-382a-4ff4-a179-687d5c8b6e42 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:42.486032 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28acd700-e7d0-4997-909a-811a54bdd7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:42.491683 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acd700-e7d0-4997-909a-811a54bdd7ba admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:42.492283 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acd700-e7d0-4997-909a-811a54bdd7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:42.493995 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acd700-e7d0-4997-909a-811a54bdd7ba admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:42.496538 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28acd700-e7d0-4997-909a-811a54bdd7ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:42.505079 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28acd700-e7d0-4997-909a-811a54bdd7ba admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:42.510018 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51c492-1f57-4b9a-a2a0-a1929451b222 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:42.512353 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-9f51c492-1f57-4b9a-a2a0-a1929451b222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:42.534064 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51c492-1f57-4b9a-a2a0-a1929451b222 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:42.551475 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f34da-fbb2-4a6a-ae7c-8566b0574734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:42.552409 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f34da-fbb2-4a6a-ae7c-8566b0574734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:42.552761 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f34da-fbb2-4a6a-ae7c-8566b0574734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:42.553103 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f34da-fbb2-4a6a-ae7c-8566b0574734 admin admin] PATH_INFO: `/v3/projects/b402d2e9744c461fb698a053955f3b98` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:42.556574 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3f34da-fbb2-4a6a-ae7c-8566b0574734 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b402d2e9744c461fb698a053955f3b98)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:42.561835 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3f34da-fbb2-4a6a-ae7c-8566b0574734 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:42.608022 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 955/1904] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:56:42 2022] POST /identity/v3/users => generated 287 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:42.615014 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28acd700-e7d0-4997-909a-811a54bdd7ba admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:42.647406 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28acd700-e7d0-4997-909a-811a54bdd7ba admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:42.693099 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-db3f34da-fbb2-4a6a-ae7c-8566b0574734 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b402d2e9744c461fb698a053955f3b98', 'request_id': 'req-db3f34da-fbb2-4a6a-ae7c-8566b0574734'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:42.710372 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-db3f34da-fbb2-4a6a-ae7c-8566b0574734 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b402d2e9744c461fb698a053955f3b98', 'request_id': 'req-db3f34da-fbb2-4a6a-ae7c-8566b0574734'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:42.726012 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-db3f34da-fbb2-4a6a-ae7c-8566b0574734 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b402d2e9744c461fb698a053955f3b98', 'request_id': 'req-db3f34da-fbb2-4a6a-ae7c-8566b0574734'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:42.752885 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-db3f34da-fbb2-4a6a-ae7c-8566b0574734 admin admin] The token cache is being invalidate because project b402d2e9744c461fb698a053955f3b98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:56:42.752885 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-db3f34da-fbb2-4a6a-ae7c-8566b0574734 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:42.754135 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-db3f34da-fbb2-4a6a-ae7c-8566b0574734 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:42.756109 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 950/1905] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:56:42 2022] DELETE /identity/v3/projects/b402d2e9744c461fb698a053955f3b98 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:42.756906 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f34da-fbb2-4a6a-ae7c-8566b0574734 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:42.759909 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-db3f34da-fbb2-4a6a-ae7c-8566b0574734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:42.783458 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b6fbe-2bdd-4ed7-afe6-8d563023f015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:42.784094 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b6fbe-2bdd-4ed7-afe6-8d563023f015 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:42.784378 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b6fbe-2bdd-4ed7-afe6-8d563023f015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:42.784912 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b6fbe-2bdd-4ed7-afe6-8d563023f015 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:42.785300 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1b6fbe-2bdd-4ed7-afe6-8d563023f015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:42.787179 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1b6fbe-2bdd-4ed7-afe6-8d563023f015 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:42.809135 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 956/1906] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:42.810040 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b6fbe-2bdd-4ed7-afe6-8d563023f015 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:42.812219 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-6b1b6fbe-2bdd-4ed7-afe6-8d563023f015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:42.849255 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b6fbe-2bdd-4ed7-afe6-8d563023f015 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:42.860419 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751bc51c-f5a9-43a7-86da-a71b55a5c087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:42.861420 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751bc51c-f5a9-43a7-86da-a71b55a5c087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:42.861826 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751bc51c-f5a9-43a7-86da-a71b55a5c087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:42.862324 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751bc51c-f5a9-43a7-86da-a71b55a5c087 admin admin] PATH_INFO: `/v3/users/9ba6cb86b97a404dad0423eccea03102` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:42.871528 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751bc51c-f5a9-43a7-86da-a71b55a5c087 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ba6cb86b97a404dad0423eccea03102)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:42.875364 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751bc51c-f5a9-43a7-86da-a71b55a5c087 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:42.944294 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:42.966128 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f34da-fbb2-4a6a-ae7c-8566b0574734 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:42.976713 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a32bc4-f5ea-4fe5-82e7-7ccd309d9dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:42.977531 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a32bc4-f5ea-4fe5-82e7-7ccd309d9dbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:42.977885 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a32bc4-f5ea-4fe5-82e7-7ccd309d9dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:42.978460 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a32bc4-f5ea-4fe5-82e7-7ccd309d9dbe admin admin] PATH_INFO: `/v3/projects/b9f4d378c43a410d9b448693cd435da4` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:42.979892 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a32bc4-f5ea-4fe5-82e7-7ccd309d9dbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9f4d378c43a410d9b448693cd435da4)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:42.984079 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a32bc4-f5ea-4fe5-82e7-7ccd309d9dbe admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:42.990895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-751bc51c-f5a9-43a7-86da-a71b55a5c087 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ba6cb86b97a404dad0423eccea03102'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:43.001311 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-751bc51c-f5a9-43a7-86da-a71b55a5c087 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ba6cb86b97a404dad0423eccea03102'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:43.002100 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-751bc51c-f5a9-43a7-86da-a71b55a5c087 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ba6cb86b97a404dad0423eccea03102'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:43.005784 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:43.031813 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-751bc51c-f5a9-43a7-86da-a71b55a5c087 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ba6cb86b97a404dad0423eccea03102'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:43.036929 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-751bc51c-f5a9-43a7-86da-a71b55a5c087 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ba6cb86b97a404dad0423eccea03102'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:43.091878 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 957/1907] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:56:42 2022] DELETE /identity/v3/users/9ba6cb86b97a404dad0423eccea03102 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:43.096751 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b8a32bc4-f5ea-4fe5-82e7-7ccd309d9dbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9f4d378c43a410d9b448693cd435da4', 'request_id': 'req-b8a32bc4-f5ea-4fe5-82e7-7ccd309d9dbe'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:43.097339 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751bc51c-f5a9-43a7-86da-a71b55a5c087 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:43.103053 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-751bc51c-f5a9-43a7-86da-a71b55a5c087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:43.104364 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b8a32bc4-f5ea-4fe5-82e7-7ccd309d9dbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9f4d378c43a410d9b448693cd435da4', 'request_id': 'req-b8a32bc4-f5ea-4fe5-82e7-7ccd309d9dbe'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:43.111480 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b8a32bc4-f5ea-4fe5-82e7-7ccd309d9dbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9f4d378c43a410d9b448693cd435da4', 'request_id': 'req-b8a32bc4-f5ea-4fe5-82e7-7ccd309d9dbe'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:43.131838 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b8a32bc4-f5ea-4fe5-82e7-7ccd309d9dbe admin admin] The token cache is being invalidate because project b9f4d378c43a410d9b448693cd435da4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:56:43.132425 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b8a32bc4-f5ea-4fe5-82e7-7ccd309d9dbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:43.133228 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b8a32bc4-f5ea-4fe5-82e7-7ccd309d9dbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:43.143887 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 951/1908] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:56:42 2022] DELETE /identity/v3/projects/b9f4d378c43a410d9b448693cd435da4 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:43.146832 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a32bc4-f5ea-4fe5-82e7-7ccd309d9dbe admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:43.148574 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b8a32bc4-f5ea-4fe5-82e7-7ccd309d9dbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:43.312957 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a32bc4-f5ea-4fe5-82e7-7ccd309d9dbe admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:43.344291 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751bc51c-f5a9-43a7-86da-a71b55a5c087 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:43.358520 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a4cae6-b131-421b-9620-594cb3137216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:43.360127 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4cae6-b131-421b-9620-594cb3137216 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:43.367157 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4cae6-b131-421b-9620-594cb3137216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:43.367768 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4cae6-b131-421b-9620-594cb3137216 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:43.369141 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a4cae6-b131-421b-9620-594cb3137216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:43.371119 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a4cae6-b131-421b-9620-594cb3137216 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:43.396934 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 958/1909] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:43.400465 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbbe31-a049-4be2-9e84-db9d0f29f2f4 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:43.404816 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbbe31-a049-4be2-9e84-db9d0f29f2f4 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:43.405384 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbbe31-a049-4be2-9e84-db9d0f29f2f4 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:43.407146 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 959/1910] 10.222.0.16 () {54 vars in 921 bytes} [Wed Sep 7 15:56:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:43.411183 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbbe31-a049-4be2-9e84-db9d0f29f2f4 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:43.419323 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-4fdbbe31-a049-4be2-9e84-db9d0f29f2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:43.462720 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbbe31-a049-4be2-9e84-db9d0f29f2f4 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:43.503333 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa37f67-67c5-40bd-9618-1490d6432c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:43.503988 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa37f67-67c5-40bd-9618-1490d6432c98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:43.504278 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa37f67-67c5-40bd-9618-1490d6432c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:43.504546 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa37f67-67c5-40bd-9618-1490d6432c98 admin admin] PATH_INFO: `/v3/projects/3b547235a60a422a8a941fddadc97594` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:43.506459 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa37f67-67c5-40bd-9618-1490d6432c98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b547235a60a422a8a941fddadc97594)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:43.519877 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa37f67-67c5-40bd-9618-1490d6432c98 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:43.543992 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b435e-e5e4-4e22-ab7d-e4e9c6fc6010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:43.545278 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b435e-e5e4-4e22-ab7d-e4e9c6fc6010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:43.545570 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b435e-e5e4-4e22-ab7d-e4e9c6fc6010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:43.545848 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b435e-e5e4-4e22-ab7d-e4e9c6fc6010 admin admin] PATH_INFO: `/v3/users/a4ae908ab99940689d22bd94563ea511` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:43.547105 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b435e-e5e4-4e22-ab7d-e4e9c6fc6010 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4ae908ab99940689d22bd94563ea511)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:43.549132 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b435e-e5e4-4e22-ab7d-e4e9c6fc6010 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:43.666570 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:43.690131 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-277b435e-e5e4-4e22-ab7d-e4e9c6fc6010 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4ae908ab99940689d22bd94563ea511'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:43.699833 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-277b435e-e5e4-4e22-ab7d-e4e9c6fc6010 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4ae908ab99940689d22bd94563ea511'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:43.700948 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-277b435e-e5e4-4e22-ab7d-e4e9c6fc6010 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4ae908ab99940689d22bd94563ea511'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:43.711129 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-baa37f67-67c5-40bd-9618-1490d6432c98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b547235a60a422a8a941fddadc97594', 'request_id': 'req-baa37f67-67c5-40bd-9618-1490d6432c98'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:43.712568 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-277b435e-e5e4-4e22-ab7d-e4e9c6fc6010 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4ae908ab99940689d22bd94563ea511'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:43.713768 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-277b435e-e5e4-4e22-ab7d-e4e9c6fc6010 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4ae908ab99940689d22bd94563ea511'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:43.727009 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-baa37f67-67c5-40bd-9618-1490d6432c98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b547235a60a422a8a941fddadc97594', 'request_id': 'req-baa37f67-67c5-40bd-9618-1490d6432c98'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:43.749103 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-baa37f67-67c5-40bd-9618-1490d6432c98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b547235a60a422a8a941fddadc97594', 'request_id': 'req-baa37f67-67c5-40bd-9618-1490d6432c98'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:43.749967 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 952/1911] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:56:43 2022] DELETE /identity/v3/users/a4ae908ab99940689d22bd94563ea511 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:43.751066 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b435e-e5e4-4e22-ab7d-e4e9c6fc6010 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:43.752580 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-277b435e-e5e4-4e22-ab7d-e4e9c6fc6010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:43.804020 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-baa37f67-67c5-40bd-9618-1490d6432c98 admin admin] The token cache is being invalidate because project 3b547235a60a422a8a941fddadc97594 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:56:43.807872 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-baa37f67-67c5-40bd-9618-1490d6432c98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:43.808874 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-baa37f67-67c5-40bd-9618-1490d6432c98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:43.815168 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 960/1912] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:56:43 2022] DELETE /identity/v3/projects/3b547235a60a422a8a941fddadc97594 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:43.830360 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b18d8-7358-4117-b6a4-9baca9e31600 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:43.831028 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b18d8-7358-4117-b6a4-9baca9e31600 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:43.831459 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b18d8-7358-4117-b6a4-9baca9e31600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:43.864625 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-eb3b18d8-7358-4117-b6a4-9baca9e31600 None None] MFA Rules not processed for user `f9b13331a5fd48f5a2521ed1600f9f35`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:43.866068 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-eb3b18d8-7358-4117-b6a4-9baca9e31600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:43.948600 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b435e-e5e4-4e22-ab7d-e4e9c6fc6010 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:43.966214 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139abca-61b7-4fe6-a110-707de019c950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:43.966936 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139abca-61b7-4fe6-a110-707de019c950 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:43.967219 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139abca-61b7-4fe6-a110-707de019c950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:43.967538 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139abca-61b7-4fe6-a110-707de019c950 admin admin] PATH_INFO: `/v3/projects/331a24450b314fb4b85610439c08200a/users/91c8d997fc834fbcb56ea40e6599881c/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:43.987891 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:44.005962 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c139abca-61b7-4fe6-a110-707de019c950 admin admin] RBAC: Authorizing `identity:create_grant(project_id=331a24450b314fb4b85610439c08200a, user_id=91c8d997fc834fbcb56ea40e6599881c, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:44.009752 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c139abca-61b7-4fe6-a110-707de019c950 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:44.036932 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 953/1913] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:43 2022] PUT /identity/v3/projects/331a24450b314fb4b85610439c08200a/users/91c8d997fc834fbcb56ea40e6599881c/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:44.037893 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139abca-61b7-4fe6-a110-707de019c950 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:44.040915 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-c139abca-61b7-4fe6-a110-707de019c950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:44.054138 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 961/1914] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Sep 7 15:56:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:44.060232 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f0846-8a43-4a6e-91df-6e46f8e244ce None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:44.060582 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f0846-8a43-4a6e-91df-6e46f8e244ce None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:44.060898 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f0846-8a43-4a6e-91df-6e46f8e244ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:44.116668 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-8d7f0846-8a43-4a6e-91df-6e46f8e244ce None None] MFA Rules not processed for user `91c8d997fc834fbcb56ea40e6599881c`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:44.136610 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-8d7f0846-8a43-4a6e-91df-6e46f8e244ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:44.216931 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139abca-61b7-4fe6-a110-707de019c950 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:44.230479 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc61064-a767-4f22-92e8-7a8790771f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:44.231862 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc61064-a767-4f22-92e8-7a8790771f17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:44.232166 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc61064-a767-4f22-92e8-7a8790771f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:44.232446 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc61064-a767-4f22-92e8-7a8790771f17 admin admin] PATH_INFO: `/v3/users/4eda431653284b4a8bbbef0d5b6af7c1` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:44.236270 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc61064-a767-4f22-92e8-7a8790771f17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4eda431653284b4a8bbbef0d5b6af7c1)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:44.244539 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc61064-a767-4f22-92e8-7a8790771f17 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:44.335010 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:44.350133 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-fcc61064-a767-4f22-92e8-7a8790771f17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4eda431653284b4a8bbbef0d5b6af7c1'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:44.367583 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-fcc61064-a767-4f22-92e8-7a8790771f17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4eda431653284b4a8bbbef0d5b6af7c1'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:44.367583 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-fcc61064-a767-4f22-92e8-7a8790771f17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4eda431653284b4a8bbbef0d5b6af7c1'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:44.386819 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 962/1915] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:44.387231 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-fcc61064-a767-4f22-92e8-7a8790771f17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4eda431653284b4a8bbbef0d5b6af7c1'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:44.388075 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-fcc61064-a767-4f22-92e8-7a8790771f17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4eda431653284b4a8bbbef0d5b6af7c1'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:44.392698 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f0846-8a43-4a6e-91df-6e46f8e244ce None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:44.399366 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-8d7f0846-8a43-4a6e-91df-6e46f8e244ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:44.423274 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 954/1916] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:56:44 2022] DELETE /identity/v3/users/4eda431653284b4a8bbbef0d5b6af7c1 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:44.423274 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc61064-a767-4f22-92e8-7a8790771f17 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:44.428043 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-fcc61064-a767-4f22-92e8-7a8790771f17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:44.619200 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f0846-8a43-4a6e-91df-6e46f8e244ce None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:44.627016 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc61064-a767-4f22-92e8-7a8790771f17 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:44.644499 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf43f2-0c9e-4006-af5d-574196a9eb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:44.646115 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf43f2-0c9e-4006-af5d-574196a9eb64 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:44.647031 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf43f2-0c9e-4006-af5d-574196a9eb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:44.647031 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf43f2-0c9e-4006-af5d-574196a9eb64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:44.649861 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf43f2-0c9e-4006-af5d-574196a9eb64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:44.656630 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf43f2-0c9e-4006-af5d-574196a9eb64 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:44.731440 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 955/1917] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:56:44 2022] POST /identity/v3/projects => generated 371 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:44.736152 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf43f2-0c9e-4006-af5d-574196a9eb64 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:44.742576 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51888562-69f2-4322-8db1-a580d41537e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:44.744830 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51888562-69f2-4322-8db1-a580d41537e0 service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:44.745796 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51888562-69f2-4322-8db1-a580d41537e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:44.746263 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51888562-69f2-4322-8db1-a580d41537e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:44.748653 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-51888562-69f2-4322-8db1-a580d41537e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:44.768345 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51888562-69f2-4322-8db1-a580d41537e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:44.771071 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51888562-69f2-4322-8db1-a580d41537e0 service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:44.780943 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:44.793545 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 963/1918] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:44.856058 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf43f2-0c9e-4006-af5d-574196a9eb64 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:44.864468 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1432e9e-31ba-4d2a-bfc2-9e9e254b0d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:44.866045 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1432e9e-31ba-4d2a-bfc2-9e9e254b0d8b admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:44.866543 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1432e9e-31ba-4d2a-bfc2-9e9e254b0d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:44.866721 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1432e9e-31ba-4d2a-bfc2-9e9e254b0d8b admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:44.869210 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1432e9e-31ba-4d2a-bfc2-9e9e254b0d8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:44.871756 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1432e9e-31ba-4d2a-bfc2-9e9e254b0d8b admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:44.903181 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 956/1919] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:56:44 2022] POST /identity/v3/users => generated 292 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:44.907276 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51888562-69f2-4322-8db1-a580d41537e0 service nova] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:44.923642 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51888562-69f2-4322-8db1-a580d41537e0 service nova] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:44.933150 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2b920-f62f-453d-ad95-39d6dae7eaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:44.934017 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2b920-f62f-453d-ad95-39d6dae7eaa5 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:44.934540 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2b920-f62f-453d-ad95-39d6dae7eaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:44.935002 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2b920-f62f-453d-ad95-39d6dae7eaa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:44.935861 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a2b920-f62f-453d-ad95-39d6dae7eaa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:44.938010 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a2b920-f62f-453d-ad95-39d6dae7eaa5 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:44.957675 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 964/1920] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:44 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:44.957902 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1432e9e-31ba-4d2a-bfc2-9e9e254b0d8b admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:44.987201 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1432e9e-31ba-4d2a-bfc2-9e9e254b0d8b admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:45.007594 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b1b624-2a3b-4cdd-9c06-331a93022ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:45.008165 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1b624-2a3b-4cdd-9c06-331a93022ff2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:45.008951 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1b624-2a3b-4cdd-9c06-331a93022ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:45.008951 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1b624-2a3b-4cdd-9c06-331a93022ff2 admin admin] PATH_INFO: `/v3/projects/ab28cd68742d456dac9da13f7da8b6fd/users/cb59d662d3f34802991d7c8b95a7f1d6/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:45.030114 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b1b624-2a3b-4cdd-9c06-331a93022ff2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab28cd68742d456dac9da13f7da8b6fd, user_id=cb59d662d3f34802991d7c8b95a7f1d6, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:45.036468 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b1b624-2a3b-4cdd-9c06-331a93022ff2 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:45.067641 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 957/1921] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:44 2022] PUT /identity/v3/projects/ab28cd68742d456dac9da13f7da8b6fd/users/cb59d662d3f34802991d7c8b95a7f1d6/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:45.069388 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2b920-f62f-453d-ad95-39d6dae7eaa5 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:45.082494 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b1b624-2a3b-4cdd-9c06-331a93022ff2 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:45.083005 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2b920-f62f-453d-ad95-39d6dae7eaa5 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:45.084569 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-41b1b624-2a3b-4cdd-9c06-331a93022ff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:45.098841 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:DELETE=5,keystone:SELECT=89,keystone:INSERT=6 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:45.175645 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f216d73-da64-45cd-9606-b99b2e135b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:45.176238 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b1b624-2a3b-4cdd-9c06-331a93022ff2 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:45.177122 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f216d73-da64-45cd-9606-b99b2e135b80 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:45.177573 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f216d73-da64-45cd-9606-b99b2e135b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:45.178003 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f216d73-da64-45cd-9606-b99b2e135b80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:45.178845 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f216d73-da64-45cd-9606-b99b2e135b80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:45.180687 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60372b7d-f49e-4ccb-9394-82b821490135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:45.181035 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f216d73-da64-45cd-9606-b99b2e135b80 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:45.181328 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60372b7d-f49e-4ccb-9394-82b821490135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:45.181606 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60372b7d-f49e-4ccb-9394-82b821490135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:45.181877 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60372b7d-f49e-4ccb-9394-82b821490135 admin admin] PATH_INFO: `/v3/projects/3f33f490279b4cbfae45141b856e8f94` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:45.183341 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60372b7d-f49e-4ccb-9394-82b821490135 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f33f490279b4cbfae45141b856e8f94)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:45.186200 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60372b7d-f49e-4ccb-9394-82b821490135 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:45.203798 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 965/1922] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:45.205127 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f216d73-da64-45cd-9606-b99b2e135b80 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:45.220771 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f216d73-da64-45cd-9606-b99b2e135b80 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:45.230588 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca5523-0011-4c5e-aab0-9198a31f8118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:45.231280 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca5523-0011-4c5e-aab0-9198a31f8118 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:45.232120 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca5523-0011-4c5e-aab0-9198a31f8118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:45.232571 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca5523-0011-4c5e-aab0-9198a31f8118 admin admin] PATH_INFO: `/v3/projects/ab28cd68742d456dac9da13f7da8b6fd/users/cb59d662d3f34802991d7c8b95a7f1d6/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:45.236488 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ca5523-0011-4c5e-aab0-9198a31f8118 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab28cd68742d456dac9da13f7da8b6fd, user_id=cb59d662d3f34802991d7c8b95a7f1d6, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:45.240460 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ca5523-0011-4c5e-aab0-9198a31f8118 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:45.262283 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 966/1923] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:45 2022] PUT /identity/v3/projects/ab28cd68742d456dac9da13f7da8b6fd/users/cb59d662d3f34802991d7c8b95a7f1d6/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:45.270842 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902e000-beee-4af4-ba51-caed4a436f61 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:45.271119 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902e000-beee-4af4-ba51-caed4a436f61 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:45.271224 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-60372b7d-f49e-4ccb-9394-82b821490135 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f33f490279b4cbfae45141b856e8f94', 'request_id': 'req-60372b7d-f49e-4ccb-9394-82b821490135'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:45.271403 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902e000-beee-4af4-ba51-caed4a436f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:45.282268 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-60372b7d-f49e-4ccb-9394-82b821490135 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f33f490279b4cbfae45141b856e8f94', 'request_id': 'req-60372b7d-f49e-4ccb-9394-82b821490135'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:45.291567 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-60372b7d-f49e-4ccb-9394-82b821490135 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f33f490279b4cbfae45141b856e8f94', 'request_id': 'req-60372b7d-f49e-4ccb-9394-82b821490135'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:45.317124 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-60372b7d-f49e-4ccb-9394-82b821490135 admin admin] The token cache is being invalidate because project 3f33f490279b4cbfae45141b856e8f94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:56:45.317424 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-60372b7d-f49e-4ccb-9394-82b821490135 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:45.318209 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-60372b7d-f49e-4ccb-9394-82b821490135 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:45.319867 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 958/1924] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:56:45 2022] DELETE /identity/v3/projects/3f33f490279b4cbfae45141b856e8f94 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:45.325380 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e684dc4-9573-4dbd-ac8f-07229fc8dfe3 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:45.325787 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e684dc4-9573-4dbd-ac8f-07229fc8dfe3 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:45.326068 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e684dc4-9573-4dbd-ac8f-07229fc8dfe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:45.327159 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-a902e000-beee-4af4-ba51-caed4a436f61 None None] MFA Rules not processed for user `cb59d662d3f34802991d7c8b95a7f1d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:45.328800 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-a902e000-beee-4af4-ba51-caed4a436f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:45.356173 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-1e684dc4-9573-4dbd-ac8f-07229fc8dfe3 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:45.358483 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-1e684dc4-9573-4dbd-ac8f-07229fc8dfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:45.467185 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 967/1925] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:45 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:45.468184 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902e000-beee-4af4-ba51-caed4a436f61 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:45.473265 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-a902e000-beee-4af4-ba51-caed4a436f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:45.505766 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 959/1926] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:45.505766 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e684dc4-9573-4dbd-ac8f-07229fc8dfe3 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:45.505766 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-1e684dc4-9573-4dbd-ac8f-07229fc8dfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:45.563258 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:45.573511 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:45.582091 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902e000-beee-4af4-ba51-caed4a436f61 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:45.588679 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8169599-2395-467e-a963-76355a64d6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:45.589592 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8169599-2395-467e-a963-76355a64d6fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:45.590067 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8169599-2395-467e-a963-76355a64d6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:45.590537 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8169599-2395-467e-a963-76355a64d6fb admin admin] PATH_INFO: `/v3/projects/58425c686bac4320a299337627c44a88` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:45.592040 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8169599-2395-467e-a963-76355a64d6fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=58425c686bac4320a299337627c44a88)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:45.592305 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e684dc4-9573-4dbd-ac8f-07229fc8dfe3 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:45.594671 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8169599-2395-467e-a963-76355a64d6fb admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:45.602806 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20432e-49a2-4bab-8d53-e43cb9bc55cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:45.604774 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20432e-49a2-4bab-8d53-e43cb9bc55cc service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:45.605067 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20432e-49a2-4bab-8d53-e43cb9bc55cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:45.605476 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20432e-49a2-4bab-8d53-e43cb9bc55cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:45.624424 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d20432e-49a2-4bab-8d53-e43cb9bc55cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:45.626137 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d20432e-49a2-4bab-8d53-e43cb9bc55cc service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:45.637751 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 960/1927] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:45 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:45.650213 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f777c-2846-4903-968f-d3429022c2b0 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:45.651370 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f777c-2846-4903-968f-d3429022c2b0 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:45.652710 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f777c-2846-4903-968f-d3429022c2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:45.674032 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-c8169599-2395-467e-a963-76355a64d6fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58425c686bac4320a299337627c44a88', 'request_id': 'req-c8169599-2395-467e-a963-76355a64d6fb'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:45.684166 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-c8169599-2395-467e-a963-76355a64d6fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58425c686bac4320a299337627c44a88', 'request_id': 'req-c8169599-2395-467e-a963-76355a64d6fb'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:45.688255 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-f82f777c-2846-4903-968f-d3429022c2b0 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:45.689592 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-f82f777c-2846-4903-968f-d3429022c2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:45.699414 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-c8169599-2395-467e-a963-76355a64d6fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58425c686bac4320a299337627c44a88', 'request_id': 'req-c8169599-2395-467e-a963-76355a64d6fb'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:45.732265 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-c8169599-2395-467e-a963-76355a64d6fb admin admin] The token cache is being invalidate because project 58425c686bac4320a299337627c44a88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:56:45.732570 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-c8169599-2395-467e-a963-76355a64d6fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:45.738428 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-c8169599-2395-467e-a963-76355a64d6fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:45.741195 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 968/1928] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:56:45 2022] DELETE /identity/v3/projects/58425c686bac4320a299337627c44a88 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:45.741826 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8169599-2395-467e-a963-76355a64d6fb admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:45.748302 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-c8169599-2395-467e-a963-76355a64d6fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:45.793010 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 961/1929] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:45.794434 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865e8cc-167f-4897-82b7-d6d64d9b024d None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:45.794776 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865e8cc-167f-4897-82b7-d6d64d9b024d None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:45.795115 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865e8cc-167f-4897-82b7-d6d64d9b024d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:45.820144 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-6865e8cc-167f-4897-82b7-d6d64d9b024d None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:45.823317 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-6865e8cc-167f-4897-82b7-d6d64d9b024d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:45.828185 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8169599-2395-467e-a963-76355a64d6fb admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:45.833051 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637f5a5-7ae5-40c0-b730-c68a96d91f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:45.833985 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637f5a5-7ae5-40c0-b730-c68a96d91f3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:45.834112 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 962/1930] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:45.834236 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637f5a5-7ae5-40c0-b730-c68a96d91f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:45.834433 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637f5a5-7ae5-40c0-b730-c68a96d91f3c admin admin] PATH_INFO: `/v3/projects/c9856246c0f146c29846f2734ebff9c0` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:45.835612 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2637f5a5-7ae5-40c0-b730-c68a96d91f3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9856246c0f146c29846f2734ebff9c0)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:45.837626 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2637f5a5-7ae5-40c0-b730-c68a96d91f3c admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:45.839639 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865e8cc-167f-4897-82b7-d6d64d9b024d None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:45.842086 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-6865e8cc-167f-4897-82b7-d6d64d9b024d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:45.897429 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2637f5a5-7ae5-40c0-b730-c68a96d91f3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9856246c0f146c29846f2734ebff9c0', 'request_id': 'req-2637f5a5-7ae5-40c0-b730-c68a96d91f3c'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:45.904549 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2637f5a5-7ae5-40c0-b730-c68a96d91f3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9856246c0f146c29846f2734ebff9c0', 'request_id': 'req-2637f5a5-7ae5-40c0-b730-c68a96d91f3c'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:45.911497 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2637f5a5-7ae5-40c0-b730-c68a96d91f3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9856246c0f146c29846f2734ebff9c0', 'request_id': 'req-2637f5a5-7ae5-40c0-b730-c68a96d91f3c'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:45.924479 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865e8cc-167f-4897-82b7-d6d64d9b024d None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:45.928344 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2637f5a5-7ae5-40c0-b730-c68a96d91f3c admin admin] The token cache is being invalidate because project c9856246c0f146c29846f2734ebff9c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:56:45.928966 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2637f5a5-7ae5-40c0-b730-c68a96d91f3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:45.930507 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2637f5a5-7ae5-40c0-b730-c68a96d91f3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:45.933066 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 969/1931] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:56:45 2022] DELETE /identity/v3/projects/c9856246c0f146c29846f2734ebff9c0 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:45.937978 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637f5a5-7ae5-40c0-b730-c68a96d91f3c admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:45.939710 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-2637f5a5-7ae5-40c0-b730-c68a96d91f3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:45.964966 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:45.992090 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd3b77-f6ff-4447-8082-1a3a1f84f2b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:45.992744 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd3b77-f6ff-4447-8082-1a3a1f84f2b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:45.993173 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd3b77-f6ff-4447-8082-1a3a1f84f2b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:45.993459 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd3b77-f6ff-4447-8082-1a3a1f84f2b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:45.995402 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-4dbd3b77-f6ff-4447-8082-1a3a1f84f2b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:46.035435 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637f5a5-7ae5-40c0-b730-c68a96d91f3c admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:46.041414 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a7b20-5b91-427c-adfc-a5b8f5cea65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:46.042301 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a7b20-5b91-427c-adfc-a5b8f5cea65c admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:46.042735 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a7b20-5b91-427c-adfc-a5b8f5cea65c admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:46.043221 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a7b20-5b91-427c-adfc-a5b8f5cea65c admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:46.044152 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a7b20-5b91-427c-adfc-a5b8f5cea65c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:46.044685 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a7b20-5b91-427c-adfc-a5b8f5cea65c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:46.046995 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a7b20-5b91-427c-adfc-a5b8f5cea65c admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:46.064556 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 970/1932] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 15:56:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:46.064556 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef5ad7-f921-4d8e-8321-15489a7341e9 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:46.064556 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef5ad7-f921-4d8e-8321-15489a7341e9 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:46.064556 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef5ad7-f921-4d8e-8321-15489a7341e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:46.070640 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:46.087005 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-dfef5ad7-f921-4d8e-8321-15489a7341e9 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:46.088287 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-dfef5ad7-f921-4d8e-8321-15489a7341e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:46.090812 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd3b77-f6ff-4447-8082-1a3a1f84f2b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:46.092960 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd3b77-f6ff-4447-8082-1a3a1f84f2b1 service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:46.096545 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 971/1933] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:46.097764 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40277cb3-0fdf-4751-b88b-b8ab1347846a None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:46.098050 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40277cb3-0fdf-4751-b88b-b8ab1347846a None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:46.098364 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40277cb3-0fdf-4751-b88b-b8ab1347846a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:46.106245 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 963/1934] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:46.107174 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd3b77-f6ff-4447-8082-1a3a1f84f2b1 service cinder] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:46.121067 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd3b77-f6ff-4447-8082-1a3a1f84f2b1 service cinder] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:46.127190 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6815f0-d233-43c8-824d-f28a8c38504b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:46.127821 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6815f0-d233-43c8-824d-f28a8c38504b admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:46.128158 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6815f0-d233-43c8-824d-f28a8c38504b admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:46.128379 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6815f0-d233-43c8-824d-f28a8c38504b admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:46.129284 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6815f0-d233-43c8-824d-f28a8c38504b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:46.131772 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6815f0-d233-43c8-824d-f28a8c38504b admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:46.139876 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-40277cb3-0fdf-4751-b88b-b8ab1347846a None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:46.141828 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-40277cb3-0fdf-4751-b88b-b8ab1347846a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:46.153924 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 972/1935] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:46.155051 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40277cb3-0fdf-4751-b88b-b8ab1347846a None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:46.167069 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40277cb3-0fdf-4751-b88b-b8ab1347846a None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:46.172690 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc84f43-b0d8-4e48-b77d-4b48245c7f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:46.173298 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc84f43-b0d8-4e48-b77d-4b48245c7f76 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:46.173609 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc84f43-b0d8-4e48-b77d-4b48245c7f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:46.174043 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 964/1936] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:56:46 2022] POST /identity/v3/projects => generated 377 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:46.175582 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8275566-4557-493f-b140-f585ba29be13 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:46.175891 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8275566-4557-493f-b140-f585ba29be13 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:46.176329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8275566-4557-493f-b140-f585ba29be13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:46.176958 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc84f43-b0d8-4e48-b77d-4b48245c7f76 admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:46.178811 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc84f43-b0d8-4e48-b77d-4b48245c7f76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:46.180214 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc84f43-b0d8-4e48-b77d-4b48245c7f76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:46.182976 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc84f43-b0d8-4e48-b77d-4b48245c7f76 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:46.203478 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-f8275566-4557-493f-b140-f585ba29be13 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:46.205620 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-f8275566-4557-493f-b140-f585ba29be13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:46.206801 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 973/1937] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 15:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:46.207638 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc84f43-b0d8-4e48-b77d-4b48245c7f76 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:46.220107 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc84f43-b0d8-4e48-b77d-4b48245c7f76 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:46.327910 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef2341-1806-4dad-bfea-54c24487e6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:46.328547 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef2341-1806-4dad-bfea-54c24487e6ec admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:46.328866 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef2341-1806-4dad-bfea-54c24487e6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:46.329146 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef2341-1806-4dad-bfea-54c24487e6ec admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:46.330419 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ef2341-1806-4dad-bfea-54c24487e6ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:46.332698 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ef2341-1806-4dad-bfea-54c24487e6ec admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:46.355304 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 965/1938] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:46.356539 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8275566-4557-493f-b140-f585ba29be13 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:46.364059 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 974/1939] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:56:46 2022] POST /identity/v3/users => generated 289 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:46.365112 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef2341-1806-4dad-bfea-54c24487e6ec admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:46.372770 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8275566-4557-493f-b140-f585ba29be13 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:46.379289 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311282c-c403-4a74-9df4-d837a9d6dc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:46.380194 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311282c-c403-4a74-9df4-d837a9d6dc38 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:46.380692 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311282c-c403-4a74-9df4-d837a9d6dc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:46.381176 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311282c-c403-4a74-9df4-d837a9d6dc38 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:46.382069 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c311282c-c403-4a74-9df4-d837a9d6dc38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:46.384830 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c311282c-c403-4a74-9df4-d837a9d6dc38 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:46.392672 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef2341-1806-4dad-bfea-54c24487e6ec admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:46.405094 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a14ce-2323-4e71-b08d-ccbfd20bfb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:46.406440 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a14ce-2323-4e71-b08d-ccbfd20bfb47 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:46.406730 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a14ce-2323-4e71-b08d-ccbfd20bfb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:46.407017 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a14ce-2323-4e71-b08d-ccbfd20bfb47 admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:46.407965 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a14ce-2323-4e71-b08d-ccbfd20bfb47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:46.408345 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a14ce-2323-4e71-b08d-ccbfd20bfb47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:46.409971 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a14ce-2323-4e71-b08d-ccbfd20bfb47 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:46.432788 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 966/1940] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:56:46 2022] POST /identity/v3/projects => generated 399 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:46.432788 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311282c-c403-4a74-9df4-d837a9d6dc38 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:46.434517 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 975/1941] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 15:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:46.435815 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a14ce-2323-4e71-b08d-ccbfd20bfb47 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:46.484358 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a14ce-2323-4e71-b08d-ccbfd20bfb47 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:46.514247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311282c-c403-4a74-9df4-d837a9d6dc38 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:46.519668 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e7aef-d89b-454b-95c7-47b774136047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:46.520916 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e7aef-d89b-454b-95c7-47b774136047 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:46.521086 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e7aef-d89b-454b-95c7-47b774136047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:46.521480 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e7aef-d89b-454b-95c7-47b774136047 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:46.522260 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9e7aef-d89b-454b-95c7-47b774136047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:46.523979 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9e7aef-d89b-454b-95c7-47b774136047 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:46.537965 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 967/1942] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:46.539049 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e7aef-d89b-454b-95c7-47b774136047 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:46.552191 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e7aef-d89b-454b-95c7-47b774136047 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:46.559511 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5983d2-63fe-4e59-992d-f22c40da3c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:46.560449 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5983d2-63fe-4e59-992d-f22c40da3c0d admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:46.560620 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5983d2-63fe-4e59-992d-f22c40da3c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:46.561273 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5983d2-63fe-4e59-992d-f22c40da3c0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:46.561923 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5983d2-63fe-4e59-992d-f22c40da3c0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:46.562203 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7288b029-e208-42d2-a587-cfd329c5a544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:46.563449 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288b029-e208-42d2-a587-cfd329c5a544 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:46.563449 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288b029-e208-42d2-a587-cfd329c5a544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:46.563449 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288b029-e208-42d2-a587-cfd329c5a544 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:46.563920 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5983d2-63fe-4e59-992d-f22c40da3c0d admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:46.564238 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7288b029-e208-42d2-a587-cfd329c5a544 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:46.566587 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7288b029-e208-42d2-a587-cfd329c5a544 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:46.575775 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:46.596510 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 968/1943] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:56:46 2022] POST /identity/v3/projects => generated 387 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:46.597113 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 976/1944] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:56:46 2022] POST /identity/v3/users => generated 300 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:46.597939 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5983d2-63fe-4e59-992d-f22c40da3c0d admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:46.600575 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7288b029-e208-42d2-a587-cfd329c5a544 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:46.611685 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7288b029-e208-42d2-a587-cfd329c5a544 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:46.619564 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:46.672270 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5983d2-63fe-4e59-992d-f22c40da3c0d admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:46.677467 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc133f74-f33d-402e-870e-b08439e67dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:46.678294 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc133f74-f33d-402e-870e-b08439e67dca admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:46.678777 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc133f74-f33d-402e-870e-b08439e67dca admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:46.679198 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc133f74-f33d-402e-870e-b08439e67dca admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:46.679836 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7d09f-ec87-4dba-83cd-806c2b620215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:46.680813 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc133f74-f33d-402e-870e-b08439e67dca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:46.680975 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7d09f-ec87-4dba-83cd-806c2b620215 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:46.681264 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7d09f-ec87-4dba-83cd-806c2b620215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:46.681714 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7d09f-ec87-4dba-83cd-806c2b620215 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:46.682387 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd7d09f-ec87-4dba-83cd-806c2b620215 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:46.683329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc133f74-f33d-402e-870e-b08439e67dca admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:46.684295 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd7d09f-ec87-4dba-83cd-806c2b620215 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:46.697483 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 969/1945] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:46.697483 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc133f74-f33d-402e-870e-b08439e67dca admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:46.705441 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc133f74-f33d-402e-870e-b08439e67dca admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:46.710482 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 977/1946] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:56:46 2022] POST /identity/v3/users => generated 294 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:46.710775 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7d09f-ec87-4dba-83cd-806c2b620215 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:46.713747 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c13df-77de-4a7b-a016-80769d6ba64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:46.714394 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c13df-77de-4a7b-a016-80769d6ba64e admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:46.714676 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c13df-77de-4a7b-a016-80769d6ba64e admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:46.714945 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c13df-77de-4a7b-a016-80769d6ba64e admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:46.715579 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8c13df-77de-4a7b-a016-80769d6ba64e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:46.717166 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8c13df-77de-4a7b-a016-80769d6ba64e admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:46.720952 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7d09f-ec87-4dba-83cd-806c2b620215 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:46.725652 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e629a-5b39-4962-aa79-94be1b575cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:46.726374 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e629a-5b39-4962-aa79-94be1b575cf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:46.726640 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e629a-5b39-4962-aa79-94be1b575cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:46.726915 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e629a-5b39-4962-aa79-94be1b575cf6 admin admin] PATH_INFO: `/v3/projects/b527da681a014427bc3e4ed1be082671/users/92025f2a8eae44749b032e740ecc92a1/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:46.727364 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 970/1947] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:46.728161 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c13df-77de-4a7b-a016-80769d6ba64e admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:46.737985 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c13df-77de-4a7b-a016-80769d6ba64e admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:46.743149 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37187b7d-2a83-49d5-aac3-fe430d6977b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:46.743287 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5e629a-5b39-4962-aa79-94be1b575cf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b527da681a014427bc3e4ed1be082671, user_id=92025f2a8eae44749b032e740ecc92a1, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:46.743755 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37187b7d-2a83-49d5-aac3-fe430d6977b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:46.744034 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37187b7d-2a83-49d5-aac3-fe430d6977b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:46.744305 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37187b7d-2a83-49d5-aac3-fe430d6977b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:46.744933 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37187b7d-2a83-49d5-aac3-fe430d6977b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:46.745824 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5e629a-5b39-4962-aa79-94be1b575cf6 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:46.746543 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37187b7d-2a83-49d5-aac3-fe430d6977b6 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:46.761469 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 971/1948] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:46.761469 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37187b7d-2a83-49d5-aac3-fe430d6977b6 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:46.761816 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 978/1949] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:46 2022] PUT /identity/v3/projects/b527da681a014427bc3e4ed1be082671/users/92025f2a8eae44749b032e740ecc92a1/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:46.767349 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e629a-5b39-4962-aa79-94be1b575cf6 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:46.771396 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37187b7d-2a83-49d5-aac3-fe430d6977b6 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:46.832995 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2210ac-4a9b-4672-a001-cd4ad840d63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:46.833722 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2210ac-4a9b-4672-a001-cd4ad840d63d admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:46.834007 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2210ac-4a9b-4672-a001-cd4ad840d63d admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:46.834319 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2210ac-4a9b-4672-a001-cd4ad840d63d admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:46.834971 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2210ac-4a9b-4672-a001-cd4ad840d63d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:46.835070 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e629a-5b39-4962-aa79-94be1b575cf6 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:46.836829 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2210ac-4a9b-4672-a001-cd4ad840d63d admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:46.840168 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94536fb9-51af-4668-a1c2-3307d3140ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:46.840783 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94536fb9-51af-4668-a1c2-3307d3140ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:46.841066 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94536fb9-51af-4668-a1c2-3307d3140ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:46.841341 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94536fb9-51af-4668-a1c2-3307d3140ea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:46.842238 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94536fb9-51af-4668-a1c2-3307d3140ea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:46.843666 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94536fb9-51af-4668-a1c2-3307d3140ea0 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:46.847883 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 972/1950] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:46.849971 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99370974-423f-46bf-aa46-6e9a3a28bcb5 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:46.850511 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99370974-423f-46bf-aa46-6e9a3a28bcb5 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:46.850622 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99370974-423f-46bf-aa46-6e9a3a28bcb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:46.860282 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 979/1951] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:46.860282 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94536fb9-51af-4668-a1c2-3307d3140ea0 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:46.871950 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94536fb9-51af-4668-a1c2-3307d3140ea0 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:46.879721 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f16c96-aced-457b-a778-2e75811e0894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:46.880419 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f16c96-aced-457b-a778-2e75811e0894 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:46.880695 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f16c96-aced-457b-a778-2e75811e0894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:46.880976 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f16c96-aced-457b-a778-2e75811e0894 admin admin] PATH_INFO: `/v3/projects/a7243522b1c241c398dc0ea6fd832ca5/users/b88e4ea3dce046a7a79e3208615deff5/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:46.882056 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-99370974-423f-46bf-aa46-6e9a3a28bcb5 None None] MFA Rules not processed for user `92025f2a8eae44749b032e740ecc92a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:46.883441 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-99370974-423f-46bf-aa46-6e9a3a28bcb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:46.900414 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f16c96-aced-457b-a778-2e75811e0894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7243522b1c241c398dc0ea6fd832ca5, user_id=b88e4ea3dce046a7a79e3208615deff5, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:46.903240 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f16c96-aced-457b-a778-2e75811e0894 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:46.919128 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 980/1952] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:46 2022] PUT /identity/v3/projects/a7243522b1c241c398dc0ea6fd832ca5/users/b88e4ea3dce046a7a79e3208615deff5/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:46.920006 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f16c96-aced-457b-a778-2e75811e0894 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:46.955249 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:46.967190 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 973/1953] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:46.968381 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a67f9c-f612-4c68-9809-9026293cd6e3 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:46.968748 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a67f9c-f612-4c68-9809-9026293cd6e3 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:46.969250 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a67f9c-f612-4c68-9809-9026293cd6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:47.005294 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f16c96-aced-457b-a778-2e75811e0894 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:47.010773 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa02b8-5129-4b35-b22e-57ed561bc966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:47.010970 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-06a67f9c-f612-4c68-9809-9026293cd6e3 None None] MFA Rules not processed for user `b88e4ea3dce046a7a79e3208615deff5`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:47.011641 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa02b8-5129-4b35-b22e-57ed561bc966 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:47.011996 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa02b8-5129-4b35-b22e-57ed561bc966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:47.012120 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-06a67f9c-f612-4c68-9809-9026293cd6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:47.012393 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa02b8-5129-4b35-b22e-57ed561bc966 admin admin] PATH_INFO: `/v3/projects/09aaf3248627477e86f77b1b3c86dd55/users/bb7d85ad602c4ef38374338b9fc45cd1/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:47.018041 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:47.032834 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa02b8-5129-4b35-b22e-57ed561bc966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09aaf3248627477e86f77b1b3c86dd55, user_id=bb7d85ad602c4ef38374338b9fc45cd1, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:47.049416 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa02b8-5129-4b35-b22e-57ed561bc966 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:47.067851 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 981/1954] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:46 2022] PUT /identity/v3/projects/09aaf3248627477e86f77b1b3c86dd55/users/bb7d85ad602c4ef38374338b9fc45cd1/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:47.074409 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa02b8-5129-4b35-b22e-57ed561bc966 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:47.130297 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 974/1955] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:46 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:47.131849 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c5b0b-d063-4e7e-87df-db5708df51d2 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:47.132277 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c5b0b-d063-4e7e-87df-db5708df51d2 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:47.132686 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c5b0b-d063-4e7e-87df-db5708df51d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:47.167354 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-2f8c5b0b-d063-4e7e-87df-db5708df51d2 None None] MFA Rules not processed for user `bb7d85ad602c4ef38374338b9fc45cd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:47.168568 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-2f8c5b0b-d063-4e7e-87df-db5708df51d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:47.188899 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa02b8-5129-4b35-b22e-57ed561bc966 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:47.193640 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96eac36-ab54-4391-81ba-b7763d5669a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:47.194269 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96eac36-ab54-4391-81ba-b7763d5669a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:47.194550 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96eac36-ab54-4391-81ba-b7763d5669a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:47.194821 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96eac36-ab54-4391-81ba-b7763d5669a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:47.195561 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96eac36-ab54-4391-81ba-b7763d5669a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:47.197618 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96eac36-ab54-4391-81ba-b7763d5669a2 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:47.231876 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 982/1956] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:56:47 2022] POST /identity/v3/projects => generated 375 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:47.231876 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96eac36-ab54-4391-81ba-b7763d5669a2 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:47.269094 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 975/1957] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:47.270041 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c5b0b-d063-4e7e-87df-db5708df51d2 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:47.272300 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-2f8c5b0b-d063-4e7e-87df-db5708df51d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:47.332275 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96eac36-ab54-4391-81ba-b7763d5669a2 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:47.339819 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626eed2-68fd-43cc-b6be-42b1090d3e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:47.340533 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626eed2-68fd-43cc-b6be-42b1090d3e71 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:47.340841 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626eed2-68fd-43cc-b6be-42b1090d3e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:47.341405 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626eed2-68fd-43cc-b6be-42b1090d3e71 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:47.342051 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a626eed2-68fd-43cc-b6be-42b1090d3e71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:47.344158 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a626eed2-68fd-43cc-b6be-42b1090d3e71 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:47.347445 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c5b0b-d063-4e7e-87df-db5708df51d2 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:47.385718 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 983/1958] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:56:47 2022] POST /identity/v3/projects => generated 401 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:47.386836 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626eed2-68fd-43cc-b6be-42b1090d3e71 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:47.412533 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f692e-cf31-4f66-aed8-234e2ff468cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:47.413436 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f692e-cf31-4f66-aed8-234e2ff468cd service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:47.413922 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f692e-cf31-4f66-aed8-234e2ff468cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:47.414230 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f692e-cf31-4f66-aed8-234e2ff468cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:47.414713 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:47.417902 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-c83f692e-cf31-4f66-aed8-234e2ff468cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:47.428064 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:47.482437 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626eed2-68fd-43cc-b6be-42b1090d3e71 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:47.488233 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54492a6-554a-4aef-bc0e-f3c314bbcc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:47.489233 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54492a6-554a-4aef-bc0e-f3c314bbcc08 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:47.489400 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54492a6-554a-4aef-bc0e-f3c314bbcc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:47.489804 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54492a6-554a-4aef-bc0e-f3c314bbcc08 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:47.490547 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54492a6-554a-4aef-bc0e-f3c314bbcc08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:47.493082 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54492a6-554a-4aef-bc0e-f3c314bbcc08 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:47.501791 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f692e-cf31-4f66-aed8-234e2ff468cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:47.503295 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f692e-cf31-4f66-aed8-234e2ff468cd service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:47.515171 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 976/1959] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:47 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:47.516206 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f692e-cf31-4f66-aed8-234e2ff468cd service cinder] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:47.520332 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 984/1960] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:56:47 2022] POST /identity/v3/users => generated 294 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:47.521025 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54492a6-554a-4aef-bc0e-f3c314bbcc08 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:47.530454 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f692e-cf31-4f66-aed8-234e2ff468cd service cinder] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:47.536681 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54492a6-554a-4aef-bc0e-f3c314bbcc08 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:47.537056 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e6807-d24e-4f9a-812a-4611cef48ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:47.537670 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e6807-d24e-4f9a-812a-4611cef48ab7 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:47.537955 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e6807-d24e-4f9a-812a-4611cef48ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:47.538259 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e6807-d24e-4f9a-812a-4611cef48ab7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:47.538895 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5e6807-d24e-4f9a-812a-4611cef48ab7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:47.540886 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5e6807-d24e-4f9a-812a-4611cef48ab7 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:47.543577 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247da29-f0d0-4da9-b203-e59cf7d462a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:47.544318 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247da29-f0d0-4da9-b203-e59cf7d462a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:47.544647 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247da29-f0d0-4da9-b203-e59cf7d462a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:47.545037 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247da29-f0d0-4da9-b203-e59cf7d462a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:47.545900 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247da29-f0d0-4da9-b203-e59cf7d462a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:47.548699 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247da29-f0d0-4da9-b203-e59cf7d462a0 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:47.575513 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 985/1961] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:56:47 2022] POST /identity/v3/users => generated 307 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:47.579655 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247da29-f0d0-4da9-b203-e59cf7d462a0 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:47.580732 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 977/1962] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:56:47 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:47.581709 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e6807-d24e-4f9a-812a-4611cef48ab7 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:47.595712 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247da29-f0d0-4da9-b203-e59cf7d462a0 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:47.662815 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2e7fb-db9c-4f2c-b097-cd95736537f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:47.663880 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2e7fb-db9c-4f2c-b097-cd95736537f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:47.664330 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2e7fb-db9c-4f2c-b097-cd95736537f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:47.665283 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2e7fb-db9c-4f2c-b097-cd95736537f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:47.666159 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b2e7fb-db9c-4f2c-b097-cd95736537f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:47.668382 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b2e7fb-db9c-4f2c-b097-cd95736537f0 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:47.687646 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 986/1963] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:47.688627 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2e7fb-db9c-4f2c-b097-cd95736537f0 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:47.694998 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e6807-d24e-4f9a-812a-4611cef48ab7 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:47.704625 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2e7fb-db9c-4f2c-b097-cd95736537f0 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:47.707922 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd6981-87f1-46c6-ad82-dd52abcaa0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:47.709729 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd6981-87f1-46c6-ad82-dd52abcaa0ee admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:47.711278 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd6981-87f1-46c6-ad82-dd52abcaa0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:47.712188 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd6981-87f1-46c6-ad82-dd52abcaa0ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:47.712877 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd6981-87f1-46c6-ad82-dd52abcaa0ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:47.714551 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd6981-87f1-46c6-ad82-dd52abcaa0ee admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:47.731261 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d8dea2-91c5-4f80-a86c-0a10d19ccc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:47.732845 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8dea2-91c5-4f80-a86c-0a10d19ccc05 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:47.733143 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8dea2-91c5-4f80-a86c-0a10d19ccc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:47.734921 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8dea2-91c5-4f80-a86c-0a10d19ccc05 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:47.737530 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d8dea2-91c5-4f80-a86c-0a10d19ccc05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:47.741675 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d8dea2-91c5-4f80-a86c-0a10d19ccc05 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:47.745483 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 978/1964] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:47.746433 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd6981-87f1-46c6-ad82-dd52abcaa0ee admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:47.770914 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd6981-87f1-46c6-ad82-dd52abcaa0ee admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:47.790701 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bdfd53-35cc-4b41-8593-5dc3cf0b615c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:47.791532 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdfd53-35cc-4b41-8593-5dc3cf0b615c admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:47.791913 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdfd53-35cc-4b41-8593-5dc3cf0b615c admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:47.792264 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdfd53-35cc-4b41-8593-5dc3cf0b615c admin admin] PATH_INFO: `/v3/projects/af389f7e7fda442983328a92ce6d6661/users/9b206d287237495c8701676b6675e059/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:47.797163 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 987/1965] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:56:47 2022] POST /identity/v3/users => generated 299 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:47.798292 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d8dea2-91c5-4f80-a86c-0a10d19ccc05 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:47.818955 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d8dea2-91c5-4f80-a86c-0a10d19ccc05 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:47.840111 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ddde5d-c2be-4f9d-8f0b-45301fb43abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:47.840731 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ddde5d-c2be-4f9d-8f0b-45301fb43abc admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:47.841017 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ddde5d-c2be-4f9d-8f0b-45301fb43abc admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:47.841294 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ddde5d-c2be-4f9d-8f0b-45301fb43abc admin admin] PATH_INFO: `/v3/projects/3b971e6512bd45febd81b564ba91238b/users/739e4f03d3ca4e0cb42e89317d82db56/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:47.845311 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bdfd53-35cc-4b41-8593-5dc3cf0b615c admin admin] RBAC: Authorizing `identity:create_grant(project_id=af389f7e7fda442983328a92ce6d6661, user_id=9b206d287237495c8701676b6675e059, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:47.848626 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bdfd53-35cc-4b41-8593-5dc3cf0b615c admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:47.874070 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 979/1966] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:47 2022] PUT /identity/v3/projects/af389f7e7fda442983328a92ce6d6661/users/9b206d287237495c8701676b6675e059/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:47.874978 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bdfd53-35cc-4b41-8593-5dc3cf0b615c admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:47.878970 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ddde5d-c2be-4f9d-8f0b-45301fb43abc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b971e6512bd45febd81b564ba91238b, user_id=739e4f03d3ca4e0cb42e89317d82db56, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:47.882539 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ddde5d-c2be-4f9d-8f0b-45301fb43abc admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:47.918118 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 988/1967] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:47 2022] PUT /identity/v3/projects/3b971e6512bd45febd81b564ba91238b/users/739e4f03d3ca4e0cb42e89317d82db56/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:47.921686 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ddde5d-c2be-4f9d-8f0b-45301fb43abc admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:48.011184 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:48.028253 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bdfd53-35cc-4b41-8593-5dc3cf0b615c admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:48.050674 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:48.092847 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ddde5d-c2be-4f9d-8f0b-45301fb43abc admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:48.100163 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453726e-9006-4282-8832-18312833344c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:48.101345 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453726e-9006-4282-8832-18312833344c admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:48.101900 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453726e-9006-4282-8832-18312833344c admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:48.102748 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453726e-9006-4282-8832-18312833344c admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:48.103645 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7453726e-9006-4282-8832-18312833344c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:48.106859 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7453726e-9006-4282-8832-18312833344c admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:48.119477 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e40126-83d8-44ad-bca3-de98f12bcc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:48.120159 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e40126-83d8-44ad-bca3-de98f12bcc13 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:48.120447 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e40126-83d8-44ad-bca3-de98f12bcc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:48.120726 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e40126-83d8-44ad-bca3-de98f12bcc13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:48.121374 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e40126-83d8-44ad-bca3-de98f12bcc13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:48.121478 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 989/1968] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:48.122254 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453726e-9006-4282-8832-18312833344c admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:48.123458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e40126-83d8-44ad-bca3-de98f12bcc13 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:48.137139 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453726e-9006-4282-8832-18312833344c admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:48.140039 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 980/1969] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:48.141038 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e40126-83d8-44ad-bca3-de98f12bcc13 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:48.151365 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223b29e-57e7-4f11-8eb7-efdacf053c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:48.152647 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223b29e-57e7-4f11-8eb7-efdacf053c1c admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:48.152810 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e40126-83d8-44ad-bca3-de98f12bcc13 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:48.153087 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223b29e-57e7-4f11-8eb7-efdacf053c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:48.153822 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223b29e-57e7-4f11-8eb7-efdacf053c1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:48.154439 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223b29e-57e7-4f11-8eb7-efdacf053c1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:48.156772 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223b29e-57e7-4f11-8eb7-efdacf053c1c admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:48.158681 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90202d10-6d4c-4726-90ef-506a8efd04bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:48.159568 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90202d10-6d4c-4726-90ef-506a8efd04bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:48.160013 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90202d10-6d4c-4726-90ef-506a8efd04bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:48.160677 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90202d10-6d4c-4726-90ef-506a8efd04bd admin admin] PATH_INFO: `/v3/projects/af389f7e7fda442983328a92ce6d6661/users/9b206d287237495c8701676b6675e059/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:48.162895 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90202d10-6d4c-4726-90ef-506a8efd04bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=af389f7e7fda442983328a92ce6d6661, user_id=9b206d287237495c8701676b6675e059, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:48.166571 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90202d10-6d4c-4726-90ef-506a8efd04bd admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:48.170155 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 990/1970] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:48.171151 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223b29e-57e7-4f11-8eb7-efdacf053c1c admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:48.183791 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223b29e-57e7-4f11-8eb7-efdacf053c1c admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:48.197902 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 981/1971] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:48 2022] PUT /identity/v3/projects/af389f7e7fda442983328a92ce6d6661/users/9b206d287237495c8701676b6675e059/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:48.197902 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90202d10-6d4c-4726-90ef-506a8efd04bd admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:48.270200 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90202d10-6d4c-4726-90ef-506a8efd04bd admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:48.277342 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e94cfe-f113-4040-b191-ba6fe0530a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:48.278085 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e94cfe-f113-4040-b191-ba6fe0530a44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:48.278394 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e94cfe-f113-4040-b191-ba6fe0530a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:48.278669 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e94cfe-f113-4040-b191-ba6fe0530a44 admin admin] PATH_INFO: `/v3/projects/3b971e6512bd45febd81b564ba91238b/users/739e4f03d3ca4e0cb42e89317d82db56/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:48.281333 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e94cfe-f113-4040-b191-ba6fe0530a44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b971e6512bd45febd81b564ba91238b, user_id=739e4f03d3ca4e0cb42e89317d82db56, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:48.284535 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e94cfe-f113-4040-b191-ba6fe0530a44 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:48.289167 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782e82c-8a03-4e1b-bc7c-9aa9d28bc253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:48.290127 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782e82c-8a03-4e1b-bc7c-9aa9d28bc253 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:48.290653 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782e82c-8a03-4e1b-bc7c-9aa9d28bc253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:48.290994 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782e82c-8a03-4e1b-bc7c-9aa9d28bc253 admin admin] PATH_INFO: `/v3/projects/ec71c955b8164bbfb8510f5f9bdead18/users/b2c7c6c0285e482e9367777bb4a5bc8b/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:48.297205 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 982/1972] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:48 2022] PUT /identity/v3/projects/3b971e6512bd45febd81b564ba91238b/users/739e4f03d3ca4e0cb42e89317d82db56/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:48.298606 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2dedde-3c91-40e7-9057-f7f4f8a14da6 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:48.298894 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2dedde-3c91-40e7-9057-f7f4f8a14da6 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:48.299186 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2dedde-3c91-40e7-9057-f7f4f8a14da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:48.323452 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c782e82c-8a03-4e1b-bc7c-9aa9d28bc253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec71c955b8164bbfb8510f5f9bdead18, user_id=b2c7c6c0285e482e9367777bb4a5bc8b, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:48.326981 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c782e82c-8a03-4e1b-bc7c-9aa9d28bc253 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:48.339493 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-2c2dedde-3c91-40e7-9057-f7f4f8a14da6 None None] MFA Rules not processed for user `9b206d287237495c8701676b6675e059`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:48.340475 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-2c2dedde-3c91-40e7-9057-f7f4f8a14da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:48.344711 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 991/1973] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:48 2022] PUT /identity/v3/projects/ec71c955b8164bbfb8510f5f9bdead18/users/b2c7c6c0285e482e9367777bb4a5bc8b/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:48.349550 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b25daf-ef6a-40b6-bcce-00c67ebfa85c None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:48.349842 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b25daf-ef6a-40b6-bcce-00c67ebfa85c None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:48.350631 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b25daf-ef6a-40b6-bcce-00c67ebfa85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:48.389269 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-07b25daf-ef6a-40b6-bcce-00c67ebfa85c None None] MFA Rules not processed for user `739e4f03d3ca4e0cb42e89317d82db56`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:48.390859 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-07b25daf-ef6a-40b6-bcce-00c67ebfa85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:48.435395 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:48.440297 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 983/1974] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:48 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:48.442070 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2dedde-3c91-40e7-9057-f7f4f8a14da6 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:48.473646 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 992/1975] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:48 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:48.475357 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b25daf-ef6a-40b6-bcce-00c67ebfa85c None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:48.527745 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:48.535197 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2dedde-3c91-40e7-9057-f7f4f8a14da6 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:48.541137 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada0d52-89d5-4932-a599-85933315b136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:48.541754 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada0d52-89d5-4932-a599-85933315b136 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:48.542044 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada0d52-89d5-4932-a599-85933315b136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:48.543150 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b25daf-ef6a-40b6-bcce-00c67ebfa85c None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:48.543961 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada0d52-89d5-4932-a599-85933315b136 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:48.544626 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada0d52-89d5-4932-a599-85933315b136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:48.546288 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada0d52-89d5-4932-a599-85933315b136 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:48.548187 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488ac75-c986-44c1-852f-f4234f1b5a72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:48.548816 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488ac75-c986-44c1-852f-f4234f1b5a72 service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:48.549099 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488ac75-c986-44c1-852f-f4234f1b5a72 service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:48.549375 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488ac75-c986-44c1-852f-f4234f1b5a72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:48.559665 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 984/1976] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:48.560612 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada0d52-89d5-4932-a599-85933315b136 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:48.572992 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-1ada0d52-89d5-4932-a599-85933315b136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:48.589533 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada0d52-89d5-4932-a599-85933315b136 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:48.594320 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081ebad-34ad-4579-9aa4-a5af97009e0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:48.595168 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081ebad-34ad-4579-9aa4-a5af97009e0c service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:48.595634 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081ebad-34ad-4579-9aa4-a5af97009e0c service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:48.596061 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081ebad-34ad-4579-9aa4-a5af97009e0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:48.608162 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5081ebad-34ad-4579-9aa4-a5af97009e0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:48.609942 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5081ebad-34ad-4579-9aa4-a5af97009e0c service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:48.621969 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 985/1977] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:48 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:48.623052 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081ebad-34ad-4579-9aa4-a5af97009e0c service cinder] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:48.636328 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081ebad-34ad-4579-9aa4-a5af97009e0c service cinder] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:48.642055 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488ac75-c986-44c1-852f-f4234f1b5a72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:48.643822 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488ac75-c986-44c1-852f-f4234f1b5a72 service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:48.646077 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69dc4e-6759-4df9-b133-6970731eb520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:48.646953 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69dc4e-6759-4df9-b133-6970731eb520 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:48.647421 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69dc4e-6759-4df9-b133-6970731eb520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:48.647705 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69dc4e-6759-4df9-b133-6970731eb520 admin admin] PATH_INFO: `/v3/projects/ec71c955b8164bbfb8510f5f9bdead18/users/b2c7c6c0285e482e9367777bb4a5bc8b/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:48.651529 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f69dc4e-6759-4df9-b133-6970731eb520 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec71c955b8164bbfb8510f5f9bdead18, user_id=b2c7c6c0285e482e9367777bb4a5bc8b, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:48.654544 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f69dc4e-6759-4df9-b133-6970731eb520 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:48.686367 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 986/1978] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:48 2022] PUT /identity/v3/projects/ec71c955b8164bbfb8510f5f9bdead18/users/b2c7c6c0285e482e9367777bb4a5bc8b/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:48.687185 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 993/1979] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:48.699999 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca1bbf-5aa9-41c9-b680-84f0355472bb None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:48.700518 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca1bbf-5aa9-41c9-b680-84f0355472bb None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:48.700946 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca1bbf-5aa9-41c9-b680-84f0355472bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:48.746105 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-02ca1bbf-5aa9-41c9-b680-84f0355472bb None None] MFA Rules not processed for user `b2c7c6c0285e482e9367777bb4a5bc8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:48.748130 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-02ca1bbf-5aa9-41c9-b680-84f0355472bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:48.754758 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488ac75-c986-44c1-852f-f4234f1b5a72 service cinder] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:48.765341 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488ac75-c986-44c1-852f-f4234f1b5a72 service cinder] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:48.863022 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f59180-53e9-4f77-9a8b-0f52e1b8c44d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:48.863895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f59180-53e9-4f77-9a8b-0f52e1b8c44d service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:48.864178 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f59180-53e9-4f77-9a8b-0f52e1b8c44d service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:48.864474 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f59180-53e9-4f77-9a8b-0f52e1b8c44d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:48.879214 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 987/1980] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:48 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:48.970147 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f59180-53e9-4f77-9a8b-0f52e1b8c44d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:48.972820 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f59180-53e9-4f77-9a8b-0f52e1b8c44d service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:48.993292 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 994/1981] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:48 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 15:56:49.252620 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca1bbf-5aa9-41c9-b680-84f0355472bb None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:49.267964 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca1bbf-5aa9-41c9-b680-84f0355472bb None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:49.274917 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511d354c-eb3b-4aca-b37e-db3475d25ebc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:49.276230 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d354c-eb3b-4aca-b37e-db3475d25ebc service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:49.276799 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d354c-eb3b-4aca-b37e-db3475d25ebc service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:49.277355 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d354c-eb3b-4aca-b37e-db3475d25ebc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:49.290433 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511d354c-eb3b-4aca-b37e-db3475d25ebc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:49.292919 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511d354c-eb3b-4aca-b37e-db3475d25ebc service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:49.307603 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 988/1982] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:49 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:50.456831 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9553d83-87f1-4810-aec9-6f08e8402127 None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:50.457381 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9553d83-87f1-4810-aec9-6f08e8402127 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:50.457381 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9553d83-87f1-4810-aec9-6f08e8402127 None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:50.463331 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511d354c-eb3b-4aca-b37e-db3475d25ebc service cinder] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:50.463860 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 995/1983] 10.222.0.16 () {54 vars in 921 bytes} [Wed Sep 7 15:56:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:56:50.475284 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05610977-d32b-43d7-b87c-cb738df2d9c2 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:50.475552 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05610977-d32b-43d7-b87c-cb738df2d9c2 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:50.475833 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05610977-d32b-43d7-b87c-cb738df2d9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:50.503818 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-05610977-d32b-43d7-b87c-cb738df2d9c2 None None] MFA Rules not processed for user `f9b13331a5fd48f5a2521ed1600f9f35`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:50.505466 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-05610977-d32b-43d7-b87c-cb738df2d9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:50.561496 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:50.576802 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:50.591580 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511d354c-eb3b-4aca-b37e-db3475d25ebc service cinder] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:50.597559 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7682ab58-5469-499b-8147-2251b97f9b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:50.598701 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682ab58-5469-499b-8147-2251b97f9b0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:50.599216 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682ab58-5469-499b-8147-2251b97f9b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:50.599740 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682ab58-5469-499b-8147-2251b97f9b0f admin admin] PATH_INFO: `/v3/users/bb7d85ad602c4ef38374338b9fc45cd1` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:50.601601 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7682ab58-5469-499b-8147-2251b97f9b0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb7d85ad602c4ef38374338b9fc45cd1)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:50.605285 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7682ab58-5469-499b-8147-2251b97f9b0f admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:50.616168 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 996/1984] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Sep 7 15:56:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:50.664181 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-7682ab58-5469-499b-8147-2251b97f9b0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb7d85ad602c4ef38374338b9fc45cd1'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:50.676416 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-7682ab58-5469-499b-8147-2251b97f9b0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb7d85ad602c4ef38374338b9fc45cd1'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:50.679520 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-7682ab58-5469-499b-8147-2251b97f9b0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb7d85ad602c4ef38374338b9fc45cd1'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:50.692442 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-7682ab58-5469-499b-8147-2251b97f9b0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb7d85ad602c4ef38374338b9fc45cd1'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:50.693405 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-7682ab58-5469-499b-8147-2251b97f9b0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb7d85ad602c4ef38374338b9fc45cd1'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:50.696870 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05610977-d32b-43d7-b87c-cb738df2d9c2 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:50.698398 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-05610977-d32b-43d7-b87c-cb738df2d9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:50.719892 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05610977-d32b-43d7-b87c-cb738df2d9c2 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:50.726346 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 989/1985] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:56:50 2022] DELETE /identity/v3/users/bb7d85ad602c4ef38374338b9fc45cd1 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:50.728363 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89910a2-e3fa-40a0-8230-6653aa3fd1e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:50.729023 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89910a2-e3fa-40a0-8230-6653aa3fd1e0 service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:50.729556 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89910a2-e3fa-40a0-8230-6653aa3fd1e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:50.729725 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89910a2-e3fa-40a0-8230-6653aa3fd1e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:50.732157 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-c89910a2-e3fa-40a0-8230-6653aa3fd1e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:50.733115 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40801d5-f180-4b58-be84-8f3663172cc4 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:50.733494 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40801d5-f180-4b58-be84-8f3663172cc4 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:50.733897 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40801d5-f180-4b58-be84-8f3663172cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:50.749122 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89910a2-e3fa-40a0-8230-6653aa3fd1e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:50.751136 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89910a2-e3fa-40a0-8230-6653aa3fd1e0 service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:50.761254 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-a40801d5-f180-4b58-be84-8f3663172cc4 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:50.763064 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-a40801d5-f180-4b58-be84-8f3663172cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:50.765617 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 997/1986] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:50.895321 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 990/1987] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:50.904444 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89910a2-e3fa-40a0-8230-6653aa3fd1e0 service nova] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:50.906368 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-c89910a2-e3fa-40a0-8230-6653aa3fd1e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:51.060671 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89910a2-e3fa-40a0-8230-6653aa3fd1e0 service nova] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:51.200153 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9c25c-a267-40c9-b72c-11b6249b45bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:51.201965 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9c25c-a267-40c9-b72c-11b6249b45bb service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:51.202606 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9c25c-a267-40c9-b72c-11b6249b45bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:51.203923 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9c25c-a267-40c9-b72c-11b6249b45bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:51.231704 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f9c25c-a267-40c9-b72c-11b6249b45bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:51.235359 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f9c25c-a267-40c9-b72c-11b6249b45bb service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:51.263265 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 998/1988] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:51.938100 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40801d5-f180-4b58-be84-8f3663172cc4 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:51.939580 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-a40801d5-f180-4b58-be84-8f3663172cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:52.005456 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9c25c-a267-40c9-b72c-11b6249b45bb service neutron] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:52.007861 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-78f9c25c-a267-40c9-b72c-11b6249b45bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:52.027518 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40801d5-f180-4b58-be84-8f3663172cc4 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:52.034307 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9c25c-a267-40c9-b72c-11b6249b45bb service neutron] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:52.040991 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f9568-a3e5-4994-82f8-3f8cc529450f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:52.041415 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f9568-a3e5-4994-82f8-3f8cc529450f service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:52.041695 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f9568-a3e5-4994-82f8-3f8cc529450f service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:52.041965 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f9568-a3e5-4994-82f8-3f8cc529450f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:52.045181 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-de9f9568-a3e5-4994-82f8-3f8cc529450f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:52.045432 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765729cf-2d8f-4c9f-9a3d-ca2675cda3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:52.047317 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765729cf-2d8f-4c9f-9a3d-ca2675cda3e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:52.047788 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765729cf-2d8f-4c9f-9a3d-ca2675cda3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:52.048211 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765729cf-2d8f-4c9f-9a3d-ca2675cda3e8 admin admin] PATH_INFO: `/v3/projects/09aaf3248627477e86f77b1b3c86dd55` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:52.050128 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765729cf-2d8f-4c9f-9a3d-ca2675cda3e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09aaf3248627477e86f77b1b3c86dd55)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:52.052201 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765729cf-2d8f-4c9f-9a3d-ca2675cda3e8 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:52.085872 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:52.117049 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-765729cf-2d8f-4c9f-9a3d-ca2675cda3e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09aaf3248627477e86f77b1b3c86dd55', 'request_id': 'req-765729cf-2d8f-4c9f-9a3d-ca2675cda3e8'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:52.129972 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-765729cf-2d8f-4c9f-9a3d-ca2675cda3e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09aaf3248627477e86f77b1b3c86dd55', 'request_id': 'req-765729cf-2d8f-4c9f-9a3d-ca2675cda3e8'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:52.154869 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-765729cf-2d8f-4c9f-9a3d-ca2675cda3e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09aaf3248627477e86f77b1b3c86dd55', 'request_id': 'req-765729cf-2d8f-4c9f-9a3d-ca2675cda3e8'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:52.175875 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9f9568-a3e5-4994-82f8-3f8cc529450f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:52.178129 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9f9568-a3e5-4994-82f8-3f8cc529450f service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:52.186489 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-765729cf-2d8f-4c9f-9a3d-ca2675cda3e8 admin admin] The token cache is being invalidate because project 09aaf3248627477e86f77b1b3c86dd55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:56:52.186489 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-765729cf-2d8f-4c9f-9a3d-ca2675cda3e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:52.186489 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-765729cf-2d8f-4c9f-9a3d-ca2675cda3e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:52.189489 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 999/1989] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:56:52 2022] DELETE /identity/v3/projects/09aaf3248627477e86f77b1b3c86dd55 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 15:56:52.193249 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765729cf-2d8f-4c9f-9a3d-ca2675cda3e8 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:52.197527 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-765729cf-2d8f-4c9f-9a3d-ca2675cda3e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:52.203970 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 991/1990] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:51 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:52.210711 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:52.293443 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765729cf-2d8f-4c9f-9a3d-ca2675cda3e8 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:52.299864 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7bcbf-8449-4c63-ad30-4f99c332b7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:52.300946 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7bcbf-8449-4c63-ad30-4f99c332b7f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:52.301358 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7bcbf-8449-4c63-ad30-4f99c332b7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:52.301704 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7bcbf-8449-4c63-ad30-4f99c332b7f2 admin admin] PATH_INFO: `/v3/users/b2c7c6c0285e482e9367777bb4a5bc8b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:52.309444 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e7bcbf-8449-4c63-ad30-4f99c332b7f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2c7c6c0285e482e9367777bb4a5bc8b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:52.311859 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e7bcbf-8449-4c63-ad30-4f99c332b7f2 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:52.390346 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-e8e7bcbf-8449-4c63-ad30-4f99c332b7f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2c7c6c0285e482e9367777bb4a5bc8b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:52.400316 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-e8e7bcbf-8449-4c63-ad30-4f99c332b7f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2c7c6c0285e482e9367777bb4a5bc8b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:52.400969 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-e8e7bcbf-8449-4c63-ad30-4f99c332b7f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2c7c6c0285e482e9367777bb4a5bc8b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:52.413355 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-e8e7bcbf-8449-4c63-ad30-4f99c332b7f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2c7c6c0285e482e9367777bb4a5bc8b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:52.417538 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-e8e7bcbf-8449-4c63-ad30-4f99c332b7f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2c7c6c0285e482e9367777bb4a5bc8b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:52.433341 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1000/1991] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:56:52 2022] DELETE /identity/v3/users/b2c7c6c0285e482e9367777bb4a5bc8b => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 15:56:52.693816 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f9568-a3e5-4994-82f8-3f8cc529450f service cinder] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:52.695383 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-de9f9568-a3e5-4994-82f8-3f8cc529450f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:52.716452 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f9568-a3e5-4994-82f8-3f8cc529450f service cinder] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:52.796453 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fadbbf8-d785-4134-983a-0aabac42faa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:52.797243 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fadbbf8-d785-4134-983a-0aabac42faa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:52.797632 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fadbbf8-d785-4134-983a-0aabac42faa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:52.798594 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fadbbf8-d785-4134-983a-0aabac42faa8 admin admin] PATH_INFO: `/v3/users/6274aac07a7b4352a0e00a589991e88b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:52.800241 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fadbbf8-d785-4134-983a-0aabac42faa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6274aac07a7b4352a0e00a589991e88b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:52.802334 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fadbbf8-d785-4134-983a-0aabac42faa8 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:52.848694 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7bcbf-8449-4c63-ad30-4f99c332b7f2 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:52.850167 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-e8e7bcbf-8449-4c63-ad30-4f99c332b7f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:52.869235 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7bcbf-8449-4c63-ad30-4f99c332b7f2 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:52.876482 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623fdbf6-247e-49e9-87c0-7b2d12f9b63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:52.877414 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623fdbf6-247e-49e9-87c0-7b2d12f9b63c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:52.877717 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623fdbf6-247e-49e9-87c0-7b2d12f9b63c admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:52.878262 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623fdbf6-247e-49e9-87c0-7b2d12f9b63c admin admin] PATH_INFO: `/v3/projects/ec71c955b8164bbfb8510f5f9bdead18` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:52.879807 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623fdbf6-247e-49e9-87c0-7b2d12f9b63c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec71c955b8164bbfb8510f5f9bdead18)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:52.882228 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623fdbf6-247e-49e9-87c0-7b2d12f9b63c admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:52.882713 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-6fadbbf8-d785-4134-983a-0aabac42faa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6274aac07a7b4352a0e00a589991e88b'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:52.891501 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-6fadbbf8-d785-4134-983a-0aabac42faa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6274aac07a7b4352a0e00a589991e88b'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:52.892179 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-6fadbbf8-d785-4134-983a-0aabac42faa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6274aac07a7b4352a0e00a589991e88b'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:52.899919 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-6fadbbf8-d785-4134-983a-0aabac42faa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6274aac07a7b4352a0e00a589991e88b'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:52.900576 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-6fadbbf8-d785-4134-983a-0aabac42faa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6274aac07a7b4352a0e00a589991e88b'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:52.920912 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 992/1992] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:56:52 2022] DELETE /identity/v3/users/6274aac07a7b4352a0e00a589991e88b => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:52.925266 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a86aa-7885-4a51-8c16-faea55fb4963 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:52.925552 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a86aa-7885-4a51-8c16-faea55fb4963 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:52.925827 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a86aa-7885-4a51-8c16-faea55fb4963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:52.937382 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-623fdbf6-247e-49e9-87c0-7b2d12f9b63c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec71c955b8164bbfb8510f5f9bdead18', 'request_id': 'req-623fdbf6-247e-49e9-87c0-7b2d12f9b63c'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:52.943297 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-623fdbf6-247e-49e9-87c0-7b2d12f9b63c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec71c955b8164bbfb8510f5f9bdead18', 'request_id': 'req-623fdbf6-247e-49e9-87c0-7b2d12f9b63c'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:52.946072 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-547a86aa-7885-4a51-8c16-faea55fb4963 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:52.947540 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-547a86aa-7885-4a51-8c16-faea55fb4963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:52.949883 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-623fdbf6-247e-49e9-87c0-7b2d12f9b63c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec71c955b8164bbfb8510f5f9bdead18', 'request_id': 'req-623fdbf6-247e-49e9-87c0-7b2d12f9b63c'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:52.965511 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-623fdbf6-247e-49e9-87c0-7b2d12f9b63c admin admin] The token cache is being invalidate because project ec71c955b8164bbfb8510f5f9bdead18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:56:52.965992 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-623fdbf6-247e-49e9-87c0-7b2d12f9b63c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:52.966698 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-623fdbf6-247e-49e9-87c0-7b2d12f9b63c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:52.969290 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1001/1993] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:56:52 2022] DELETE /identity/v3/projects/ec71c955b8164bbfb8510f5f9bdead18 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:52.974723 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cca75a-6862-4a78-bcbd-9daabd8a0b4d None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:52.975128 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cca75a-6862-4a78-bcbd-9daabd8a0b4d None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:52.975505 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cca75a-6862-4a78-bcbd-9daabd8a0b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:52.978658 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:53.016712 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-51cca75a-6862-4a78-bcbd-9daabd8a0b4d None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:53.017947 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-51cca75a-6862-4a78-bcbd-9daabd8a0b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:53.024111 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:53.027181 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 993/1994] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 15:56:53.039097 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a86aa-7885-4a51-8c16-faea55fb4963 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:53.041703 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-547a86aa-7885-4a51-8c16-faea55fb4963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:53.096356 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1002/1995] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:53.105660 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b8274-6677-4dfb-b96e-52b0eedb8e6c None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:53.105951 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b8274-6677-4dfb-b96e-52b0eedb8e6c None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:53.106258 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b8274-6677-4dfb-b96e-52b0eedb8e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:53.114360 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a86aa-7885-4a51-8c16-faea55fb4963 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:53.119000 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d59cf99-fc6e-4a7c-81f0-823b9983c38f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:53.119903 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59cf99-fc6e-4a7c-81f0-823b9983c38f service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:53.120189 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59cf99-fc6e-4a7c-81f0-823b9983c38f service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:53.120461 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59cf99-fc6e-4a7c-81f0-823b9983c38f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:53.128668 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-9c4b8274-6677-4dfb-b96e-52b0eedb8e6c None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:53.130149 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-9c4b8274-6677-4dfb-b96e-52b0eedb8e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:53.130322 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d59cf99-fc6e-4a7c-81f0-823b9983c38f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:53.131763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d59cf99-fc6e-4a7c-81f0-823b9983c38f service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:53.140120 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1003/1996] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:53.142492 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 994/1997] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:53.144211 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b8274-6677-4dfb-b96e-52b0eedb8e6c None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:53.154013 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b8274-6677-4dfb-b96e-52b0eedb8e6c None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:53.159160 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce9416-b8e4-47af-b0fd-a7cd192e6e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:53.159803 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce9416-b8e4-47af-b0fd-a7cd192e6e28 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:53.160081 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce9416-b8e4-47af-b0fd-a7cd192e6e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:53.160348 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce9416-b8e4-47af-b0fd-a7cd192e6e28 admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:53.161022 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ce9416-b8e4-47af-b0fd-a7cd192e6e28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:53.161321 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ce9416-b8e4-47af-b0fd-a7cd192e6e28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:53.162958 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ce9416-b8e4-47af-b0fd-a7cd192e6e28 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:53.177815 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1004/1998] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 15:56:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:53.182962 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d59cf99-fc6e-4a7c-81f0-823b9983c38f service neutron] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:53.195217 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d59cf99-fc6e-4a7c-81f0-823b9983c38f service neutron] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:53.201892 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e9ed1-423b-4db7-b141-853769eb1005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:53.203009 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e9ed1-423b-4db7-b141-853769eb1005 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:53.203454 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e9ed1-423b-4db7-b141-853769eb1005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:53.203827 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e9ed1-423b-4db7-b141-853769eb1005 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:53.204784 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76e9ed1-423b-4db7-b141-853769eb1005 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:53.207557 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76e9ed1-423b-4db7-b141-853769eb1005 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:53.246138 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 995/1999] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:56:53 2022] POST /identity/v3/projects => generated 381 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:53.250639 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce9416-b8e4-47af-b0fd-a7cd192e6e28 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:53.261970 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce9416-b8e4-47af-b0fd-a7cd192e6e28 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:53.348672 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be0443-31a5-4ebd-8be2-d04eb1b3280f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:53.349303 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be0443-31a5-4ebd-8be2-d04eb1b3280f admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:53.349592 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be0443-31a5-4ebd-8be2-d04eb1b3280f admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:53.350482 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be0443-31a5-4ebd-8be2-d04eb1b3280f admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:53.351482 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28be0443-31a5-4ebd-8be2-d04eb1b3280f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:53.353727 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28be0443-31a5-4ebd-8be2-d04eb1b3280f admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:53.378418 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1005/2000] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:56:53 2022] POST /identity/v3/users => generated 291 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:53.382679 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e9ed1-423b-4db7-b141-853769eb1005 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:53.395289 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e9ed1-423b-4db7-b141-853769eb1005 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:53.404847 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543e39f-0b10-4ff4-aac4-a8afeed10de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:53.405472 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543e39f-0b10-4ff4-aac4-a8afeed10de8 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:53.405954 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543e39f-0b10-4ff4-aac4-a8afeed10de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:53.406309 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543e39f-0b10-4ff4-aac4-a8afeed10de8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:53.406673 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543e39f-0b10-4ff4-aac4-a8afeed10de8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:53.408240 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543e39f-0b10-4ff4-aac4-a8afeed10de8 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:53.424786 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 996/2001] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:53.428784 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be0443-31a5-4ebd-8be2-d04eb1b3280f admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:53.443183 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be0443-31a5-4ebd-8be2-d04eb1b3280f admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:53.452102 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16415274-2e86-4f32-9e33-77a1800e22dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:53.452733 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16415274-2e86-4f32-9e33-77a1800e22dc admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:53.453257 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16415274-2e86-4f32-9e33-77a1800e22dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:53.453547 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16415274-2e86-4f32-9e33-77a1800e22dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:53.454326 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16415274-2e86-4f32-9e33-77a1800e22dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:53.456623 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16415274-2e86-4f32-9e33-77a1800e22dc admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:53.466147 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543e39f-0b10-4ff4-aac4-a8afeed10de8 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:53.468295 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-9543e39f-0b10-4ff4-aac4-a8afeed10de8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:53.483702 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543e39f-0b10-4ff4-aac4-a8afeed10de8 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:53.489284 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbbbf97-3dd2-4bdf-a5d6-015d25697b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:53.489932 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbbbf97-3dd2-4bdf-a5d6-015d25697b8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:53.490246 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbbbf97-3dd2-4bdf-a5d6-015d25697b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:53.490671 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbbbf97-3dd2-4bdf-a5d6-015d25697b8c admin admin] PATH_INFO: `/v3/projects/46c08fab9afe464a8f2684e1cc7f44fc` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:53.491833 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbbbf97-3dd2-4bdf-a5d6-015d25697b8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=46c08fab9afe464a8f2684e1cc7f44fc)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:53.496705 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbbbf97-3dd2-4bdf-a5d6-015d25697b8c admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:53.499956 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1006/2002] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:53.500832 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16415274-2e86-4f32-9e33-77a1800e22dc admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:53.516183 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16415274-2e86-4f32-9e33-77a1800e22dc admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:53.522549 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dad196-1bda-4bc9-b7e4-472ee8242c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:53.523398 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dad196-1bda-4bc9-b7e4-472ee8242c6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:53.524497 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dad196-1bda-4bc9-b7e4-472ee8242c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:53.524946 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dad196-1bda-4bc9-b7e4-472ee8242c6b admin admin] PATH_INFO: `/v3/projects/56e156b0f5624f9780bb803064419d6b/users/a3b34a191b6645978ae09a3e3f98d05f/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:53.542262 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dad196-1bda-4bc9-b7e4-472ee8242c6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=56e156b0f5624f9780bb803064419d6b, user_id=a3b34a191b6645978ae09a3e3f98d05f, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:53.545095 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dad196-1bda-4bc9-b7e4-472ee8242c6b admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:53.570109 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1007/2003] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:53 2022] PUT /identity/v3/projects/56e156b0f5624f9780bb803064419d6b/users/a3b34a191b6645978ae09a3e3f98d05f/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:53.572517 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc89e1c-1e34-44a4-afca-7fd2065e682d None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:53.572813 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc89e1c-1e34-44a4-afca-7fd2065e682d None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:53.573093 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc89e1c-1e34-44a4-afca-7fd2065e682d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:53.586401 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-dcbbbf97-3dd2-4bdf-a5d6-015d25697b8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46c08fab9afe464a8f2684e1cc7f44fc', 'request_id': 'req-dcbbbf97-3dd2-4bdf-a5d6-015d25697b8c'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:53.593381 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-dcbbbf97-3dd2-4bdf-a5d6-015d25697b8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46c08fab9afe464a8f2684e1cc7f44fc', 'request_id': 'req-dcbbbf97-3dd2-4bdf-a5d6-015d25697b8c'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:53.600691 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-dcbbbf97-3dd2-4bdf-a5d6-015d25697b8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46c08fab9afe464a8f2684e1cc7f44fc', 'request_id': 'req-dcbbbf97-3dd2-4bdf-a5d6-015d25697b8c'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:53.619312 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-3fc89e1c-1e34-44a4-afca-7fd2065e682d None None] MFA Rules not processed for user `a3b34a191b6645978ae09a3e3f98d05f`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:53.621210 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-3fc89e1c-1e34-44a4-afca-7fd2065e682d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:53.623605 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-dcbbbf97-3dd2-4bdf-a5d6-015d25697b8c admin admin] The token cache is being invalidate because project 46c08fab9afe464a8f2684e1cc7f44fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:56:53.623976 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-dcbbbf97-3dd2-4bdf-a5d6-015d25697b8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:53.624713 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-dcbbbf97-3dd2-4bdf-a5d6-015d25697b8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:53.626521 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 997/2004] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:56:53 2022] DELETE /identity/v3/projects/46c08fab9afe464a8f2684e1cc7f44fc => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 15:56:53.635704 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbbbf97-3dd2-4bdf-a5d6-015d25697b8c admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:53.640788 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-dcbbbf97-3dd2-4bdf-a5d6-015d25697b8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:53.694654 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:53.740710 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:53.783688 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1008/2005] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:53.792936 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc89e1c-1e34-44a4-afca-7fd2065e682d None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:53.795613 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-3fc89e1c-1e34-44a4-afca-7fd2065e682d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:53.814584 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbbbf97-3dd2-4bdf-a5d6-015d25697b8c admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:53.822820 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac925d1f-23ab-4d22-bf4c-12bc6954de70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:53.823930 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac925d1f-23ab-4d22-bf4c-12bc6954de70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:53.824286 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac925d1f-23ab-4d22-bf4c-12bc6954de70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:53.824627 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac925d1f-23ab-4d22-bf4c-12bc6954de70 admin admin] PATH_INFO: `/v3/users/95553b3335834967a730cc8aa3e91098` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:53.825974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac925d1f-23ab-4d22-bf4c-12bc6954de70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95553b3335834967a730cc8aa3e91098)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:53.837114 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac925d1f-23ab-4d22-bf4c-12bc6954de70 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:53.916903 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-ac925d1f-23ab-4d22-bf4c-12bc6954de70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95553b3335834967a730cc8aa3e91098'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:53.927545 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-ac925d1f-23ab-4d22-bf4c-12bc6954de70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95553b3335834967a730cc8aa3e91098'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:53.928601 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-ac925d1f-23ab-4d22-bf4c-12bc6954de70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95553b3335834967a730cc8aa3e91098'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:53.940145 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-ac925d1f-23ab-4d22-bf4c-12bc6954de70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95553b3335834967a730cc8aa3e91098'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:53.941148 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-ac925d1f-23ab-4d22-bf4c-12bc6954de70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95553b3335834967a730cc8aa3e91098'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:53.969178 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 998/2006] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:56:53 2022] DELETE /identity/v3/users/95553b3335834967a730cc8aa3e91098 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 15:56:53.981227 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc89e1c-1e34-44a4-afca-7fd2065e682d None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:54.068227 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7957e83-7acd-46ce-8cc5-4b346375499d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:54.068984 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7957e83-7acd-46ce-8cc5-4b346375499d admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:54.069347 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7957e83-7acd-46ce-8cc5-4b346375499d admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:54.069685 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7957e83-7acd-46ce-8cc5-4b346375499d admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:54.070626 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7957e83-7acd-46ce-8cc5-4b346375499d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:54.073094 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7957e83-7acd-46ce-8cc5-4b346375499d admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:54.117365 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1009/2007] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:56:53 2022] POST /identity/v3/projects => generated 381 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:54.121506 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac925d1f-23ab-4d22-bf4c-12bc6954de70 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:54.122897 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-ac925d1f-23ab-4d22-bf4c-12bc6954de70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:54.143804 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac925d1f-23ab-4d22-bf4c-12bc6954de70 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:54.166055 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7957e83-7acd-46ce-8cc5-4b346375499d admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:54.168181 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-e7957e83-7acd-46ce-8cc5-4b346375499d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:54.284415 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7957e83-7acd-46ce-8cc5-4b346375499d admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:54.288681 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e3f9f3-7ffc-4782-93dd-46667305d782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:54.290551 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3f9f3-7ffc-4782-93dd-46667305d782 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:54.291246 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3f9f3-7ffc-4782-93dd-46667305d782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:54.291771 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3f9f3-7ffc-4782-93dd-46667305d782 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:54.292484 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e3f9f3-7ffc-4782-93dd-46667305d782 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:54.293128 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ddd96-2ebb-435e-bd10-8004505b2789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:54.293989 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ddd96-2ebb-435e-bd10-8004505b2789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:54.294302 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ddd96-2ebb-435e-bd10-8004505b2789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:54.295968 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ddd96-2ebb-435e-bd10-8004505b2789 admin admin] PATH_INFO: `/v3/users/b88e4ea3dce046a7a79e3208615deff5` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:54.296090 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e3f9f3-7ffc-4782-93dd-46667305d782 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:54.297505 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ddd96-2ebb-435e-bd10-8004505b2789 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b88e4ea3dce046a7a79e3208615deff5)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:54.300121 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ddd96-2ebb-435e-bd10-8004505b2789 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:54.315071 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:54.327516 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 999/2008] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:56:54 2022] POST /identity/v3/users => generated 297 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 15:56:54.331321 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e3f9f3-7ffc-4782-93dd-46667305d782 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:54.347920 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e3f9f3-7ffc-4782-93dd-46667305d782 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:54.355779 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f128a1-a5ab-4f72-96b9-afb024befe1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:54.357011 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f128a1-a5ab-4f72-96b9-afb024befe1c admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:54.357846 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f128a1-a5ab-4f72-96b9-afb024befe1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:54.358207 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f128a1-a5ab-4f72-96b9-afb024befe1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:54.359792 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f128a1-a5ab-4f72-96b9-afb024befe1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:54.362219 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f128a1-a5ab-4f72-96b9-afb024befe1c admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:54.380598 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1000/2009] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 15:56:54.385580 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f128a1-a5ab-4f72-96b9-afb024befe1c admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:54.394898 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-405ddd96-2ebb-435e-bd10-8004505b2789 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b88e4ea3dce046a7a79e3208615deff5'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:54.408047 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-405ddd96-2ebb-435e-bd10-8004505b2789 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b88e4ea3dce046a7a79e3208615deff5'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:54.409172 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-405ddd96-2ebb-435e-bd10-8004505b2789 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b88e4ea3dce046a7a79e3208615deff5'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:54.421169 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f128a1-a5ab-4f72-96b9-afb024befe1c admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:54.428877 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-405ddd96-2ebb-435e-bd10-8004505b2789 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b88e4ea3dce046a7a79e3208615deff5'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:54.430035 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-405ddd96-2ebb-435e-bd10-8004505b2789 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b88e4ea3dce046a7a79e3208615deff5'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:54.431912 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee88dec-5f85-4db3-ab83-ff06b7179a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:54.435973 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee88dec-5f85-4db3-ab83-ff06b7179a3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:54.436341 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee88dec-5f85-4db3-ab83-ff06b7179a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:54.436703 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee88dec-5f85-4db3-ab83-ff06b7179a3d admin admin] PATH_INFO: `/v3/projects/00e0b513ce704b209bb0c4ca49bdd01c/users/e94997833d8b4ff0b787edac1095f7b3/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:54.451638 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1010/2010] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:56:54 2022] DELETE /identity/v3/users/b88e4ea3dce046a7a79e3208615deff5 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:54.456669 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394d82d-0486-4ab5-8ebd-78b337d4b596 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:54.457699 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394d82d-0486-4ab5-8ebd-78b337d4b596 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:54.458896 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394d82d-0486-4ab5-8ebd-78b337d4b596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:54.477897 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee88dec-5f85-4db3-ab83-ff06b7179a3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=00e0b513ce704b209bb0c4ca49bdd01c, user_id=e94997833d8b4ff0b787edac1095f7b3, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:54.483547 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee88dec-5f85-4db3-ab83-ff06b7179a3d admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:54.496779 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:54.513871 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1001/2011] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:54 2022] PUT /identity/v3/projects/00e0b513ce704b209bb0c4ca49bdd01c/users/e94997833d8b4ff0b787edac1095f7b3/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:54.523127 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee88dec-5f85-4db3-ab83-ff06b7179a3d admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:54.525444 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-d394d82d-0486-4ab5-8ebd-78b337d4b596 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:54.527814 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-d394d82d-0486-4ab5-8ebd-78b337d4b596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:54.531180 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-7ee88dec-5f85-4db3-ab83-ff06b7179a3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:54.655876 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee88dec-5f85-4db3-ab83-ff06b7179a3d admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:54.663511 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf1026-94f1-429d-8641-34d8880412bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:54.664805 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf1026-94f1-429d-8641-34d8880412bf admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:54.665066 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf1026-94f1-429d-8641-34d8880412bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:54.665529 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf1026-94f1-429d-8641-34d8880412bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:54.666317 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf1026-94f1-429d-8641-34d8880412bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:54.669106 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf1026-94f1-429d-8641-34d8880412bf admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:54.691235 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1002/2012] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:54.692354 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf1026-94f1-429d-8641-34d8880412bf admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:54.701810 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1011/2013] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 15:56:54.708127 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394d82d-0486-4ab5-8ebd-78b337d4b596 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:54.713667 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-d394d82d-0486-4ab5-8ebd-78b337d4b596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:54.726116 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf1026-94f1-429d-8641-34d8880412bf admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:54.734750 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b79f7-7dbf-40d6-a77f-69ad10a3b4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:54.735790 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b79f7-7dbf-40d6-a77f-69ad10a3b4ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:54.736171 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b79f7-7dbf-40d6-a77f-69ad10a3b4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:54.748233 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b79f7-7dbf-40d6-a77f-69ad10a3b4ba admin admin] PATH_INFO: `/v3/projects/00e0b513ce704b209bb0c4ca49bdd01c/users/e94997833d8b4ff0b787edac1095f7b3/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:54.754297 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163b79f7-7dbf-40d6-a77f-69ad10a3b4ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=00e0b513ce704b209bb0c4ca49bdd01c, user_id=e94997833d8b4ff0b787edac1095f7b3, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:54.757206 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163b79f7-7dbf-40d6-a77f-69ad10a3b4ba admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:54.779106 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1003/2014] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:54 2022] PUT /identity/v3/projects/00e0b513ce704b209bb0c4ca49bdd01c/users/e94997833d8b4ff0b787edac1095f7b3/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:54.780269 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b79f7-7dbf-40d6-a77f-69ad10a3b4ba admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:54.786400 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-163b79f7-7dbf-40d6-a77f-69ad10a3b4ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:54.808086 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394d82d-0486-4ab5-8ebd-78b337d4b596 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:54.894886 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b79f7-7dbf-40d6-a77f-69ad10a3b4ba admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:54.900954 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c928b0e-6ac5-406c-959e-7ef043223a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:54.901704 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c928b0e-6ac5-406c-959e-7ef043223a85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:54.902059 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c928b0e-6ac5-406c-959e-7ef043223a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:54.902448 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c928b0e-6ac5-406c-959e-7ef043223a85 admin admin] PATH_INFO: `/v3/projects/21e3a288ffbb4e2ebbae3333d3f543db` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:54.903697 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c928b0e-6ac5-406c-959e-7ef043223a85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21e3a288ffbb4e2ebbae3333d3f543db)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:54.905733 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:54.906595 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c928b0e-6ac5-406c-959e-7ef043223a85 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:54.920886 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1fea40-311c-425f-a28e-fc3ed04153bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:54.921517 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1fea40-311c-425f-a28e-fc3ed04153bd service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:54.921799 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1fea40-311c-425f-a28e-fc3ed04153bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:54.922077 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1fea40-311c-425f-a28e-fc3ed04153bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:54.936221 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1fea40-311c-425f-a28e-fc3ed04153bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:54.937967 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1fea40-311c-425f-a28e-fc3ed04153bd service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:54.953692 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1012/2015] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 15:56:54.955211 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db7af2-8a1c-4666-9552-fa6019956aeb None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:54.955707 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db7af2-8a1c-4666-9552-fa6019956aeb None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:54.955995 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db7af2-8a1c-4666-9552-fa6019956aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:54.976141 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-4c928b0e-6ac5-406c-959e-7ef043223a85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21e3a288ffbb4e2ebbae3333d3f543db', 'request_id': 'req-4c928b0e-6ac5-406c-959e-7ef043223a85'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:54.985289 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-4c928b0e-6ac5-406c-959e-7ef043223a85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21e3a288ffbb4e2ebbae3333d3f543db', 'request_id': 'req-4c928b0e-6ac5-406c-959e-7ef043223a85'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:54.997692 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-37db7af2-8a1c-4666-9552-fa6019956aeb None None] MFA Rules not processed for user `e94997833d8b4ff0b787edac1095f7b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:54.998979 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-37db7af2-8a1c-4666-9552-fa6019956aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:55.002493 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-4c928b0e-6ac5-406c-959e-7ef043223a85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21e3a288ffbb4e2ebbae3333d3f543db', 'request_id': 'req-4c928b0e-6ac5-406c-959e-7ef043223a85'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:55.033224 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-4c928b0e-6ac5-406c-959e-7ef043223a85 admin admin] The token cache is being invalidate because project 21e3a288ffbb4e2ebbae3333d3f543db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:56:55.033614 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-4c928b0e-6ac5-406c-959e-7ef043223a85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:55.036171 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-4c928b0e-6ac5-406c-959e-7ef043223a85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:55.039339 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1004/2016] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:56:54 2022] DELETE /identity/v3/projects/21e3a288ffbb4e2ebbae3333d3f543db => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:55.046668 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b60bc-8fee-4ef4-a76c-b7f239c12b23 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:55.047362 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b60bc-8fee-4ef4-a76c-b7f239c12b23 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:55.048353 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b60bc-8fee-4ef4-a76c-b7f239c12b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:55.107111 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-957b60bc-8fee-4ef4-a76c-b7f239c12b23 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:55.110584 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-957b60bc-8fee-4ef4-a76c-b7f239c12b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:55.126023 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:55.226363 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1013/2017] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:54 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:55.287140 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1005/2018] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:55.293113 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db7af2-8a1c-4666-9552-fa6019956aeb None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:55.293966 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef47e38-0208-4c56-a106-deb43086a5d6 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:55.294305 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef47e38-0208-4c56-a106-deb43086a5d6 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:55.294600 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef47e38-0208-4c56-a106-deb43086a5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:55.294704 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-37db7af2-8a1c-4666-9552-fa6019956aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:55.336959 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-0ef47e38-0208-4c56-a106-deb43086a5d6 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:55.344591 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-0ef47e38-0208-4c56-a106-deb43086a5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:55.373244 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1006/2019] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:55.377467 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef47e38-0208-4c56-a106-deb43086a5d6 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:55.388532 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db7af2-8a1c-4666-9552-fa6019956aeb None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:55.389872 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef47e38-0208-4c56-a106-deb43086a5d6 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:55.395418 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a702f2cb-f988-4794-8f8b-11d94e702998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:55.395578 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b52d52-0ba6-4651-83b0-3f6a4c061ec4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:55.396341 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702f2cb-f988-4794-8f8b-11d94e702998 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:55.396470 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b52d52-0ba6-4651-83b0-3f6a4c061ec4 service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:55.396549 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702f2cb-f988-4794-8f8b-11d94e702998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:55.396632 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702f2cb-f988-4794-8f8b-11d94e702998 admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:55.397277 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a702f2cb-f988-4794-8f8b-11d94e702998 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:55.397527 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a702f2cb-f988-4794-8f8b-11d94e702998 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:55.397857 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b52d52-0ba6-4651-83b0-3f6a4c061ec4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:55.398157 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b52d52-0ba6-4651-83b0-3f6a4c061ec4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:55.402000 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a702f2cb-f988-4794-8f8b-11d94e702998 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:55.417248 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1007/2020] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 15:56:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:55.419305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b52d52-0ba6-4651-83b0-3f6a4c061ec4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:55.422813 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a702f2cb-f988-4794-8f8b-11d94e702998 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:55.423133 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b52d52-0ba6-4651-83b0-3f6a4c061ec4 service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:55.436287 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a702f2cb-f988-4794-8f8b-11d94e702998 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:55.444307 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b753e7-74a3-42ae-8eb5-4c1915f2360b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:55.444973 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b753e7-74a3-42ae-8eb5-4c1915f2360b admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:55.445290 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b753e7-74a3-42ae-8eb5-4c1915f2360b admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:55.446407 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b753e7-74a3-42ae-8eb5-4c1915f2360b admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:55.447046 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b753e7-74a3-42ae-8eb5-4c1915f2360b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:55.448540 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1014/2021] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:55 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:55.449727 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b52d52-0ba6-4651-83b0-3f6a4c061ec4 service cinder] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:55.450171 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b753e7-74a3-42ae-8eb5-4c1915f2360b admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:55.456929 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-81b52d52-0ba6-4651-83b0-3f6a4c061ec4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:55.478805 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b52d52-0ba6-4651-83b0-3f6a4c061ec4 service cinder] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:55.485735 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8cefa9-3764-47d4-b342-206a4659b1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:55.486540 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8cefa9-3764-47d4-b342-206a4659b1ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:55.487038 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8cefa9-3764-47d4-b342-206a4659b1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:55.487393 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8cefa9-3764-47d4-b342-206a4659b1ff admin admin] PATH_INFO: `/v3/projects/a7243522b1c241c398dc0ea6fd832ca5` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:55.488959 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8cefa9-3764-47d4-b342-206a4659b1ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7243522b1c241c398dc0ea6fd832ca5)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:55.495363 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1008/2022] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:56:55 2022] POST /identity/v3/projects => generated 359 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 15:56:55.495555 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8cefa9-3764-47d4-b342-206a4659b1ff admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:55.498631 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b753e7-74a3-42ae-8eb5-4c1915f2360b admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:55.589807 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-fb8cefa9-3764-47d4-b342-206a4659b1ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7243522b1c241c398dc0ea6fd832ca5', 'request_id': 'req-fb8cefa9-3764-47d4-b342-206a4659b1ff'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:55.600459 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-fb8cefa9-3764-47d4-b342-206a4659b1ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7243522b1c241c398dc0ea6fd832ca5', 'request_id': 'req-fb8cefa9-3764-47d4-b342-206a4659b1ff'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:55.614793 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-fb8cefa9-3764-47d4-b342-206a4659b1ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7243522b1c241c398dc0ea6fd832ca5', 'request_id': 'req-fb8cefa9-3764-47d4-b342-206a4659b1ff'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:55.630826 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:55.644810 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-fb8cefa9-3764-47d4-b342-206a4659b1ff admin admin] The token cache is being invalidate because project a7243522b1c241c398dc0ea6fd832ca5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:56:55.644810 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-fb8cefa9-3764-47d4-b342-206a4659b1ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:55.644810 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-fb8cefa9-3764-47d4-b342-206a4659b1ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:55.645065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b753e7-74a3-42ae-8eb5-4c1915f2360b admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:55.645154 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1015/2023] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:56:55 2022] DELETE /identity/v3/projects/a7243522b1c241c398dc0ea6fd832ca5 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:55.649631 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8cefa9-3764-47d4-b342-206a4659b1ff admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:55.655624 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-fb8cefa9-3764-47d4-b342-206a4659b1ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:55.771176 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6885c861-8cfb-41a1-87b5-764c941cfff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:55.772031 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6885c861-8cfb-41a1-87b5-764c941cfff9 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:55.772429 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6885c861-8cfb-41a1-87b5-764c941cfff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:55.772627 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6885c861-8cfb-41a1-87b5-764c941cfff9 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:55.773259 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6885c861-8cfb-41a1-87b5-764c941cfff9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:55.776502 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6885c861-8cfb-41a1-87b5-764c941cfff9 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:55.792655 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8cefa9-3764-47d4-b342-206a4659b1ff admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:55.798664 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469eaeb8-0412-409b-a97e-359787152ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:55.799684 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469eaeb8-0412-409b-a97e-359787152ee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:55.800271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469eaeb8-0412-409b-a97e-359787152ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:55.801089 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469eaeb8-0412-409b-a97e-359787152ee0 admin admin] PATH_INFO: `/v3/users/739e4f03d3ca4e0cb42e89317d82db56` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:55.806350 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469eaeb8-0412-409b-a97e-359787152ee0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=739e4f03d3ca4e0cb42e89317d82db56)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:55.806977 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469eaeb8-0412-409b-a97e-359787152ee0 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:55.815970 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1009/2024] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:56:55 2022] POST /identity/v3/users => generated 280 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:55.835081 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6885c861-8cfb-41a1-87b5-764c941cfff9 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:55.843733 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-6885c861-8cfb-41a1-87b5-764c941cfff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:55.869979 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6885c861-8cfb-41a1-87b5-764c941cfff9 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:55.877147 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-469eaeb8-0412-409b-a97e-359787152ee0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '739e4f03d3ca4e0cb42e89317d82db56'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:55.879142 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788686b3-3211-453d-80e2-73c465d244db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:55.880062 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788686b3-3211-453d-80e2-73c465d244db admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:55.881661 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788686b3-3211-453d-80e2-73c465d244db admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:55.881960 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788686b3-3211-453d-80e2-73c465d244db admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:55.882674 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788686b3-3211-453d-80e2-73c465d244db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:55.886487 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788686b3-3211-453d-80e2-73c465d244db admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:55.890115 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:55.894308 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-469eaeb8-0412-409b-a97e-359787152ee0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '739e4f03d3ca4e0cb42e89317d82db56'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:55.898092 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-469eaeb8-0412-409b-a97e-359787152ee0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '739e4f03d3ca4e0cb42e89317d82db56'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:55.906600 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1010/2025] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:55.907762 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788686b3-3211-453d-80e2-73c465d244db admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:55.917677 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-788686b3-3211-453d-80e2-73c465d244db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:55.928029 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-469eaeb8-0412-409b-a97e-359787152ee0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '739e4f03d3ca4e0cb42e89317d82db56'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:55.928760 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-469eaeb8-0412-409b-a97e-359787152ee0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '739e4f03d3ca4e0cb42e89317d82db56'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:55.944026 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1016/2026] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:56:55 2022] DELETE /identity/v3/users/739e4f03d3ca4e0cb42e89317d82db56 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:55.949956 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788686b3-3211-453d-80e2-73c465d244db admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:56.050770 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49163afb-7cf3-4e06-9204-f072c1c0f8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:56.051607 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49163afb-7cf3-4e06-9204-f072c1c0f8f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:56.051724 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49163afb-7cf3-4e06-9204-f072c1c0f8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:56.052072 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49163afb-7cf3-4e06-9204-f072c1c0f8f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:56.052810 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49163afb-7cf3-4e06-9204-f072c1c0f8f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:56.054517 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49163afb-7cf3-4e06-9204-f072c1c0f8f5 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:56.073291 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1011/2027] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:56.077794 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469eaeb8-0412-409b-a97e-359787152ee0 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:56.092071 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469eaeb8-0412-409b-a97e-359787152ee0 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:56.106706 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e4d89-1a40-43dc-b1b4-5db817a14587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:56.107863 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e4d89-1a40-43dc-b1b4-5db817a14587 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:56.108050 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e4d89-1a40-43dc-b1b4-5db817a14587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:56.108569 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e4d89-1a40-43dc-b1b4-5db817a14587 admin admin] PATH_INFO: `/v3/projects/741601ab58ba4fb1a34e5e334b202041/users/9526eb7b0e8a40f5b3fc715484340dd1/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:56.120993 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49163afb-7cf3-4e06-9204-f072c1c0f8f5 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:56.122849 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-49163afb-7cf3-4e06-9204-f072c1c0f8f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:56.131404 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e4d89-1a40-43dc-b1b4-5db817a14587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=741601ab58ba4fb1a34e5e334b202041, user_id=9526eb7b0e8a40f5b3fc715484340dd1, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:56.135788 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e4d89-1a40-43dc-b1b4-5db817a14587 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:56.139406 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49163afb-7cf3-4e06-9204-f072c1c0f8f5 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:56.145584 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bbef18-6d82-449e-9ad4-4ca16536b183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:56.146494 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbef18-6d82-449e-9ad4-4ca16536b183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:56.146765 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbef18-6d82-449e-9ad4-4ca16536b183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:56.147137 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbef18-6d82-449e-9ad4-4ca16536b183 admin admin] PATH_INFO: `/v3/users/a3b34a191b6645978ae09a3e3f98d05f` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:56.148418 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bbef18-6d82-449e-9ad4-4ca16536b183 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3b34a191b6645978ae09a3e3f98d05f)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:56.151112 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bbef18-6d82-449e-9ad4-4ca16536b183 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:56.158228 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1017/2028] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:56 2022] PUT /identity/v3/projects/741601ab58ba4fb1a34e5e334b202041/users/9526eb7b0e8a40f5b3fc715484340dd1/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:56.166938 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f258609-4b8a-4563-bd2f-eedaecc67202 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:56.167409 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f258609-4b8a-4563-bd2f-eedaecc67202 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:56.167748 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f258609-4b8a-4563-bd2f-eedaecc67202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:56.200308 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-8f258609-4b8a-4563-bd2f-eedaecc67202 None None] MFA Rules not processed for user `9526eb7b0e8a40f5b3fc715484340dd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:56.201799 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-8f258609-4b8a-4563-bd2f-eedaecc67202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:56.220953 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-62bbef18-6d82-449e-9ad4-4ca16536b183 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3b34a191b6645978ae09a3e3f98d05f'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:56.231878 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-62bbef18-6d82-449e-9ad4-4ca16536b183 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3b34a191b6645978ae09a3e3f98d05f'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:56.232526 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-62bbef18-6d82-449e-9ad4-4ca16536b183 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3b34a191b6645978ae09a3e3f98d05f'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:56.264508 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:56.290474 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-62bbef18-6d82-449e-9ad4-4ca16536b183 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3b34a191b6645978ae09a3e3f98d05f'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:56.291342 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-62bbef18-6d82-449e-9ad4-4ca16536b183 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3b34a191b6645978ae09a3e3f98d05f'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:56.310481 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1018/2029] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:56 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 15:56:56.328635 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1012/2030] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:56:56 2022] DELETE /identity/v3/users/a3b34a191b6645978ae09a3e3f98d05f => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 15:56:56.328842 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1b75e-b97e-4b17-a376-3d3faa89c1c8 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:56.328842 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1b75e-b97e-4b17-a376-3d3faa89c1c8 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:56.329315 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1b75e-b97e-4b17-a376-3d3faa89c1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:56.353159 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-e8d1b75e-b97e-4b17-a376-3d3faa89c1c8 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:56.354920 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-e8d1b75e-b97e-4b17-a376-3d3faa89c1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:56.356487 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bbef18-6d82-449e-9ad4-4ca16536b183 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:56.358915 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-62bbef18-6d82-449e-9ad4-4ca16536b183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:56.465123 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bbef18-6d82-449e-9ad4-4ca16536b183 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:56.467766 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1019/2031] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:56.468694 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d1b75e-b97e-4b17-a376-3d3faa89c1c8 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:56.469721 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534b99e-9b92-4bf8-b722-979d442f5882 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:56.470452 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-e8d1b75e-b97e-4b17-a376-3d3faa89c1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:56.470546 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534b99e-9b92-4bf8-b722-979d442f5882 service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:56.470799 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534b99e-9b92-4bf8-b722-979d442f5882 service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:56.471088 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534b99e-9b92-4bf8-b722-979d442f5882 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:56.485703 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d1b75e-b97e-4b17-a376-3d3faa89c1c8 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:56.493648 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:56.502134 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a7e88-c865-4d87-8057-6d14bd3d1099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:56.502826 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a7e88-c865-4d87-8057-6d14bd3d1099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:56.503109 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a7e88-c865-4d87-8057-6d14bd3d1099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:56.503385 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a7e88-c865-4d87-8057-6d14bd3d1099 admin admin] PATH_INFO: `/v3/projects/3b971e6512bd45febd81b564ba91238b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:56.504842 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2a7e88-c865-4d87-8057-6d14bd3d1099 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b971e6512bd45febd81b564ba91238b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:56.507520 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2a7e88-c865-4d87-8057-6d14bd3d1099 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:56.575833 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534b99e-9b92-4bf8-b722-979d442f5882 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:56.577923 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534b99e-9b92-4bf8-b722-979d442f5882 service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:56.590731 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-fd2a7e88-c865-4d87-8057-6d14bd3d1099 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b971e6512bd45febd81b564ba91238b', 'request_id': 'req-fd2a7e88-c865-4d87-8057-6d14bd3d1099'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:56.596533 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-fd2a7e88-c865-4d87-8057-6d14bd3d1099 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b971e6512bd45febd81b564ba91238b', 'request_id': 'req-fd2a7e88-c865-4d87-8057-6d14bd3d1099'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:56.598877 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1013/2032] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:56 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:56.602917 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534b99e-9b92-4bf8-b722-979d442f5882 service cinder] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:56.611981 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-fd2a7e88-c865-4d87-8057-6d14bd3d1099 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b971e6512bd45febd81b564ba91238b', 'request_id': 'req-fd2a7e88-c865-4d87-8057-6d14bd3d1099'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:56.613050 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b534b99e-9b92-4bf8-b722-979d442f5882 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:56.622034 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-fd2a7e88-c865-4d87-8057-6d14bd3d1099 admin admin] The token cache is being invalidate because project 3b971e6512bd45febd81b564ba91238b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:56:56.622858 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-fd2a7e88-c865-4d87-8057-6d14bd3d1099 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:56.623675 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-fd2a7e88-c865-4d87-8057-6d14bd3d1099 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:56.625925 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1020/2033] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:56:56 2022] DELETE /identity/v3/projects/3b971e6512bd45febd81b564ba91238b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:56.630479 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a7e88-c865-4d87-8057-6d14bd3d1099 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:56.632246 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-fd2a7e88-c865-4d87-8057-6d14bd3d1099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:56.726289 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534b99e-9b92-4bf8-b722-979d442f5882 service cinder] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:56.758579 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a7e88-c865-4d87-8057-6d14bd3d1099 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:56.765267 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e0d7e-5201-4f35-86af-039356bf6e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:56.766376 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e0d7e-5201-4f35-86af-039356bf6e74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:56.766767 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e0d7e-5201-4f35-86af-039356bf6e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:56.767158 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e0d7e-5201-4f35-86af-039356bf6e74 admin admin] PATH_INFO: `/v3/users/9526eb7b0e8a40f5b3fc715484340dd1` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:56.768501 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6e0d7e-5201-4f35-86af-039356bf6e74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9526eb7b0e8a40f5b3fc715484340dd1)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:56.770734 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6e0d7e-5201-4f35-86af-039356bf6e74 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:56.782259 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:56.805526 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62318548-aa1f-498c-beaf-b454a292227a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:56.806707 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62318548-aa1f-498c-beaf-b454a292227a service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:56.807974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62318548-aa1f-498c-beaf-b454a292227a service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:56.808415 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62318548-aa1f-498c-beaf-b454a292227a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:56.810903 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-62318548-aa1f-498c-beaf-b454a292227a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:56.829572 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62318548-aa1f-498c-beaf-b454a292227a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:56.832957 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62318548-aa1f-498c-beaf-b454a292227a service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:56.845047 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1014/2034] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:56:56.847033 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b0753-9e31-4e0b-a49c-b03f145c25d5 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:56.847743 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b0753-9e31-4e0b-a49c-b03f145c25d5 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:56.848248 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b0753-9e31-4e0b-a49c-b03f145c25d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:56.853603 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-3e6e0d7e-5201-4f35-86af-039356bf6e74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9526eb7b0e8a40f5b3fc715484340dd1'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:56.868237 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-3e6e0d7e-5201-4f35-86af-039356bf6e74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9526eb7b0e8a40f5b3fc715484340dd1'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:56.868237 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-3e6e0d7e-5201-4f35-86af-039356bf6e74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9526eb7b0e8a40f5b3fc715484340dd1'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:56.877513 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-5c1b0753-9e31-4e0b-a49c-b03f145c25d5 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:56.881496 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-5c1b0753-9e31-4e0b-a49c-b03f145c25d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:56.891313 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-3e6e0d7e-5201-4f35-86af-039356bf6e74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9526eb7b0e8a40f5b3fc715484340dd1'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:56.892082 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-3e6e0d7e-5201-4f35-86af-039356bf6e74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9526eb7b0e8a40f5b3fc715484340dd1'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:56.893194 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1015/2035] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:56.901216 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe6eb4-69d2-4981-90b3-f8a3ae7acd8f None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:56.901488 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe6eb4-69d2-4981-90b3-f8a3ae7acd8f None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:56.901817 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe6eb4-69d2-4981-90b3-f8a3ae7acd8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:56.910568 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1021/2036] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:56:56 2022] DELETE /identity/v3/users/9526eb7b0e8a40f5b3fc715484340dd1 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:56.916700 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc574ee0-ce2a-49ef-bc18-9657863a6076 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:56.917322 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc574ee0-ce2a-49ef-bc18-9657863a6076 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:56.917686 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc574ee0-ce2a-49ef-bc18-9657863a6076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:56.938766 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-1dfe6eb4-69d2-4981-90b3-f8a3ae7acd8f None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:56.939734 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-dc574ee0-ce2a-49ef-bc18-9657863a6076 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:56.940700 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-1dfe6eb4-69d2-4981-90b3-f8a3ae7acd8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:56.940904 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-dc574ee0-ce2a-49ef-bc18-9657863a6076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:57.010127 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1022/2037] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:57.020241 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc574ee0-ce2a-49ef-bc18-9657863a6076 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:57.022054 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1016/2038] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 15:56:57.022611 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-dc574ee0-ce2a-49ef-bc18-9657863a6076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:57.027842 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe6eb4-69d2-4981-90b3-f8a3ae7acd8f None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:57.045960 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe6eb4-69d2-4981-90b3-f8a3ae7acd8f None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:57.053263 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a8cfb-b80c-4acf-b057-48bd7fe0d7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:57.054113 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a8cfb-b80c-4acf-b057-48bd7fe0d7d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:57.054565 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a8cfb-b80c-4acf-b057-48bd7fe0d7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:57.055517 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a8cfb-b80c-4acf-b057-48bd7fe0d7d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:57.056518 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a8cfb-b80c-4acf-b057-48bd7fe0d7d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:57.056926 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a8cfb-b80c-4acf-b057-48bd7fe0d7d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:57.059080 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a8cfb-b80c-4acf-b057-48bd7fe0d7d6 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:57.068879 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:57.083245 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1017/2039] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 15:56:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:56:57.084595 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a8cfb-b80c-4acf-b057-48bd7fe0d7d6 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:57.097483 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a8cfb-b80c-4acf-b057-48bd7fe0d7d6 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:57.102812 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179c37e-ccec-4214-86a2-1f19e205a5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:57.104122 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179c37e-ccec-4214-86a2-1f19e205a5cd admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:57.104122 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179c37e-ccec-4214-86a2-1f19e205a5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:57.104416 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179c37e-ccec-4214-86a2-1f19e205a5cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:57.105023 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179c37e-ccec-4214-86a2-1f19e205a5cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:57.107322 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179c37e-ccec-4214-86a2-1f19e205a5cd admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:57.143239 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc574ee0-ce2a-49ef-bc18-9657863a6076 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:57.147807 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a05713-7a08-48a3-9dd5-f554c89503f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:57.148432 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a05713-7a08-48a3-9dd5-f554c89503f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:57.149927 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a05713-7a08-48a3-9dd5-f554c89503f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:57.149927 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a05713-7a08-48a3-9dd5-f554c89503f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:57.155102 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1018/2040] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:56:57 2022] POST /identity/v3/projects => generated 383 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:57.156352 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179c37e-ccec-4214-86a2-1f19e205a5cd admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:57.161155 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a05713-7a08-48a3-9dd5-f554c89503f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:57.163070 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a05713-7a08-48a3-9dd5-f554c89503f4 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:57.174017 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1023/2041] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 15:56:57.298769 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a05713-7a08-48a3-9dd5-f554c89503f4 service neutron] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:57.299366 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179c37e-ccec-4214-86a2-1f19e205a5cd admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:57.301005 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-33a05713-7a08-48a3-9dd5-f554c89503f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:57.305774 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4bff27-b9c4-47fd-95ec-5e7754a0212d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:57.307796 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bff27-b9c4-47fd-95ec-5e7754a0212d admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:57.308132 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bff27-b9c4-47fd-95ec-5e7754a0212d admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:57.308593 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bff27-b9c4-47fd-95ec-5e7754a0212d admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:57.310335 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4bff27-b9c4-47fd-95ec-5e7754a0212d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:57.314033 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4bff27-b9c4-47fd-95ec-5e7754a0212d admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:57.346704 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1019/2042] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:56:57 2022] POST /identity/v3/users => generated 292 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:57.351214 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a05713-7a08-48a3-9dd5-f554c89503f4 service neutron] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:57.351506 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4bff27-b9c4-47fd-95ec-5e7754a0212d admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:57.364627 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be018014-8f35-4934-97f9-c72f6f3e58bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:57.366918 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be018014-8f35-4934-97f9-c72f6f3e58bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:57.367178 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be018014-8f35-4934-97f9-c72f6f3e58bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:57.367508 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be018014-8f35-4934-97f9-c72f6f3e58bc admin admin] PATH_INFO: `/v3/projects/56e156b0f5624f9780bb803064419d6b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:57.369320 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4bff27-b9c4-47fd-95ec-5e7754a0212d admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:57.370981 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be018014-8f35-4934-97f9-c72f6f3e58bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=56e156b0f5624f9780bb803064419d6b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:57.373789 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be018014-8f35-4934-97f9-c72f6f3e58bc admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:57.378713 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc3c03-7184-4c95-9e59-8814ba05aeac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:57.380772 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc3c03-7184-4c95-9e59-8814ba05aeac admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:57.384506 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc3c03-7184-4c95-9e59-8814ba05aeac admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:57.385096 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc3c03-7184-4c95-9e59-8814ba05aeac admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:57.385786 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc3c03-7184-4c95-9e59-8814ba05aeac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:57.387499 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc3c03-7184-4c95-9e59-8814ba05aeac admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:57.402089 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1020/2043] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:57.406859 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc3c03-7184-4c95-9e59-8814ba05aeac admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:57.415685 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:57.427690 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc3c03-7184-4c95-9e59-8814ba05aeac admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:57.465633 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-be018014-8f35-4934-97f9-c72f6f3e58bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56e156b0f5624f9780bb803064419d6b', 'request_id': 'req-be018014-8f35-4934-97f9-c72f6f3e58bc'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:57.481503 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-be018014-8f35-4934-97f9-c72f6f3e58bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56e156b0f5624f9780bb803064419d6b', 'request_id': 'req-be018014-8f35-4934-97f9-c72f6f3e58bc'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:57.513425 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-be018014-8f35-4934-97f9-c72f6f3e58bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56e156b0f5624f9780bb803064419d6b', 'request_id': 'req-be018014-8f35-4934-97f9-c72f6f3e58bc'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:57.529808 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-be018014-8f35-4934-97f9-c72f6f3e58bc admin admin] The token cache is being invalidate because project 56e156b0f5624f9780bb803064419d6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:56:57.530892 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-be018014-8f35-4934-97f9-c72f6f3e58bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:57.531576 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-be018014-8f35-4934-97f9-c72f6f3e58bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:57.533253 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1024/2044] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:56:57 2022] DELETE /identity/v3/projects/56e156b0f5624f9780bb803064419d6b => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 15:56:57.537732 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be018014-8f35-4934-97f9-c72f6f3e58bc admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:57.538194 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b5473-5f85-48ed-aec6-beb4a88d6fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:57.538828 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b5473-5f85-48ed-aec6-beb4a88d6fdc admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:57.539637 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b5473-5f85-48ed-aec6-beb4a88d6fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:57.540728 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b5473-5f85-48ed-aec6-beb4a88d6fdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:57.540728 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069b5473-5f85-48ed-aec6-beb4a88d6fdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:57.541193 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-be018014-8f35-4934-97f9-c72f6f3e58bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:57.542300 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069b5473-5f85-48ed-aec6-beb4a88d6fdc admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:57.555752 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1021/2045] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:57.556013 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be018014-8f35-4934-97f9-c72f6f3e58bc admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:57.560014 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b5473-5f85-48ed-aec6-beb4a88d6fdc admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:57.561813 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-069b5473-5f85-48ed-aec6-beb4a88d6fdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:57.562061 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec3816-7710-4357-80fc-720a1fbcf129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:57.563776 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec3816-7710-4357-80fc-720a1fbcf129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:57.568976 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec3816-7710-4357-80fc-720a1fbcf129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:57.569448 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec3816-7710-4357-80fc-720a1fbcf129 admin admin] PATH_INFO: `/v3/users/e94997833d8b4ff0b787edac1095f7b3` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:57.571312 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ec3816-7710-4357-80fc-720a1fbcf129 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e94997833d8b4ff0b787edac1095f7b3)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:57.574882 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ec3816-7710-4357-80fc-720a1fbcf129 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:57.575978 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b5473-5f85-48ed-aec6-beb4a88d6fdc admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:57.581063 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24519c0-3b5e-4f86-a579-6e144aaa4c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:57.581723 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24519c0-3b5e-4f86-a579-6e144aaa4c2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:57.582013 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24519c0-3b5e-4f86-a579-6e144aaa4c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:57.582700 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24519c0-3b5e-4f86-a579-6e144aaa4c2a admin admin] PATH_INFO: `/v3/projects/ddb2809b357c4376a79c3f1191fa6ea0/users/529deb2951f946a8a8ef588473e6e0c0/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:57.599377 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24519c0-3b5e-4f86-a579-6e144aaa4c2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddb2809b357c4376a79c3f1191fa6ea0, user_id=529deb2951f946a8a8ef588473e6e0c0, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:57.602921 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24519c0-3b5e-4f86-a579-6e144aaa4c2a admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:57.626537 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1022/2046] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:57 2022] PUT /identity/v3/projects/ddb2809b357c4376a79c3f1191fa6ea0/users/529deb2951f946a8a8ef588473e6e0c0/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:57.632485 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b48111-698d-44b7-bbae-b2ebdfc8c9a2 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:57.632793 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b48111-698d-44b7-bbae-b2ebdfc8c9a2 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:57.633169 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b48111-698d-44b7-bbae-b2ebdfc8c9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:57.650962 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-47ec3816-7710-4357-80fc-720a1fbcf129 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e94997833d8b4ff0b787edac1095f7b3'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:57.662413 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-66b48111-698d-44b7-bbae-b2ebdfc8c9a2 None None] MFA Rules not processed for user `529deb2951f946a8a8ef588473e6e0c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:57.663625 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-66b48111-698d-44b7-bbae-b2ebdfc8c9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:57.663982 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-47ec3816-7710-4357-80fc-720a1fbcf129 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e94997833d8b4ff0b787edac1095f7b3'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:57.666397 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-47ec3816-7710-4357-80fc-720a1fbcf129 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e94997833d8b4ff0b787edac1095f7b3'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:57.679890 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:57.686277 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-47ec3816-7710-4357-80fc-720a1fbcf129 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e94997833d8b4ff0b787edac1095f7b3'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:57.687548 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-47ec3816-7710-4357-80fc-720a1fbcf129 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e94997833d8b4ff0b787edac1095f7b3'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:57.713922 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1025/2047] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:56:57 2022] DELETE /identity/v3/users/e94997833d8b4ff0b787edac1095f7b3 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:57.714863 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec3816-7710-4357-80fc-720a1fbcf129 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:57.723863 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-47ec3816-7710-4357-80fc-720a1fbcf129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:57.767954 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1023/2048] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 15:56:57.772333 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b48111-698d-44b7-bbae-b2ebdfc8c9a2 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:57.773940 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-66b48111-698d-44b7-bbae-b2ebdfc8c9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:57.813077 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec3816-7710-4357-80fc-720a1fbcf129 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:57.819842 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8eed9d-f33a-46a5-aec5-814244f1f09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:57.820985 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8eed9d-f33a-46a5-aec5-814244f1f09f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:57.821367 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8eed9d-f33a-46a5-aec5-814244f1f09f admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:57.821663 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8eed9d-f33a-46a5-aec5-814244f1f09f admin admin] PATH_INFO: `/v3/projects/741601ab58ba4fb1a34e5e334b202041` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:57.822912 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8eed9d-f33a-46a5-aec5-814244f1f09f admin admin] RBAC: Authorizing `identity:delete_project(project_id=741601ab58ba4fb1a34e5e334b202041)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:57.825519 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8eed9d-f33a-46a5-aec5-814244f1f09f admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:57.856000 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b48111-698d-44b7-bbae-b2ebdfc8c9a2 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:57.862606 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8912c-79fd-4c72-ab99-dfe7ffd4b79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:57.863512 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8912c-79fd-4c72-ab99-dfe7ffd4b79d admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:57.863861 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8912c-79fd-4c72-ab99-dfe7ffd4b79d admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:57.864177 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8912c-79fd-4c72-ab99-dfe7ffd4b79d admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:57.864899 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b8912c-79fd-4c72-ab99-dfe7ffd4b79d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:57.868727 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b8912c-79fd-4c72-ab99-dfe7ffd4b79d admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:57.869733 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:57.897473 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-cb8eed9d-f33a-46a5-aec5-814244f1f09f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '741601ab58ba4fb1a34e5e334b202041', 'request_id': 'req-cb8eed9d-f33a-46a5-aec5-814244f1f09f'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:57.906166 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-cb8eed9d-f33a-46a5-aec5-814244f1f09f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '741601ab58ba4fb1a34e5e334b202041', 'request_id': 'req-cb8eed9d-f33a-46a5-aec5-814244f1f09f'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:57.912028 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1024/2049] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:56:57 2022] POST /identity/v3/projects => generated 383 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 15:56:57.916533 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-cb8eed9d-f33a-46a5-aec5-814244f1f09f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '741601ab58ba4fb1a34e5e334b202041', 'request_id': 'req-cb8eed9d-f33a-46a5-aec5-814244f1f09f'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:57.923322 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8912c-79fd-4c72-ab99-dfe7ffd4b79d admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:57.953962 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-cb8eed9d-f33a-46a5-aec5-814244f1f09f admin admin] The token cache is being invalidate because project 741601ab58ba4fb1a34e5e334b202041 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:56:57.954285 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-cb8eed9d-f33a-46a5-aec5-814244f1f09f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:57.954998 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-cb8eed9d-f33a-46a5-aec5-814244f1f09f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:57.957101 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1026/2050] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:56:57 2022] DELETE /identity/v3/projects/741601ab58ba4fb1a34e5e334b202041 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:57.962096 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d7274-053a-448b-b92a-7c929d80b217 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:57.962615 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d7274-053a-448b-b92a-7c929d80b217 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:57.962923 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d7274-053a-448b-b92a-7c929d80b217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:58.014826 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-039d7274-053a-448b-b92a-7c929d80b217 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:58.016423 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-039d7274-053a-448b-b92a-7c929d80b217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:58.041372 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8912c-79fd-4c72-ab99-dfe7ffd4b79d admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:58.047216 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a61d48b-d3d0-4d22-9b65-3891698235c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:58.047920 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61d48b-d3d0-4d22-9b65-3891698235c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:58.048297 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61d48b-d3d0-4d22-9b65-3891698235c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:58.048640 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61d48b-d3d0-4d22-9b65-3891698235c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:58.049344 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a61d48b-d3d0-4d22-9b65-3891698235c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:58.051666 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a61d48b-d3d0-4d22-9b65-3891698235c7 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:58.081535 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1025/2051] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:56:57 2022] POST /identity/v3/users => generated 292 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:58.089334 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a61d48b-d3d0-4d22-9b65-3891698235c7 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:58.093306 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-2a61d48b-d3d0-4d22-9b65-3891698235c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:58.111960 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a61d48b-d3d0-4d22-9b65-3891698235c7 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:58.117962 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f32c2-291f-414e-b74e-0546ccb8276b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:58.119012 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f32c2-291f-414e-b74e-0546ccb8276b admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:58.119331 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f32c2-291f-414e-b74e-0546ccb8276b admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:58.119611 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f32c2-291f-414e-b74e-0546ccb8276b admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:58.120914 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759f32c2-291f-414e-b74e-0546ccb8276b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:58.122575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759f32c2-291f-414e-b74e-0546ccb8276b admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:58.145959 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1026/2052] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:58.147804 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f32c2-291f-414e-b74e-0546ccb8276b admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:58.163551 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f32c2-291f-414e-b74e-0546ccb8276b admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:58.178970 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b91dd5-41ef-4dfb-a055-12bb5ca99d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:58.180678 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b91dd5-41ef-4dfb-a055-12bb5ca99d0e admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:58.182362 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b91dd5-41ef-4dfb-a055-12bb5ca99d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:58.182793 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b91dd5-41ef-4dfb-a055-12bb5ca99d0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:58.183515 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b91dd5-41ef-4dfb-a055-12bb5ca99d0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:58.187647 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b91dd5-41ef-4dfb-a055-12bb5ca99d0e admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:58.192474 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1027/2053] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:58.201759 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ced945-bb35-482d-823a-b345254eb41f None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:58.201759 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ced945-bb35-482d-823a-b345254eb41f None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:58.201759 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ced945-bb35-482d-823a-b345254eb41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:58.206892 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1027/2054] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:58.208152 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b91dd5-41ef-4dfb-a055-12bb5ca99d0e admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:58.229897 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-97ced945-bb35-482d-823a-b345254eb41f None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:58.231213 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-97ced945-bb35-482d-823a-b345254eb41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:58.237173 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b91dd5-41ef-4dfb-a055-12bb5ca99d0e admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:58.246512 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d043bc6a-c830-41fd-b0c4-2b015ad1d6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:58.247252 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1028/2055] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 15:56:58.247377 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043bc6a-c830-41fd-b0c4-2b015ad1d6a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:58.247557 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043bc6a-c830-41fd-b0c4-2b015ad1d6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:58.247846 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043bc6a-c830-41fd-b0c4-2b015ad1d6a0 admin admin] PATH_INFO: `/v3/projects/c7d8557946cc4fcfb85477055995bd15/users/a380d58f1656486f99c74edcd9c8cc19/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:58.248211 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ced945-bb35-482d-823a-b345254eb41f None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:58.262902 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ced945-bb35-482d-823a-b345254eb41f None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:58.267609 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:58.271858 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cf964d-ef7b-41e8-8a7f-bf327b24e98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:58.273292 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf964d-ef7b-41e8-8a7f-bf327b24e98c admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:58.274736 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf964d-ef7b-41e8-8a7f-bf327b24e98c admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:58.275433 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf964d-ef7b-41e8-8a7f-bf327b24e98c admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:58.276977 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cf964d-ef7b-41e8-8a7f-bf327b24e98c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:58.277728 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cf964d-ef7b-41e8-8a7f-bf327b24e98c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:58.280794 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cf964d-ef7b-41e8-8a7f-bf327b24e98c admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:58.290900 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d043bc6a-c830-41fd-b0c4-2b015ad1d6a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7d8557946cc4fcfb85477055995bd15, user_id=a380d58f1656486f99c74edcd9c8cc19, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:58.296286 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d043bc6a-c830-41fd-b0c4-2b015ad1d6a0 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:58.314093 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1028/2056] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:58 2022] PUT /identity/v3/projects/c7d8557946cc4fcfb85477055995bd15/users/a380d58f1656486f99c74edcd9c8cc19/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 15:56:58.316635 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d043bc6a-c830-41fd-b0c4-2b015ad1d6a0 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:58.319260 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-d043bc6a-c830-41fd-b0c4-2b015ad1d6a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:58.325043 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1029/2057] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 15:56:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:58.326158 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cf964d-ef7b-41e8-8a7f-bf327b24e98c admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:58.339472 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cf964d-ef7b-41e8-8a7f-bf327b24e98c admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:58.423658 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9168cb-0da5-41c3-8381-a31fed590b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:58.424356 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9168cb-0da5-41c3-8381-a31fed590b41 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:58.424668 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9168cb-0da5-41c3-8381-a31fed590b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:58.424977 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9168cb-0da5-41c3-8381-a31fed590b41 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:58.425642 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9168cb-0da5-41c3-8381-a31fed590b41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:58.427609 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9168cb-0da5-41c3-8381-a31fed590b41 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:58.467013 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1030/2058] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:56:58 2022] POST /identity/v3/projects => generated 383 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:58.468630 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e283e4-c543-4f28-8dc3-7ad8fbc40642 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:58.468917 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e283e4-c543-4f28-8dc3-7ad8fbc40642 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:58.469194 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e283e4-c543-4f28-8dc3-7ad8fbc40642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:58.473349 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d043bc6a-c830-41fd-b0c4-2b015ad1d6a0 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:58.501373 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-77e283e4-c543-4f28-8dc3-7ad8fbc40642 None None] MFA Rules not processed for user `a380d58f1656486f99c74edcd9c8cc19`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:58.502699 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-77e283e4-c543-4f28-8dc3-7ad8fbc40642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:58.514926 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:58.583422 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac3fc2d-3f95-432f-a3bf-c251ae8b29bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:58.584314 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3fc2d-3f95-432f-a3bf-c251ae8b29bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:58.584753 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3fc2d-3f95-432f-a3bf-c251ae8b29bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:58.585121 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3fc2d-3f95-432f-a3bf-c251ae8b29bb admin admin] PATH_INFO: `/v3/projects/00e0b513ce704b209bb0c4ca49bdd01c` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:58.586630 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac3fc2d-3f95-432f-a3bf-c251ae8b29bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=00e0b513ce704b209bb0c4ca49bdd01c)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:58.601591 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac3fc2d-3f95-432f-a3bf-c251ae8b29bb admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:58.626226 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1031/2059] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:58.626226 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e283e4-c543-4f28-8dc3-7ad8fbc40642 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:58.665441 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e283e4-c543-4f28-8dc3-7ad8fbc40642 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:58.693565 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440e9bb-4e30-401b-a9fe-9b5f3f25767b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:58.694590 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440e9bb-4e30-401b-a9fe-9b5f3f25767b admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:58.695037 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440e9bb-4e30-401b-a9fe-9b5f3f25767b admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:58.696399 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440e9bb-4e30-401b-a9fe-9b5f3f25767b admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:58.697351 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6440e9bb-4e30-401b-a9fe-9b5f3f25767b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:58.699728 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6440e9bb-4e30-401b-a9fe-9b5f3f25767b admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:58.736797 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-1ac3fc2d-3f95-432f-a3bf-c251ae8b29bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00e0b513ce704b209bb0c4ca49bdd01c', 'request_id': 'req-1ac3fc2d-3f95-432f-a3bf-c251ae8b29bb'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:58.745052 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-1ac3fc2d-3f95-432f-a3bf-c251ae8b29bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00e0b513ce704b209bb0c4ca49bdd01c', 'request_id': 'req-1ac3fc2d-3f95-432f-a3bf-c251ae8b29bb'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:58.758807 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-1ac3fc2d-3f95-432f-a3bf-c251ae8b29bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00e0b513ce704b209bb0c4ca49bdd01c', 'request_id': 'req-1ac3fc2d-3f95-432f-a3bf-c251ae8b29bb'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:58.759718 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1032/2060] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:56:58 2022] POST /identity/v3/users => generated 292 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:58.761168 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440e9bb-4e30-401b-a9fe-9b5f3f25767b admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:58.774127 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440e9bb-4e30-401b-a9fe-9b5f3f25767b admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:58.787771 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-1ac3fc2d-3f95-432f-a3bf-c251ae8b29bb admin admin] The token cache is being invalidate because project 00e0b513ce704b209bb0c4ca49bdd01c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:56:58.788200 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-1ac3fc2d-3f95-432f-a3bf-c251ae8b29bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:58.790409 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-1ac3fc2d-3f95-432f-a3bf-c251ae8b29bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:56:58.795392 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1029/2061] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:56:58 2022] DELETE /identity/v3/projects/00e0b513ce704b209bb0c4ca49bdd01c => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:58.796311 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac3fc2d-3f95-432f-a3bf-c251ae8b29bb admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:58.797875 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-1ac3fc2d-3f95-432f-a3bf-c251ae8b29bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:58.850136 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:58.879898 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf1c1b2-7203-42f4-91a3-706503f72534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:58.880710 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1c1b2-7203-42f4-91a3-706503f72534 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:58.880984 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1c1b2-7203-42f4-91a3-706503f72534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:58.881259 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1c1b2-7203-42f4-91a3-706503f72534 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:58.881898 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf1c1b2-7203-42f4-91a3-706503f72534 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:58.884579 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf1c1b2-7203-42f4-91a3-706503f72534 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:58.922055 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac3fc2d-3f95-432f-a3bf-c251ae8b29bb admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:58.927273 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1033/2062] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:56:58 2022] POST /identity/v3/projects => generated 385 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:58.928798 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b279ce8-bbea-4d09-8a03-1cb69875adb9 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:58.929178 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b279ce8-bbea-4d09-8a03-1cb69875adb9 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:58.929548 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b279ce8-bbea-4d09-8a03-1cb69875adb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:58.942944 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf3a6a-d40b-44a3-a101-8e4379bfc691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:58.944912 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf3a6a-d40b-44a3-a101-8e4379bfc691 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:58.946951 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf3a6a-d40b-44a3-a101-8e4379bfc691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:58.947355 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf3a6a-d40b-44a3-a101-8e4379bfc691 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:58.948108 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcf3a6a-d40b-44a3-a101-8e4379bfc691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:58.949877 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcf3a6a-d40b-44a3-a101-8e4379bfc691 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:58.953413 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-6b279ce8-bbea-4d09-8a03-1cb69875adb9 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:58.954780 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-6b279ce8-bbea-4d09-8a03-1cb69875adb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:58.965371 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1030/2063] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:58.966940 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf3a6a-d40b-44a3-a101-8e4379bfc691 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:58.973420 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-ebcf3a6a-d40b-44a3-a101-8e4379bfc691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:58.990096 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf3a6a-d40b-44a3-a101-8e4379bfc691 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:59.043815 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1034/2064] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:59.044917 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b279ce8-bbea-4d09-8a03-1cb69875adb9 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:59.073058 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b279ce8-bbea-4d09-8a03-1cb69875adb9 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:59.075513 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ddcebc-02bd-489d-8727-9ae3f68c81be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:59.076130 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ddcebc-02bd-489d-8727-9ae3f68c81be admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:59.076402 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ddcebc-02bd-489d-8727-9ae3f68c81be admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:59.076677 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ddcebc-02bd-489d-8727-9ae3f68c81be admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:59.077419 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ddcebc-02bd-489d-8727-9ae3f68c81be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:59.079221 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5891ff7-3478-4317-9fc1-c0b68b4ad230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:59.079840 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5891ff7-3478-4317-9fc1-c0b68b4ad230 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:59.080121 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5891ff7-3478-4317-9fc1-c0b68b4ad230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:59.080224 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ddcebc-02bd-489d-8727-9ae3f68c81be admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:59.080392 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5891ff7-3478-4317-9fc1-c0b68b4ad230 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:59.081038 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5891ff7-3478-4317-9fc1-c0b68b4ad230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:59.082850 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5891ff7-3478-4317-9fc1-c0b68b4ad230 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:59.095244 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1035/2065] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:59.100022 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e0e8f-9d2d-4318-b001-22dd69bc498e None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:59.100417 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e0e8f-9d2d-4318-b001-22dd69bc498e None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:59.100684 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e0e8f-9d2d-4318-b001-22dd69bc498e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:59.109220 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1031/2066] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:56:58 2022] POST /identity/v3/users => generated 299 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:59.111879 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ddcebc-02bd-489d-8727-9ae3f68c81be admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:59.119424 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:59.124430 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ddcebc-02bd-489d-8727-9ae3f68c81be admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:59.127030 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-c67e0e8f-9d2d-4318-b001-22dd69bc498e None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:59.129403 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-c67e0e8f-9d2d-4318-b001-22dd69bc498e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:59.132144 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8d684-46ea-4de6-94a5-b8326e71831d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:59.133627 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8d684-46ea-4de6-94a5-b8326e71831d admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:59.134051 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8d684-46ea-4de6-94a5-b8326e71831d admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:59.134751 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8d684-46ea-4de6-94a5-b8326e71831d admin admin] PATH_INFO: `/v3/projects/efb8d0664d8247a7a8512f0ae7c0c164/users/fe79869d1a404e548b3bcde1ad54f70a/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:59.142830 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1036/2067] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:59.142830 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e0e8f-9d2d-4318-b001-22dd69bc498e None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:59.168810 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e0e8f-9d2d-4318-b001-22dd69bc498e None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:59.176382 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a49b568-ae5f-44f1-88d7-25c33df696a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:59.177188 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49b568-ae5f-44f1-88d7-25c33df696a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:59.177664 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49b568-ae5f-44f1-88d7-25c33df696a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:59.178098 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49b568-ae5f-44f1-88d7-25c33df696a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:59.178895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a49b568-ae5f-44f1-88d7-25c33df696a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:59.181508 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a49b568-ae5f-44f1-88d7-25c33df696a1 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:59.188922 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca8d684-46ea-4de6-94a5-b8326e71831d admin admin] RBAC: Authorizing `identity:create_grant(project_id=efb8d0664d8247a7a8512f0ae7c0c164, user_id=fe79869d1a404e548b3bcde1ad54f70a, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:59.192289 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca8d684-46ea-4de6-94a5-b8326e71831d admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:59.197317 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1037/2068] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:59.198361 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a49b568-ae5f-44f1-88d7-25c33df696a1 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:59.213308 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a49b568-ae5f-44f1-88d7-25c33df696a1 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:59.224153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1032/2069] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:59 2022] PUT /identity/v3/projects/efb8d0664d8247a7a8512f0ae7c0c164/users/fe79869d1a404e548b3bcde1ad54f70a/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:59.228283 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8d684-46ea-4de6-94a5-b8326e71831d admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:59.293682 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967f211-d5a7-4dd9-bc03-1f0d3e1cfacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:59.294578 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967f211-d5a7-4dd9-bc03-1f0d3e1cfacc admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:59.295144 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967f211-d5a7-4dd9-bc03-1f0d3e1cfacc admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:59.295571 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967f211-d5a7-4dd9-bc03-1f0d3e1cfacc admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:59.296382 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d967f211-d5a7-4dd9-bc03-1f0d3e1cfacc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:56:59.296858 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d967f211-d5a7-4dd9-bc03-1f0d3e1cfacc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:59.298684 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d967f211-d5a7-4dd9-bc03-1f0d3e1cfacc admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:59.313421 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1038/2070] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 15:56:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:56:59.314961 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ba53f-92de-4c51-bebf-fb844d72d83d None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:59.315251 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ba53f-92de-4c51-bebf-fb844d72d83d None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:59.315775 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ba53f-92de-4c51-bebf-fb844d72d83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:59.331098 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8d684-46ea-4de6-94a5-b8326e71831d admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:59.337469 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a285a-2c20-4050-aecd-049ef22b0622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:59.338124 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a285a-2c20-4050-aecd-049ef22b0622 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:59.338434 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a285a-2c20-4050-aecd-049ef22b0622 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:59.338824 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a285a-2c20-4050-aecd-049ef22b0622 admin admin] PATH_INFO: `/v3/projects/9bbe6b9a743140a2ac439fd242b7cb9d/users/48d9d469312a4661b3e6f8b87f13dc0e/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:59.348449 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-2b3ba53f-92de-4c51-bebf-fb844d72d83d None None] MFA Rules not processed for user `fe79869d1a404e548b3bcde1ad54f70a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:59.349670 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-2b3ba53f-92de-4c51-bebf-fb844d72d83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:59.358942 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8a285a-2c20-4050-aecd-049ef22b0622 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bbe6b9a743140a2ac439fd242b7cb9d, user_id=48d9d469312a4661b3e6f8b87f13dc0e, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:59.361935 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8a285a-2c20-4050-aecd-049ef22b0622 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:59.379480 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1033/2071] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:59 2022] PUT /identity/v3/projects/9bbe6b9a743140a2ac439fd242b7cb9d/users/48d9d469312a4661b3e6f8b87f13dc0e/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:59.380775 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a285a-2c20-4050-aecd-049ef22b0622 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:59.395824 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:59.469387 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1039/2072] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:59.469387 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ba53f-92de-4c51-bebf-fb844d72d83d None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:59.486311 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ba53f-92de-4c51-bebf-fb844d72d83d None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:59.486618 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a285a-2c20-4050-aecd-049ef22b0622 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:59.491774 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888b593-9ae1-45a4-9a21-6719160def75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:59.492002 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123f413-3955-4225-8125-86e7dcba49a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:59.492838 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123f413-3955-4225-8125-86e7dcba49a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:59.493192 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888b593-9ae1-45a4-9a21-6719160def75 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:59.493531 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123f413-3955-4225-8125-86e7dcba49a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:59.493772 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888b593-9ae1-45a4-9a21-6719160def75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:59.493881 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123f413-3955-4225-8125-86e7dcba49a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:59.494320 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888b593-9ae1-45a4-9a21-6719160def75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:59.494479 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7123f413-3955-4225-8125-86e7dcba49a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:59.495247 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2888b593-9ae1-45a4-9a21-6719160def75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:59.496448 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7123f413-3955-4225-8125-86e7dcba49a6 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:59.498281 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2888b593-9ae1-45a4-9a21-6719160def75 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:59.513140 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1040/2073] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:59.514195 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888b593-9ae1-45a4-9a21-6719160def75 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:59.525778 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888b593-9ae1-45a4-9a21-6719160def75 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:59.532127 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc988c-39f0-483c-a6ef-2b11f9b1f5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:59.532779 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc988c-39f0-483c-a6ef-2b11f9b1f5a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:59.533476 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc988c-39f0-483c-a6ef-2b11f9b1f5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:59.533476 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc988c-39f0-483c-a6ef-2b11f9b1f5a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:59.534035 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc988c-39f0-483c-a6ef-2b11f9b1f5a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:59.535980 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc988c-39f0-483c-a6ef-2b11f9b1f5a4 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:59.571543 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1034/2074] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:56:59 2022] POST /identity/v3/projects => generated 373 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:59.574231 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123f413-3955-4225-8125-86e7dcba49a6 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:59.579334 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1041/2075] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:56:59 2022] POST /identity/v3/projects => generated 385 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:59.580724 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc988c-39f0-483c-a6ef-2b11f9b1f5a4 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:59.655596 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:59.676897 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123f413-3955-4225-8125-86e7dcba49a6 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:59.680056 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc988c-39f0-483c-a6ef-2b11f9b1f5a4 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:59.682823 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57da94-cdfc-4f2f-908b-bc54fe159ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:59.683495 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57da94-cdfc-4f2f-908b-bc54fe159ae3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:59.683873 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57da94-cdfc-4f2f-908b-bc54fe159ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:59.684148 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57da94-cdfc-4f2f-908b-bc54fe159ae3 admin admin] PATH_INFO: `/v3/projects/9bbe6b9a743140a2ac439fd242b7cb9d/users/48d9d469312a4661b3e6f8b87f13dc0e/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:59.685075 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa87754-bfcb-4eb6-a253-73be7825c1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:59.685681 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa87754-bfcb-4eb6-a253-73be7825c1d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:59.685960 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa87754-bfcb-4eb6-a253-73be7825c1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:59.686137 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba57da94-cdfc-4f2f-908b-bc54fe159ae3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bbe6b9a743140a2ac439fd242b7cb9d, user_id=48d9d469312a4661b3e6f8b87f13dc0e, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:59.686260 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa87754-bfcb-4eb6-a253-73be7825c1d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:59.686924 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa87754-bfcb-4eb6-a253-73be7825c1d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:59.688828 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa87754-bfcb-4eb6-a253-73be7825c1d3 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:59.688964 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba57da94-cdfc-4f2f-908b-bc54fe159ae3 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:59.710236 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1035/2076] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:56:59 2022] PUT /identity/v3/projects/9bbe6b9a743140a2ac439fd242b7cb9d/users/48d9d469312a4661b3e6f8b87f13dc0e/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:56:59.710236 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57da94-cdfc-4f2f-908b-bc54fe159ae3 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:59.731436 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1042/2077] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:56:59 2022] POST /identity/v3/users => generated 287 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:59.731436 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadfee58-dded-4fcc-a302-53c0eebca60b None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:59.731436 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadfee58-dded-4fcc-a302-53c0eebca60b None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:59.731436 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadfee58-dded-4fcc-a302-53c0eebca60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:59.769203 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-dadfee58-dded-4fcc-a302-53c0eebca60b None None] MFA Rules not processed for user `48d9d469312a4661b3e6f8b87f13dc0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:56:59.770791 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-dadfee58-dded-4fcc-a302-53c0eebca60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:59.793118 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57da94-cdfc-4f2f-908b-bc54fe159ae3 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:59.799779 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c2304-c957-4186-b7fa-e5c47aa465d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:59.800399 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c2304-c957-4186-b7fa-e5c47aa465d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:59.800743 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c2304-c957-4186-b7fa-e5c47aa465d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:59.801024 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c2304-c957-4186-b7fa-e5c47aa465d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:59.801685 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c2304-c957-4186-b7fa-e5c47aa465d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:59.804282 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c2304-c957-4186-b7fa-e5c47aa465d0 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:59.831457 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1036/2078] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:56:59 2022] POST /identity/v3/users => generated 293 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:56:59.835156 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c2304-c957-4186-b7fa-e5c47aa465d0 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:59.854016 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c2304-c957-4186-b7fa-e5c47aa465d0 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:59.860957 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd01e09-cf42-4428-8997-f36b69de673a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:59.861580 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd01e09-cf42-4428-8997-f36b69de673a admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:59.861857 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd01e09-cf42-4428-8997-f36b69de673a admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:59.862133 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd01e09-cf42-4428-8997-f36b69de673a admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:59.862815 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd01e09-cf42-4428-8997-f36b69de673a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:59.864422 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd01e09-cf42-4428-8997-f36b69de673a admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:59.864808 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1043/2079] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:56:59 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:56:59.865724 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadfee58-dded-4fcc-a302-53c0eebca60b None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:59.882653 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1037/2080] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:59.884129 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd01e09-cf42-4428-8997-f36b69de673a admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:59.887039 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadfee58-dded-4fcc-a302-53c0eebca60b None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:59.888722 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-9fd01e09-cf42-4428-8997-f36b69de673a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:56:59.892771 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4297674d-6872-45f9-b7ae-8f1329cfdd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:59.893479 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297674d-6872-45f9-b7ae-8f1329cfdd27 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:59.894158 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297674d-6872-45f9-b7ae-8f1329cfdd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:59.894158 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297674d-6872-45f9-b7ae-8f1329cfdd27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:59.895204 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4297674d-6872-45f9-b7ae-8f1329cfdd27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:59.895315 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:56:59.897183 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4297674d-6872-45f9-b7ae-8f1329cfdd27 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:59.910677 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1044/2081] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:59.911472 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4297674d-6872-45f9-b7ae-8f1329cfdd27 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:59.929540 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4297674d-6872-45f9-b7ae-8f1329cfdd27 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:59.935784 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c3836-4530-4bb0-8595-fc3cfb6d8516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:59.936669 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c3836-4530-4bb0-8595-fc3cfb6d8516 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:59.936970 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c3836-4530-4bb0-8595-fc3cfb6d8516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:59.937250 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c3836-4530-4bb0-8595-fc3cfb6d8516 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:59.937897 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c3836-4530-4bb0-8595-fc3cfb6d8516 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:56:59.939752 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c3836-4530-4bb0-8595-fc3cfb6d8516 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:56:59.976142 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd01e09-cf42-4428-8997-f36b69de673a admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:56:59.982055 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1045/2082] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:56:59.982487 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c4b68-756a-428f-ba70-065f21127e03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:56:59.983456 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c4b68-756a-428f-ba70-065f21127e03 service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:56:59.983593 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c3836-4530-4bb0-8595-fc3cfb6d8516 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:56:59.983747 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c4b68-756a-428f-ba70-065f21127e03 service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:56:59.984029 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c4b68-756a-428f-ba70-065f21127e03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:56:59.985987 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-2b9c4b68-756a-428f-ba70-065f21127e03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:00.005177 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c3836-4530-4bb0-8595-fc3cfb6d8516 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:00.012723 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e7794-7b58-4981-b48a-7b797099831e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:00.013387 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e7794-7b58-4981-b48a-7b797099831e admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:00.013795 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e7794-7b58-4981-b48a-7b797099831e admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:00.014241 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e7794-7b58-4981-b48a-7b797099831e admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:00.015006 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e7794-7b58-4981-b48a-7b797099831e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:00.016804 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e7794-7b58-4981-b48a-7b797099831e admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:00.028755 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1046/2083] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:57:00.029672 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e7794-7b58-4981-b48a-7b797099831e admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:00.046707 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e7794-7b58-4981-b48a-7b797099831e admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:00.052191 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c4b68-756a-428f-ba70-065f21127e03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:00.053574 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaca717-4994-46f0-8483-b08494d71aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:00.053725 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c4b68-756a-428f-ba70-065f21127e03 service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:00.055130 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaca717-4994-46f0-8483-b08494d71aa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:00.055631 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaca717-4994-46f0-8483-b08494d71aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:00.056192 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaca717-4994-46f0-8483-b08494d71aa3 admin admin] PATH_INFO: `/v3/projects/07179378245f4a9889f02676cdd73124/users/6769412d02d0483aa979e3005ce4179e/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:00.062934 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1038/2084] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:56:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:57:00.063748 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c4b68-756a-428f-ba70-065f21127e03 service cinder] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:00.075273 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c4b68-756a-428f-ba70-065f21127e03 service cinder] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:00.076554 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaca717-4994-46f0-8483-b08494d71aa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07179378245f4a9889f02676cdd73124, user_id=6769412d02d0483aa979e3005ce4179e, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:00.079264 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaca717-4994-46f0-8483-b08494d71aa3 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:00.080678 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366c179-3bd8-4d91-840f-e21db32b8e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:00.082298 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366c179-3bd8-4d91-840f-e21db32b8e5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:00.082680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366c179-3bd8-4d91-840f-e21db32b8e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:00.083054 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366c179-3bd8-4d91-840f-e21db32b8e5b admin admin] PATH_INFO: `/v3/projects/f956b2ca5dfc4cec8b7d7cbd76ac0fd3/users/7cc1c318ae4c47e3aeea13980064843a/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:00.098289 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1047/2085] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:57:00 2022] PUT /identity/v3/projects/07179378245f4a9889f02676cdd73124/users/6769412d02d0483aa979e3005ce4179e/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:00.112562 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9366c179-3bd8-4d91-840f-e21db32b8e5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f956b2ca5dfc4cec8b7d7cbd76ac0fd3, user_id=7cc1c318ae4c47e3aeea13980064843a, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:00.115384 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9366c179-3bd8-4d91-840f-e21db32b8e5b admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:00.117293 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3193e-c4f0-4632-9012-6420f4666edc None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:00.118227 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3193e-c4f0-4632-9012-6420f4666edc None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:00.118632 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3193e-c4f0-4632-9012-6420f4666edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:00.138244 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1039/2086] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:57:00 2022] PUT /identity/v3/projects/f956b2ca5dfc4cec8b7d7cbd76ac0fd3/users/7cc1c318ae4c47e3aeea13980064843a/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:00.144186 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb37ab-e2f4-4ff5-95ae-9f057583089c None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:00.144722 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb37ab-e2f4-4ff5-95ae-9f057583089c None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:00.145013 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb37ab-e2f4-4ff5-95ae-9f057583089c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:00.185522 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-57d3193e-c4f0-4632-9012-6420f4666edc None None] MFA Rules not processed for user `6769412d02d0483aa979e3005ce4179e`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:00.185522 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-57d3193e-c4f0-4632-9012-6420f4666edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:00.185870 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-cdbb37ab-e2f4-4ff5-95ae-9f057583089c None None] MFA Rules not processed for user `7cc1c318ae4c47e3aeea13980064843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:00.190165 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-cdbb37ab-e2f4-4ff5-95ae-9f057583089c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:00.284336 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1040/2087] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:57:00.292174 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb37ab-e2f4-4ff5-95ae-9f057583089c None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:00.293463 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:00.331307 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:00.353612 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1048/2088] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:57:00.408495 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb37ab-e2f4-4ff5-95ae-9f057583089c None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:00.413681 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3896607-c2b4-4231-a9cf-d5d713ebd59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:00.414979 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3896607-c2b4-4231-a9cf-d5d713ebd59c admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:00.415364 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3896607-c2b4-4231-a9cf-d5d713ebd59c admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:00.415647 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3896607-c2b4-4231-a9cf-d5d713ebd59c admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:00.416288 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3896607-c2b4-4231-a9cf-d5d713ebd59c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:00.418228 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3896607-c2b4-4231-a9cf-d5d713ebd59c admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:00.457979 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1041/2089] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:57:00 2022] POST /identity/v3/projects => generated 383 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 15:57:00.460619 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3193e-c4f0-4632-9012-6420f4666edc None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:00.498226 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3193e-c4f0-4632-9012-6420f4666edc None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:00.502418 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3896607-c2b4-4231-a9cf-d5d713ebd59c admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:00.574583 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3896607-c2b4-4231-a9cf-d5d713ebd59c admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:00.587016 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b43e86-2be1-479b-b36d-343e98a665bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:00.587873 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b43e86-2be1-479b-b36d-343e98a665bf service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:00.588169 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b43e86-2be1-479b-b36d-343e98a665bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:00.588480 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b43e86-2be1-479b-b36d-343e98a665bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:00.604078 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ccfbf3-5c06-46bc-895e-855bfd30e350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:00.605927 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ccfbf3-5c06-46bc-895e-855bfd30e350 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:00.606437 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ccfbf3-5c06-46bc-895e-855bfd30e350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:00.606887 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ccfbf3-5c06-46bc-895e-855bfd30e350 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:00.608031 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ccfbf3-5c06-46bc-895e-855bfd30e350 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:00.610415 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ccfbf3-5c06-46bc-895e-855bfd30e350 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:00.639934 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1049/2090] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:57:00 2022] POST /identity/v3/users => generated 298 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:57:00.647142 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ccfbf3-5c06-46bc-895e-855bfd30e350 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:00.675161 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ccfbf3-5c06-46bc-895e-855bfd30e350 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:00.689008 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9e29b-56c3-42f6-8307-445fe1b9efd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:00.689871 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9e29b-56c3-42f6-8307-445fe1b9efd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:00.690335 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9e29b-56c3-42f6-8307-445fe1b9efd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:00.691080 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9e29b-56c3-42f6-8307-445fe1b9efd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:00.692810 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b9e29b-56c3-42f6-8307-445fe1b9efd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:00.696707 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b9e29b-56c3-42f6-8307-445fe1b9efd2 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:00.710716 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1050/2091] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 15:57:00.718379 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9e29b-56c3-42f6-8307-445fe1b9efd2 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:00.720708 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b43e86-2be1-479b-b36d-343e98a665bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:00.722157 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b43e86-2be1-479b-b36d-343e98a665bf service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:00.731348 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9e29b-56c3-42f6-8307-445fe1b9efd2 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:00.739197 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe78f196-c6f9-4247-bc8e-38112af4be33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:00.739787 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe78f196-c6f9-4247-bc8e-38112af4be33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:00.740076 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe78f196-c6f9-4247-bc8e-38112af4be33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:00.740387 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe78f196-c6f9-4247-bc8e-38112af4be33 admin admin] PATH_INFO: `/v3/projects/8215a0c44225453481e40049988ad506/users/008a5d7727c740088cd419d4b8c9ba7a/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:00.747958 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1042/2092] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:57:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 15:57:00.768429 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b43e86-2be1-479b-b36d-343e98a665bf service cinder] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:00.772129 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe78f196-c6f9-4247-bc8e-38112af4be33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8215a0c44225453481e40049988ad506, user_id=008a5d7727c740088cd419d4b8c9ba7a, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:00.779358 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe78f196-c6f9-4247-bc8e-38112af4be33 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:00.785807 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b43e86-2be1-479b-b36d-343e98a665bf service cinder] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:00.799295 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a25b074-9715-45be-9716-aaaeacfb9a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:00.800665 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25b074-9715-45be-9716-aaaeacfb9a5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:00.800975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25b074-9715-45be-9716-aaaeacfb9a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:00.801260 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25b074-9715-45be-9716-aaaeacfb9a5d admin admin] PATH_INFO: `/v3/users/6769412d02d0483aa979e3005ce4179e` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:00.804094 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1051/2093] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:57:00 2022] PUT /identity/v3/projects/8215a0c44225453481e40049988ad506/users/008a5d7727c740088cd419d4b8c9ba7a/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:00.809768 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe78f196-c6f9-4247-bc8e-38112af4be33 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:00.810367 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a25b074-9715-45be-9716-aaaeacfb9a5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6769412d02d0483aa979e3005ce4179e)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:00.812487 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a25b074-9715-45be-9716-aaaeacfb9a5d admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:00.943061 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-6a25b074-9715-45be-9716-aaaeacfb9a5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6769412d02d0483aa979e3005ce4179e'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:00.958601 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe78f196-c6f9-4247-bc8e-38112af4be33 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:00.960680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-6a25b074-9715-45be-9716-aaaeacfb9a5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6769412d02d0483aa979e3005ce4179e'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:00.962517 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-6a25b074-9715-45be-9716-aaaeacfb9a5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6769412d02d0483aa979e3005ce4179e'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:00.966511 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33105e-d918-4b8b-ad85-1df4df0055f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:00.967529 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33105e-d918-4b8b-ad85-1df4df0055f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:00.968394 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33105e-d918-4b8b-ad85-1df4df0055f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:00.968791 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33105e-d918-4b8b-ad85-1df4df0055f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:00.978561 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:00.978561 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-6a25b074-9715-45be-9716-aaaeacfb9a5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6769412d02d0483aa979e3005ce4179e'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:00.979742 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc33105e-d918-4b8b-ad85-1df4df0055f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:00.987241 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc33105e-d918-4b8b-ad85-1df4df0055f8 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:00.992805 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-6a25b074-9715-45be-9716-aaaeacfb9a5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6769412d02d0483aa979e3005ce4179e'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:01.029742 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1043/2094] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:57:00 2022] DELETE /identity/v3/users/6769412d02d0483aa979e3005ce4179e => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:01.047925 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2a026-38b7-4196-9df1-eebd89688b4c None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:01.048224 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2a026-38b7-4196-9df1-eebd89688b4c None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:01.048486 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2a026-38b7-4196-9df1-eebd89688b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:01.053560 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1052/2095] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:57:01.059297 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33105e-d918-4b8b-ad85-1df4df0055f8 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:01.063756 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-cc33105e-d918-4b8b-ad85-1df4df0055f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:01.074988 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-6bf2a026-38b7-4196-9df1-eebd89688b4c None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:01.076714 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-6bf2a026-38b7-4196-9df1-eebd89688b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:01.095057 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33105e-d918-4b8b-ad85-1df4df0055f8 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:01.154061 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1044/2096] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:57:01.171264 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:01.209126 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf2a026-38b7-4196-9df1-eebd89688b4c None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:01.212354 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-6bf2a026-38b7-4196-9df1-eebd89688b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:01.222169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0119f-7a9e-447b-bbcf-4d893dd4ca4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:01.223340 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0119f-7a9e-447b-bbcf-4d893dd4ca4d admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:01.223630 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0119f-7a9e-447b-bbcf-4d893dd4ca4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:01.223914 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0119f-7a9e-447b-bbcf-4d893dd4ca4d admin admin] PATH_INFO: `/v3/projects/8215a0c44225453481e40049988ad506/users/008a5d7727c740088cd419d4b8c9ba7a/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:01.226757 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d0119f-7a9e-447b-bbcf-4d893dd4ca4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8215a0c44225453481e40049988ad506, user_id=008a5d7727c740088cd419d4b8c9ba7a, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:01.233630 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d0119f-7a9e-447b-bbcf-4d893dd4ca4d admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:01.252613 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1053/2097] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:57:01 2022] PUT /identity/v3/projects/8215a0c44225453481e40049988ad506/users/008a5d7727c740088cd419d4b8c9ba7a/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:01.268935 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e70b3-3143-496d-93e7-9a5c9ee34181 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:01.270566 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e70b3-3143-496d-93e7-9a5c9ee34181 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:01.270908 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e70b3-3143-496d-93e7-9a5c9ee34181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:01.319838 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf2a026-38b7-4196-9df1-eebd89688b4c None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:01.355595 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-662e70b3-3143-496d-93e7-9a5c9ee34181 None None] MFA Rules not processed for user `008a5d7727c740088cd419d4b8c9ba7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:01.372094 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-662e70b3-3143-496d-93e7-9a5c9ee34181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:01.426735 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7359ece-82a2-4ea8-8743-ab465886605f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:01.427246 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7359ece-82a2-4ea8-8743-ab465886605f service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:01.427526 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7359ece-82a2-4ea8-8743-ab465886605f service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:01.427980 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7359ece-82a2-4ea8-8743-ab465886605f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:01.481659 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1054/2098] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:01 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:57:01.490841 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e70b3-3143-496d-93e7-9a5c9ee34181 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:01.492465 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-662e70b3-3143-496d-93e7-9a5c9ee34181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:01.499579 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:01.521050 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7359ece-82a2-4ea8-8743-ab465886605f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:01.522548 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7359ece-82a2-4ea8-8743-ab465886605f service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:01.534687 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1045/2099] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:57:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 15:57:01.557231 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e70b3-3143-496d-93e7-9a5c9ee34181 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:01.560955 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f59cf8-4325-4d96-a0d8-7ce909102825 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:01.561561 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f59cf8-4325-4d96-a0d8-7ce909102825 service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:01.561840 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f59cf8-4325-4d96-a0d8-7ce909102825 service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:01.562111 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f59cf8-4325-4d96-a0d8-7ce909102825 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:01.563874 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-58f59cf8-4325-4d96-a0d8-7ce909102825 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:01.631771 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f59cf8-4325-4d96-a0d8-7ce909102825 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:01.634064 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f59cf8-4325-4d96-a0d8-7ce909102825 service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:01.646327 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1055/2100] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:57:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 15:57:02.211853 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7359ece-82a2-4ea8-8743-ab465886605f service neutron] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:02.215069 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-a7359ece-82a2-4ea8-8743-ab465886605f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:02.228139 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7359ece-82a2-4ea8-8743-ab465886605f service neutron] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:02.232399 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a03e8-9ce9-4879-8cff-ddbe12a33da6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:02.233295 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f59cf8-4325-4d96-a0d8-7ce909102825 service cinder] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:02.233430 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a03e8-9ce9-4879-8cff-ddbe12a33da6 service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:02.233677 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a03e8-9ce9-4879-8cff-ddbe12a33da6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:02.233852 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a03e8-9ce9-4879-8cff-ddbe12a33da6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:02.234912 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-58f59cf8-4325-4d96-a0d8-7ce909102825 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:02.235698 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-af4a03e8-9ce9-4879-8cff-ddbe12a33da6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:02.260877 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f59cf8-4325-4d96-a0d8-7ce909102825 service cinder] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:02.265972 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6333992-4396-4441-a625-143d4c1a979f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:02.267044 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6333992-4396-4441-a625-143d4c1a979f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:02.267564 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6333992-4396-4441-a625-143d4c1a979f admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:02.267688 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6333992-4396-4441-a625-143d4c1a979f admin admin] PATH_INFO: `/v3/projects/07179378245f4a9889f02676cdd73124` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:02.269244 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6333992-4396-4441-a625-143d4c1a979f admin admin] RBAC: Authorizing `identity:delete_project(project_id=07179378245f4a9889f02676cdd73124)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:02.272790 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6333992-4396-4441-a625-143d4c1a979f admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:02.281861 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:02.339122 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-f6333992-4396-4441-a625-143d4c1a979f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07179378245f4a9889f02676cdd73124', 'request_id': 'req-f6333992-4396-4441-a625-143d4c1a979f'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:02.342837 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a03e8-9ce9-4879-8cff-ddbe12a33da6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:02.344752 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a03e8-9ce9-4879-8cff-ddbe12a33da6 service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:02.346193 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-f6333992-4396-4441-a625-143d4c1a979f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07179378245f4a9889f02676cdd73124', 'request_id': 'req-f6333992-4396-4441-a625-143d4c1a979f'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:02.356669 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-f6333992-4396-4441-a625-143d4c1a979f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07179378245f4a9889f02676cdd73124', 'request_id': 'req-f6333992-4396-4441-a625-143d4c1a979f'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:02.358329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1046/2101] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:57:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:57:02.387127 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-f6333992-4396-4441-a625-143d4c1a979f admin admin] The token cache is being invalidate because project 07179378245f4a9889f02676cdd73124 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:57:02.389953 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-f6333992-4396-4441-a625-143d4c1a979f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:02.391116 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-f6333992-4396-4441-a625-143d4c1a979f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:02.396296 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1056/2102] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:57:02 2022] DELETE /identity/v3/projects/07179378245f4a9889f02676cdd73124 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 15:57:02.397902 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f3d4a-1e1f-4d77-b1a1-21a3d642a82d None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:02.398830 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f3d4a-1e1f-4d77-b1a1-21a3d642a82d None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:02.399841 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f3d4a-1e1f-4d77-b1a1-21a3d642a82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:02.425048 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-7a5f3d4a-1e1f-4d77-b1a1-21a3d642a82d None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:02.426384 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-7a5f3d4a-1e1f-4d77-b1a1-21a3d642a82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:02.516367 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1047/2103] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:57:02.525572 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10dce82-c961-4550-a4c7-c8b69b95f536 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:02.525985 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10dce82-c961-4550-a4c7-c8b69b95f536 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:02.526298 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10dce82-c961-4550-a4c7-c8b69b95f536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:02.570891 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-a10dce82-c961-4550-a4c7-c8b69b95f536 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:02.573052 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-a10dce82-c961-4550-a4c7-c8b69b95f536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:02.589035 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1057/2104] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:57:02.591140 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f3d4a-1e1f-4d77-b1a1-21a3d642a82d None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:02.605762 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f3d4a-1e1f-4d77-b1a1-21a3d642a82d None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:02.612947 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e75a20-ffaa-4125-aa54-54d434483b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:02.613568 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e75a20-ffaa-4125-aa54-54d434483b7c admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:02.613849 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e75a20-ffaa-4125-aa54-54d434483b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:02.614126 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e75a20-ffaa-4125-aa54-54d434483b7c admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:02.614859 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e75a20-ffaa-4125-aa54-54d434483b7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:02.615167 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e75a20-ffaa-4125-aa54-54d434483b7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:02.616830 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e75a20-ffaa-4125-aa54-54d434483b7c admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:02.638109 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1048/2105] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 15:57:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:57:02.639603 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10dce82-c961-4550-a4c7-c8b69b95f536 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:02.671586 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10dce82-c961-4550-a4c7-c8b69b95f536 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:02.680792 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad036f-e751-4dc9-b26d-a2d24e80e100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:02.681972 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad036f-e751-4dc9-b26d-a2d24e80e100 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:02.682754 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad036f-e751-4dc9-b26d-a2d24e80e100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:02.683275 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad036f-e751-4dc9-b26d-a2d24e80e100 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:02.684057 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad036f-e751-4dc9-b26d-a2d24e80e100 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:02.687057 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad036f-e751-4dc9-b26d-a2d24e80e100 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:02.750085 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1058/2106] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:57:02 2022] POST /identity/v3/projects => generated 369 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:57:02.751126 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e75a20-ffaa-4125-aa54-54d434483b7c admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:02.768885 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e75a20-ffaa-4125-aa54-54d434483b7c admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:02.848365 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421ad74-57f8-4628-ac51-0ab56b9551fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:02.849003 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421ad74-57f8-4628-ac51-0ab56b9551fc admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:02.849285 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421ad74-57f8-4628-ac51-0ab56b9551fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:02.849559 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421ad74-57f8-4628-ac51-0ab56b9551fc admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:02.850206 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b421ad74-57f8-4628-ac51-0ab56b9551fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:02.852329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b421ad74-57f8-4628-ac51-0ab56b9551fc admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:02.868729 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:02.876300 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1049/2107] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:57:02 2022] POST /identity/v3/users => generated 285 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:57:02.880861 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad036f-e751-4dc9-b26d-a2d24e80e100 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:02.894276 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad036f-e751-4dc9-b26d-a2d24e80e100 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:02.901178 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d38090-14e2-4567-8294-1714c9b2862c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:02.901699 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d38090-14e2-4567-8294-1714c9b2862c admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:02.917301 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d38090-14e2-4567-8294-1714c9b2862c admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:02.918309 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d38090-14e2-4567-8294-1714c9b2862c admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:02.919130 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d38090-14e2-4567-8294-1714c9b2862c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:02.925395 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d38090-14e2-4567-8294-1714c9b2862c admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:02.956851 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1059/2108] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:57:02 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:57:02.962785 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421ad74-57f8-4628-ac51-0ab56b9551fc admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:02.981676 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421ad74-57f8-4628-ac51-0ab56b9551fc admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:03.002283 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f105a71-75d2-465d-a4e4-5e49a203dd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:03.002283 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f105a71-75d2-465d-a4e4-5e49a203dd59 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:03.002283 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f105a71-75d2-465d-a4e4-5e49a203dd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:03.002283 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f105a71-75d2-465d-a4e4-5e49a203dd59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:03.005505 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f105a71-75d2-465d-a4e4-5e49a203dd59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:03.022398 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f105a71-75d2-465d-a4e4-5e49a203dd59 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:03.043736 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1050/2109] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:57:02 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:57:03.048154 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d38090-14e2-4567-8294-1714c9b2862c admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:03.064042 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d38090-14e2-4567-8294-1714c9b2862c admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:03.079543 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c73fd4-f4ec-49b4-b575-c3a545085365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:03.081362 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c73fd4-f4ec-49b4-b575-c3a545085365 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:03.081663 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c73fd4-f4ec-49b4-b575-c3a545085365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:03.081943 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c73fd4-f4ec-49b4-b575-c3a545085365 admin admin] PATH_INFO: `/v3/projects/a858abe7d80548f2ba5c534505fd058e/users/5fa44f2ae691477eb62a084c82144a61/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:03.120521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c73fd4-f4ec-49b4-b575-c3a545085365 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a858abe7d80548f2ba5c534505fd058e, user_id=5fa44f2ae691477eb62a084c82144a61, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:03.123501 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c73fd4-f4ec-49b4-b575-c3a545085365 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:03.151889 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1060/2110] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:57:03 2022] PUT /identity/v3/projects/a858abe7d80548f2ba5c534505fd058e/users/5fa44f2ae691477eb62a084c82144a61/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:03.162487 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb265b9-fd39-42f1-8f45-cd5292bb5560 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:03.163389 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb265b9-fd39-42f1-8f45-cd5292bb5560 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:03.163794 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb265b9-fd39-42f1-8f45-cd5292bb5560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:03.227319 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-ffb265b9-fd39-42f1-8f45-cd5292bb5560 None None] MFA Rules not processed for user `5fa44f2ae691477eb62a084c82144a61`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:03.229595 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-ffb265b9-fd39-42f1-8f45-cd5292bb5560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:03.311537 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1051/2111] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:57:03.346645 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c73fd4-f4ec-49b4-b575-c3a545085365 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:03.356046 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-d1c73fd4-f4ec-49b4-b575-c3a545085365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:03.513715 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb265b9-fd39-42f1-8f45-cd5292bb5560 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:03.515699 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-ffb265b9-fd39-42f1-8f45-cd5292bb5560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:03.582798 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c73fd4-f4ec-49b4-b575-c3a545085365 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:03.590939 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa756b07-af69-4081-8bf6-d8642ac5ef08 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5753fea47f5944cd93dbea90fb9ad9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:03.591915 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa756b07-af69-4081-8bf6-d8642ac5ef08 service glance] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:03.592345 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa756b07-af69-4081-8bf6-d8642ac5ef08 service glance] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:03.593120 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa756b07-af69-4081-8bf6-d8642ac5ef08 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:03.606007 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa756b07-af69-4081-8bf6-d8642ac5ef08 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:03.615219 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa756b07-af69-4081-8bf6-d8642ac5ef08 service glance] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:03.637647 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1061/2112] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:57:03 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:57:03.643101 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb265b9-fd39-42f1-8f45-cd5292bb5560 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:03.647443 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3651630-9a88-4e7c-8ebb-00423c9382d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:03.648998 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3651630-9a88-4e7c-8ebb-00423c9382d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:03.649557 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3651630-9a88-4e7c-8ebb-00423c9382d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:03.650044 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3651630-9a88-4e7c-8ebb-00423c9382d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:03.652875 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-f3651630-9a88-4e7c-8ebb-00423c9382d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:03.670386 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa756b07-af69-4081-8bf6-d8642ac5ef08 service glance] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:03.672090 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-fa756b07-af69-4081-8bf6-d8642ac5ef08 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:03.688815 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa756b07-af69-4081-8bf6-d8642ac5ef08 service glance] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:03.698580 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35c4b1-0d6d-491a-81ac-1e14ddcbc71e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:03.698686 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35c4b1-0d6d-491a-81ac-1e14ddcbc71e service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:03.699013 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35c4b1-0d6d-491a-81ac-1e14ddcbc71e service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:03.699435 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35c4b1-0d6d-491a-81ac-1e14ddcbc71e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:03.701982 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-ce35c4b1-0d6d-491a-81ac-1e14ddcbc71e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:03.715022 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:03.776837 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3651630-9a88-4e7c-8ebb-00423c9382d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:03.778674 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3651630-9a88-4e7c-8ebb-00423c9382d8 service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:03.792601 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1052/2113] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:57:03 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 15:57:03.805649 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce35c4b1-0d6d-491a-81ac-1e14ddcbc71e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:03.807161 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce35c4b1-0d6d-491a-81ac-1e14ddcbc71e service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:03.817469 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1062/2114] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:57:03 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 15:57:04.670835 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3651630-9a88-4e7c-8ebb-00423c9382d8 service cinder] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:04.681224 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3651630-9a88-4e7c-8ebb-00423c9382d8 service cinder] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:04.685048 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46c74e-93c4-45b2-9354-452b030242fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:04.685739 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46c74e-93c4-45b2-9354-452b030242fc service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:04.686280 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46c74e-93c4-45b2-9354-452b030242fc service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:04.686686 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46c74e-93c4-45b2-9354-452b030242fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:04.688596 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-cf46c74e-93c4-45b2-9354-452b030242fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:04.734386 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:04.797185 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf46c74e-93c4-45b2-9354-452b030242fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:04.798829 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf46c74e-93c4-45b2-9354-452b030242fc service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:04.818784 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1053/2115] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:57:04 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:57:07.726336 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35c4b1-0d6d-491a-81ac-1e14ddcbc71e service cinder] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:07.727943 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-ce35c4b1-0d6d-491a-81ac-1e14ddcbc71e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:07.863070 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35c4b1-0d6d-491a-81ac-1e14ddcbc71e service cinder] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:07.874256 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d96540-88c4-4df2-8897-9b48d3556323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:07.875155 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d96540-88c4-4df2-8897-9b48d3556323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:07.875610 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d96540-88c4-4df2-8897-9b48d3556323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:07.875892 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d96540-88c4-4df2-8897-9b48d3556323 admin admin] PATH_INFO: `/v3/users/92025f2a8eae44749b032e740ecc92a1` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:07.879071 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d96540-88c4-4df2-8897-9b48d3556323 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92025f2a8eae44749b032e740ecc92a1)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:07.880973 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d96540-88c4-4df2-8897-9b48d3556323 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:07.919373 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46c74e-93c4-45b2-9354-452b030242fc service cinder] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:07.921933 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-cf46c74e-93c4-45b2-9354-452b030242fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:07.950719 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46c74e-93c4-45b2-9354-452b030242fc service cinder] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:07.957846 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0efb60-2b40-4be6-868f-919649ca01a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:07.958696 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0efb60-2b40-4be6-868f-919649ca01a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:07.959174 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0efb60-2b40-4be6-868f-919649ca01a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:07.959568 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0efb60-2b40-4be6-868f-919649ca01a9 admin admin] PATH_INFO: `/v3/users/529deb2951f946a8a8ef588473e6e0c0` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:07.961994 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0efb60-2b40-4be6-868f-919649ca01a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=529deb2951f946a8a8ef588473e6e0c0)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:07.966659 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0efb60-2b40-4be6-868f-919649ca01a9 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:08.052537 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-64d96540-88c4-4df2-8897-9b48d3556323 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92025f2a8eae44749b032e740ecc92a1'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:08.059917 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-ff0efb60-2b40-4be6-868f-919649ca01a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '529deb2951f946a8a8ef588473e6e0c0'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:08.063178 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-64d96540-88c4-4df2-8897-9b48d3556323 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92025f2a8eae44749b032e740ecc92a1'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:08.063811 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-64d96540-88c4-4df2-8897-9b48d3556323 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92025f2a8eae44749b032e740ecc92a1'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:08.069469 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-ff0efb60-2b40-4be6-868f-919649ca01a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '529deb2951f946a8a8ef588473e6e0c0'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:08.070888 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-ff0efb60-2b40-4be6-868f-919649ca01a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '529deb2951f946a8a8ef588473e6e0c0'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:08.081929 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-ff0efb60-2b40-4be6-868f-919649ca01a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '529deb2951f946a8a8ef588473e6e0c0'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:08.082743 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-ff0efb60-2b40-4be6-868f-919649ca01a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '529deb2951f946a8a8ef588473e6e0c0'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:08.089225 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-64d96540-88c4-4df2-8897-9b48d3556323 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92025f2a8eae44749b032e740ecc92a1'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:08.090667 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-64d96540-88c4-4df2-8897-9b48d3556323 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92025f2a8eae44749b032e740ecc92a1'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:08.119166 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1063/2116] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:57:07 2022] DELETE /identity/v3/users/92025f2a8eae44749b032e740ecc92a1 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:08.123877 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1054/2117] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:57:07 2022] DELETE /identity/v3/users/529deb2951f946a8a8ef588473e6e0c0 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:08.124350 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa45d0-9dfc-450d-8dd9-f99ea7eaed7e None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:08.125035 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa45d0-9dfc-450d-8dd9-f99ea7eaed7e None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:08.125628 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa45d0-9dfc-450d-8dd9-f99ea7eaed7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:08.129841 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c33c71-648b-4ad4-a8ec-38e32dfe1f15 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:08.130132 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c33c71-648b-4ad4-a8ec-38e32dfe1f15 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:08.130438 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c33c71-648b-4ad4-a8ec-38e32dfe1f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:08.168033 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-61c33c71-648b-4ad4-a8ec-38e32dfe1f15 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:08.169367 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-61c33c71-648b-4ad4-a8ec-38e32dfe1f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:08.182101 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-e3aa45d0-9dfc-450d-8dd9-f99ea7eaed7e None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:08.187229 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-e3aa45d0-9dfc-450d-8dd9-f99ea7eaed7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:08.266101 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:08.276217 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1055/2118] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:57:08.287968 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c33c71-648b-4ad4-a8ec-38e32dfe1f15 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:08.289355 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-61c33c71-648b-4ad4-a8ec-38e32dfe1f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:08.387933 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1064/2119] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 15:57:08.392336 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:08.396032 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa45d0-9dfc-450d-8dd9-f99ea7eaed7e None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:08.402942 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-e3aa45d0-9dfc-450d-8dd9-f99ea7eaed7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:08.443365 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c33c71-648b-4ad4-a8ec-38e32dfe1f15 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:08.447712 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244043e-0b1b-4c7b-aa7d-132ca74c9e3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:08.448413 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244043e-0b1b-4c7b-aa7d-132ca74c9e3b service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:08.448770 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244043e-0b1b-4c7b-aa7d-132ca74c9e3b service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:08.449118 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244043e-0b1b-4c7b-aa7d-132ca74c9e3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:08.463463 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b244043e-0b1b-4c7b-aa7d-132ca74c9e3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:08.465255 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b244043e-0b1b-4c7b-aa7d-132ca74c9e3b service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:08.480578 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1056/2120] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:57:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:57:08.553662 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa45d0-9dfc-450d-8dd9-f99ea7eaed7e None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:08.560474 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef78b526-5ecf-45f6-9ad5-805f91cfc812 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:08.561377 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78b526-5ecf-45f6-9ad5-805f91cfc812 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:08.561825 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78b526-5ecf-45f6-9ad5-805f91cfc812 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:08.562279 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78b526-5ecf-45f6-9ad5-805f91cfc812 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:08.574904 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef78b526-5ecf-45f6-9ad5-805f91cfc812 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:08.576444 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef78b526-5ecf-45f6-9ad5-805f91cfc812 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:08.589383 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1065/2121] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:57:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:57:08.874909 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244043e-0b1b-4c7b-aa7d-132ca74c9e3b service neutron] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:08.876457 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b244043e-0b1b-4c7b-aa7d-132ca74c9e3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:08.890643 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244043e-0b1b-4c7b-aa7d-132ca74c9e3b service neutron] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:08.895981 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd777cae-993b-4be3-b073-2557cc4e4c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:08.896699 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd777cae-993b-4be3-b073-2557cc4e4c94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:08.897065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd777cae-993b-4be3-b073-2557cc4e4c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:08.897410 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd777cae-993b-4be3-b073-2557cc4e4c94 admin admin] PATH_INFO: `/v3/projects/ddb2809b357c4376a79c3f1191fa6ea0` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:08.898709 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd777cae-993b-4be3-b073-2557cc4e4c94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddb2809b357c4376a79c3f1191fa6ea0)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:08.910261 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd777cae-993b-4be3-b073-2557cc4e4c94 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:09.002409 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-bd777cae-993b-4be3-b073-2557cc4e4c94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddb2809b357c4376a79c3f1191fa6ea0', 'request_id': 'req-bd777cae-993b-4be3-b073-2557cc4e4c94'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:09.029384 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-bd777cae-993b-4be3-b073-2557cc4e4c94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddb2809b357c4376a79c3f1191fa6ea0', 'request_id': 'req-bd777cae-993b-4be3-b073-2557cc4e4c94'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:09.050865 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-bd777cae-993b-4be3-b073-2557cc4e4c94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddb2809b357c4376a79c3f1191fa6ea0', 'request_id': 'req-bd777cae-993b-4be3-b073-2557cc4e4c94'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:09.080991 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-bd777cae-993b-4be3-b073-2557cc4e4c94 admin admin] The token cache is being invalidate because project ddb2809b357c4376a79c3f1191fa6ea0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:57:09.081613 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-bd777cae-993b-4be3-b073-2557cc4e4c94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:09.082607 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-bd777cae-993b-4be3-b073-2557cc4e4c94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:09.085653 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1057/2122] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:57:08 2022] DELETE /identity/v3/projects/ddb2809b357c4376a79c3f1191fa6ea0 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:09.090253 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef78b526-5ecf-45f6-9ad5-805f91cfc812 service neutron] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:09.103815 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd777cae-993b-4be3-b073-2557cc4e4c94 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:09.105391 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-bd777cae-993b-4be3-b073-2557cc4e4c94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:09.105516 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef78b526-5ecf-45f6-9ad5-805f91cfc812 service neutron] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:09.189919 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd777cae-993b-4be3-b073-2557cc4e4c94 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:09.197194 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31304194-a226-4571-9a67-8de89b02dcb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:09.197912 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31304194-a226-4571-9a67-8de89b02dcb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:09.198233 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31304194-a226-4571-9a67-8de89b02dcb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:09.198516 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31304194-a226-4571-9a67-8de89b02dcb0 admin admin] PATH_INFO: `/v3/projects/b527da681a014427bc3e4ed1be082671` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:09.199690 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31304194-a226-4571-9a67-8de89b02dcb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b527da681a014427bc3e4ed1be082671)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:09.201620 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31304194-a226-4571-9a67-8de89b02dcb0 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:09.211861 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669d0b2-408b-4cc9-b079-84a72fcd148c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:09.213268 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669d0b2-408b-4cc9-b079-84a72fcd148c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:09.213587 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669d0b2-408b-4cc9-b079-84a72fcd148c admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:09.213872 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669d0b2-408b-4cc9-b079-84a72fcd148c admin admin] PATH_INFO: `/v3/users/a380d58f1656486f99c74edcd9c8cc19` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:09.215061 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1669d0b2-408b-4cc9-b079-84a72fcd148c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a380d58f1656486f99c74edcd9c8cc19)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:09.217040 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1669d0b2-408b-4cc9-b079-84a72fcd148c admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:09.282667 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-31304194-a226-4571-9a67-8de89b02dcb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b527da681a014427bc3e4ed1be082671', 'request_id': 'req-31304194-a226-4571-9a67-8de89b02dcb0'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:09.290793 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-31304194-a226-4571-9a67-8de89b02dcb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b527da681a014427bc3e4ed1be082671', 'request_id': 'req-31304194-a226-4571-9a67-8de89b02dcb0'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:09.292331 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-1669d0b2-408b-4cc9-b079-84a72fcd148c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a380d58f1656486f99c74edcd9c8cc19'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:09.295168 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:09.303461 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-1669d0b2-408b-4cc9-b079-84a72fcd148c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a380d58f1656486f99c74edcd9c8cc19'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:09.304103 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-1669d0b2-408b-4cc9-b079-84a72fcd148c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a380d58f1656486f99c74edcd9c8cc19'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:09.311411 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-31304194-a226-4571-9a67-8de89b02dcb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b527da681a014427bc3e4ed1be082671', 'request_id': 'req-31304194-a226-4571-9a67-8de89b02dcb0'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:09.327107 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-1669d0b2-408b-4cc9-b079-84a72fcd148c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a380d58f1656486f99c74edcd9c8cc19'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:09.327815 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-1669d0b2-408b-4cc9-b079-84a72fcd148c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a380d58f1656486f99c74edcd9c8cc19'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:09.328782 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-31304194-a226-4571-9a67-8de89b02dcb0 admin admin] The token cache is being invalidate because project b527da681a014427bc3e4ed1be082671 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:57:09.329184 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-31304194-a226-4571-9a67-8de89b02dcb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:09.329841 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-31304194-a226-4571-9a67-8de89b02dcb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:09.334669 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1058/2123] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:57:09 2022] DELETE /identity/v3/projects/b527da681a014427bc3e4ed1be082671 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:09.341418 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31304194-a226-4571-9a67-8de89b02dcb0 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:09.342948 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-31304194-a226-4571-9a67-8de89b02dcb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:09.348777 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:09.371484 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1066/2124] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:57:09 2022] DELETE /identity/v3/users/a380d58f1656486f99c74edcd9c8cc19 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:09.447637 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31304194-a226-4571-9a67-8de89b02dcb0 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:09.517425 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa7a6d-7eac-4095-8400-67fbff10d391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:09.518131 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa7a6d-7eac-4095-8400-67fbff10d391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:09.518449 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa7a6d-7eac-4095-8400-67fbff10d391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:09.518732 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa7a6d-7eac-4095-8400-67fbff10d391 admin admin] PATH_INFO: `/v3/users/9b206d287237495c8701676b6675e059` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:09.520269 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aa7a6d-7eac-4095-8400-67fbff10d391 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b206d287237495c8701676b6675e059)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:09.524038 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aa7a6d-7eac-4095-8400-67fbff10d391 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:09.606074 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669d0b2-408b-4cc9-b079-84a72fcd148c admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:09.607181 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-e1aa7a6d-7eac-4095-8400-67fbff10d391 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b206d287237495c8701676b6675e059'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:09.610246 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-1669d0b2-408b-4cc9-b079-84a72fcd148c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:09.618519 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-e1aa7a6d-7eac-4095-8400-67fbff10d391 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b206d287237495c8701676b6675e059'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:09.619367 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-e1aa7a6d-7eac-4095-8400-67fbff10d391 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b206d287237495c8701676b6675e059'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:09.627162 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669d0b2-408b-4cc9-b079-84a72fcd148c admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:09.630684 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-e1aa7a6d-7eac-4095-8400-67fbff10d391 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b206d287237495c8701676b6675e059'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:09.634782 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-e1aa7a6d-7eac-4095-8400-67fbff10d391 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b206d287237495c8701676b6675e059'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:09.641328 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21417b38-887c-40c4-95b7-62516a3fb36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:09.641986 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21417b38-887c-40c4-95b7-62516a3fb36a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:09.642303 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21417b38-887c-40c4-95b7-62516a3fb36a admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:09.642584 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21417b38-887c-40c4-95b7-62516a3fb36a admin admin] PATH_INFO: `/v3/users/fe79869d1a404e548b3bcde1ad54f70a` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:09.643770 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21417b38-887c-40c4-95b7-62516a3fb36a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe79869d1a404e548b3bcde1ad54f70a)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:09.646084 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21417b38-887c-40c4-95b7-62516a3fb36a admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:09.676171 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1059/2125] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:57:09 2022] DELETE /identity/v3/users/9b206d287237495c8701676b6675e059 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:09.774503 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-21417b38-887c-40c4-95b7-62516a3fb36a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe79869d1a404e548b3bcde1ad54f70a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:09.779252 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa7a6d-7eac-4095-8400-67fbff10d391 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:09.781381 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-e1aa7a6d-7eac-4095-8400-67fbff10d391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:09.820244 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:09.823087 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-21417b38-887c-40c4-95b7-62516a3fb36a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe79869d1a404e548b3bcde1ad54f70a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:09.825718 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-21417b38-887c-40c4-95b7-62516a3fb36a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe79869d1a404e548b3bcde1ad54f70a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:09.866478 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-21417b38-887c-40c4-95b7-62516a3fb36a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe79869d1a404e548b3bcde1ad54f70a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:09.871810 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-21417b38-887c-40c4-95b7-62516a3fb36a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe79869d1a404e548b3bcde1ad54f70a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:09.893144 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1067/2126] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:57:09 2022] DELETE /identity/v3/users/fe79869d1a404e548b3bcde1ad54f70a => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 15:57:09.894983 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa7a6d-7eac-4095-8400-67fbff10d391 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:09.900102 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3db2fb-4594-408b-b484-d833cd77f979 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:09.900628 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3db2fb-4594-408b-b484-d833cd77f979 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:09.901366 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3db2fb-4594-408b-b484-d833cd77f979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:09.939488 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-af3db2fb-4594-408b-b484-d833cd77f979 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:09.941121 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-af3db2fb-4594-408b-b484-d833cd77f979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:09.968123 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d7b7dd-b643-4133-b366-f3d8fd954ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:09.969225 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7b7dd-b643-4133-b366-f3d8fd954ed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:09.969579 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7b7dd-b643-4133-b366-f3d8fd954ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:09.970065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7b7dd-b643-4133-b366-f3d8fd954ed3 admin admin] PATH_INFO: `/v3/projects/c7d8557946cc4fcfb85477055995bd15` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:09.971477 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d7b7dd-b643-4133-b366-f3d8fd954ed3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7d8557946cc4fcfb85477055995bd15)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:09.974117 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d7b7dd-b643-4133-b366-f3d8fd954ed3 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:10.050825 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1068/2127] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:57:10.058888 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-40d7b7dd-b643-4133-b366-f3d8fd954ed3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7d8557946cc4fcfb85477055995bd15', 'request_id': 'req-40d7b7dd-b643-4133-b366-f3d8fd954ed3'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:10.067229 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-40d7b7dd-b643-4133-b366-f3d8fd954ed3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7d8557946cc4fcfb85477055995bd15', 'request_id': 'req-40d7b7dd-b643-4133-b366-f3d8fd954ed3'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:10.068506 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3db2fb-4594-408b-b484-d833cd77f979 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:10.075018 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-af3db2fb-4594-408b-b484-d833cd77f979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:10.076524 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-40d7b7dd-b643-4133-b366-f3d8fd954ed3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7d8557946cc4fcfb85477055995bd15', 'request_id': 'req-40d7b7dd-b643-4133-b366-f3d8fd954ed3'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:10.099784 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-40d7b7dd-b643-4133-b366-f3d8fd954ed3 admin admin] The token cache is being invalidate because project c7d8557946cc4fcfb85477055995bd15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:57:10.100552 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-40d7b7dd-b643-4133-b366-f3d8fd954ed3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:10.102647 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-40d7b7dd-b643-4133-b366-f3d8fd954ed3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:10.109032 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1060/2128] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:57:09 2022] DELETE /identity/v3/projects/c7d8557946cc4fcfb85477055995bd15 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 15:57:10.110077 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d7b7dd-b643-4133-b366-f3d8fd954ed3 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:10.113354 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-40d7b7dd-b643-4133-b366-f3d8fd954ed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:10.164837 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3db2fb-4594-408b-b484-d833cd77f979 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:10.186431 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:10.228389 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0028d0-668c-46d7-86d5-b21dbf252f83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:10.229248 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0028d0-668c-46d7-86d5-b21dbf252f83 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:10.229633 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0028d0-668c-46d7-86d5-b21dbf252f83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:10.230003 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0028d0-668c-46d7-86d5-b21dbf252f83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:10.235569 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-cb0028d0-668c-46d7-86d5-b21dbf252f83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:10.249336 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:10.293546 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d7b7dd-b643-4133-b366-f3d8fd954ed3 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:10.308726 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4d7fe-33da-407f-8ccc-187c07f1651e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:10.310142 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4d7fe-33da-407f-8ccc-187c07f1651e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:10.310532 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4d7fe-33da-407f-8ccc-187c07f1651e admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:10.311374 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4d7fe-33da-407f-8ccc-187c07f1651e admin admin] PATH_INFO: `/v3/users/48d9d469312a4661b3e6f8b87f13dc0e` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:10.312663 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d4d7fe-33da-407f-8ccc-187c07f1651e admin admin] RBAC: Authorizing `identity:delete_user(user_id=48d9d469312a4661b3e6f8b87f13dc0e)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:10.314848 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d4d7fe-33da-407f-8ccc-187c07f1651e admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:10.322319 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0028d0-668c-46d7-86d5-b21dbf252f83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:10.325115 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0028d0-668c-46d7-86d5-b21dbf252f83 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:10.339965 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1069/2129] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:57:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:57:10.340531 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0028d0-668c-46d7-86d5-b21dbf252f83 service neutron] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:10.342130 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-cb0028d0-668c-46d7-86d5-b21dbf252f83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:10.358359 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0028d0-668c-46d7-86d5-b21dbf252f83 service neutron] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:10.362884 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacbe158-442e-4286-b817-a3f069bd95a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:10.363764 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbe158-442e-4286-b817-a3f069bd95a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:10.363881 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbe158-442e-4286-b817-a3f069bd95a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:10.364229 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbe158-442e-4286-b817-a3f069bd95a9 admin admin] PATH_INFO: `/v3/projects/af389f7e7fda442983328a92ce6d6661` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:10.365418 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacbe158-442e-4286-b817-a3f069bd95a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af389f7e7fda442983328a92ce6d6661)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:10.367489 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacbe158-442e-4286-b817-a3f069bd95a9 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:10.393951 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-93d4d7fe-33da-407f-8ccc-187c07f1651e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48d9d469312a4661b3e6f8b87f13dc0e'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:10.406929 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-93d4d7fe-33da-407f-8ccc-187c07f1651e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48d9d469312a4661b3e6f8b87f13dc0e'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:10.408250 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-93d4d7fe-33da-407f-8ccc-187c07f1651e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48d9d469312a4661b3e6f8b87f13dc0e'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:10.420827 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-93d4d7fe-33da-407f-8ccc-187c07f1651e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48d9d469312a4661b3e6f8b87f13dc0e'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:10.421910 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-93d4d7fe-33da-407f-8ccc-187c07f1651e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48d9d469312a4661b3e6f8b87f13dc0e'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:10.433449 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-eacbe158-442e-4286-b817-a3f069bd95a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af389f7e7fda442983328a92ce6d6661', 'request_id': 'req-eacbe158-442e-4286-b817-a3f069bd95a9'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:10.440442 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-eacbe158-442e-4286-b817-a3f069bd95a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af389f7e7fda442983328a92ce6d6661', 'request_id': 'req-eacbe158-442e-4286-b817-a3f069bd95a9'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:10.442135 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1061/2130] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:57:10 2022] DELETE /identity/v3/users/48d9d469312a4661b3e6f8b87f13dc0e => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:10.449582 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-eacbe158-442e-4286-b817-a3f069bd95a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af389f7e7fda442983328a92ce6d6661', 'request_id': 'req-eacbe158-442e-4286-b817-a3f069bd95a9'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:10.465963 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-eacbe158-442e-4286-b817-a3f069bd95a9 admin admin] The token cache is being invalidate because project af389f7e7fda442983328a92ce6d6661 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:57:10.466312 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-eacbe158-442e-4286-b817-a3f069bd95a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:10.467020 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-eacbe158-442e-4286-b817-a3f069bd95a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:10.469307 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1070/2131] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:57:10 2022] DELETE /identity/v3/projects/af389f7e7fda442983328a92ce6d6661 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:10.474483 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d721f-6a2f-4a3b-8ffc-d794c2f17610 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:10.474777 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d721f-6a2f-4a3b-8ffc-d794c2f17610 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:10.475049 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d721f-6a2f-4a3b-8ffc-d794c2f17610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:10.499396 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-957d721f-6a2f-4a3b-8ffc-d794c2f17610 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:10.500731 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-957d721f-6a2f-4a3b-8ffc-d794c2f17610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:10.579728 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1062/2132] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:57:10.588687 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5618c3b-7f5c-4059-9e32-97a9e0355e50 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:10.588981 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5618c3b-7f5c-4059-9e32-97a9e0355e50 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:10.589269 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5618c3b-7f5c-4059-9e32-97a9e0355e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:10.612054 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-a5618c3b-7f5c-4059-9e32-97a9e0355e50 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:10.613197 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-a5618c3b-7f5c-4059-9e32-97a9e0355e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:10.634845 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1071/2133] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:57:10.635679 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d721f-6a2f-4a3b-8ffc-d794c2f17610 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:10.648369 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d721f-6a2f-4a3b-8ffc-d794c2f17610 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:10.653399 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee636eb-c88c-483c-8eba-276657ec33eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:10.654021 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee636eb-c88c-483c-8eba-276657ec33eb admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:10.654751 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee636eb-c88c-483c-8eba-276657ec33eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:10.655026 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee636eb-c88c-483c-8eba-276657ec33eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:10.655685 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee636eb-c88c-483c-8eba-276657ec33eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:10.655984 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee636eb-c88c-483c-8eba-276657ec33eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:10.657617 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee636eb-c88c-483c-8eba-276657ec33eb admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:10.678422 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1063/2134] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 15:57:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:57:10.679978 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5618c3b-7f5c-4059-9e32-97a9e0355e50 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:10.691741 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5618c3b-7f5c-4059-9e32-97a9e0355e50 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:10.696902 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee636eb-c88c-483c-8eba-276657ec33eb admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:10.698144 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14046e-6aaf-4531-8a88-f3e4db5de452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:10.698837 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14046e-6aaf-4531-8a88-f3e4db5de452 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:10.699122 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14046e-6aaf-4531-8a88-f3e4db5de452 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:10.699397 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14046e-6aaf-4531-8a88-f3e4db5de452 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:10.699592 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-eee636eb-c88c-483c-8eba-276657ec33eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:10.700039 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14046e-6aaf-4531-8a88-f3e4db5de452 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:10.702844 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14046e-6aaf-4531-8a88-f3e4db5de452 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:10.719652 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee636eb-c88c-483c-8eba-276657ec33eb admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:10.730714 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab0d51-d601-43a7-a49d-eb6468218057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:10.737270 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab0d51-d601-43a7-a49d-eb6468218057 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:10.737569 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab0d51-d601-43a7-a49d-eb6468218057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:10.737832 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab0d51-d601-43a7-a49d-eb6468218057 admin admin] PATH_INFO: `/v3/projects/efb8d0664d8247a7a8512f0ae7c0c164` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:10.739764 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cab0d51-d601-43a7-a49d-eb6468218057 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efb8d0664d8247a7a8512f0ae7c0c164)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:10.742349 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cab0d51-d601-43a7-a49d-eb6468218057 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:10.770758 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1072/2135] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:57:10 2022] POST /identity/v3/projects => generated 383 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 15:57:10.779177 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14046e-6aaf-4531-8a88-f3e4db5de452 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:10.827644 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-9cab0d51-d601-43a7-a49d-eb6468218057 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efb8d0664d8247a7a8512f0ae7c0c164', 'request_id': 'req-9cab0d51-d601-43a7-a49d-eb6468218057'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:10.832419 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:10.837248 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-9cab0d51-d601-43a7-a49d-eb6468218057 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efb8d0664d8247a7a8512f0ae7c0c164', 'request_id': 'req-9cab0d51-d601-43a7-a49d-eb6468218057'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:10.839151 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:10.851853 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-9cab0d51-d601-43a7-a49d-eb6468218057 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efb8d0664d8247a7a8512f0ae7c0c164', 'request_id': 'req-9cab0d51-d601-43a7-a49d-eb6468218057'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:10.872871 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-9cab0d51-d601-43a7-a49d-eb6468218057 admin admin] The token cache is being invalidate because project efb8d0664d8247a7a8512f0ae7c0c164 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:57:10.873094 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-9cab0d51-d601-43a7-a49d-eb6468218057 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:10.873967 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-9cab0d51-d601-43a7-a49d-eb6468218057 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:10.876521 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1064/2136] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:57:10 2022] DELETE /identity/v3/projects/efb8d0664d8247a7a8512f0ae7c0c164 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 15:57:10.877807 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab0d51-d601-43a7-a49d-eb6468218057 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:10.879687 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-9cab0d51-d601-43a7-a49d-eb6468218057 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:10.896714 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14046e-6aaf-4531-8a88-f3e4db5de452 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:10.964762 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab0d51-d601-43a7-a49d-eb6468218057 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:10.968692 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c2681-7fba-4431-91d5-de95ffcc459e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:10.970111 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c2681-7fba-4431-91d5-de95ffcc459e admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:10.970428 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c2681-7fba-4431-91d5-de95ffcc459e admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:10.970705 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c2681-7fba-4431-91d5-de95ffcc459e admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:10.971346 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718c2681-7fba-4431-91d5-de95ffcc459e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:10.971451 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af16be1-9741-4bbb-9b69-b7e60e0018e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:10.972039 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af16be1-9741-4bbb-9b69-b7e60e0018e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:10.972323 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af16be1-9741-4bbb-9b69-b7e60e0018e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:10.972596 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af16be1-9741-4bbb-9b69-b7e60e0018e3 admin admin] PATH_INFO: `/v3/projects/9bbe6b9a743140a2ac439fd242b7cb9d` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:10.973275 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718c2681-7fba-4431-91d5-de95ffcc459e admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:10.975052 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af16be1-9741-4bbb-9b69-b7e60e0018e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bbe6b9a743140a2ac439fd242b7cb9d)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:10.977314 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af16be1-9741-4bbb-9b69-b7e60e0018e3 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:11.004748 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1073/2137] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:57:10 2022] POST /identity/v3/users => generated 292 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 15:57:11.004748 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c2681-7fba-4431-91d5-de95ffcc459e admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:11.006857 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-718c2681-7fba-4431-91d5-de95ffcc459e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:11.021097 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c2681-7fba-4431-91d5-de95ffcc459e admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:11.047241 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af03ce3a-f968-4bd2-8e4b-ca62ea76b818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:11.048903 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-6af16be1-9741-4bbb-9b69-b7e60e0018e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bbe6b9a743140a2ac439fd242b7cb9d', 'request_id': 'req-6af16be1-9741-4bbb-9b69-b7e60e0018e3'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:11.049262 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03ce3a-f968-4bd2-8e4b-ca62ea76b818 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:11.049551 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03ce3a-f968-4bd2-8e4b-ca62ea76b818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:11.049828 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03ce3a-f968-4bd2-8e4b-ca62ea76b818 admin admin] PATH_INFO: `/v3/users/7cc1c318ae4c47e3aeea13980064843a` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:11.051079 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af03ce3a-f968-4bd2-8e4b-ca62ea76b818 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cc1c318ae4c47e3aeea13980064843a)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:11.053190 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af03ce3a-f968-4bd2-8e4b-ca62ea76b818 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:11.056422 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-6af16be1-9741-4bbb-9b69-b7e60e0018e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bbe6b9a743140a2ac439fd242b7cb9d', 'request_id': 'req-6af16be1-9741-4bbb-9b69-b7e60e0018e3'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:11.066577 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-6af16be1-9741-4bbb-9b69-b7e60e0018e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bbe6b9a743140a2ac439fd242b7cb9d', 'request_id': 'req-6af16be1-9741-4bbb-9b69-b7e60e0018e3'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:11.082239 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-6af16be1-9741-4bbb-9b69-b7e60e0018e3 admin admin] The token cache is being invalidate because project 9bbe6b9a743140a2ac439fd242b7cb9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:57:11.082838 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-6af16be1-9741-4bbb-9b69-b7e60e0018e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:11.083524 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-6af16be1-9741-4bbb-9b69-b7e60e0018e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:11.085337 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1065/2138] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:57:10 2022] DELETE /identity/v3/projects/9bbe6b9a743140a2ac439fd242b7cb9d => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:11.089212 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af16be1-9741-4bbb-9b69-b7e60e0018e3 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:11.089212 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-6af16be1-9741-4bbb-9b69-b7e60e0018e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:11.114197 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-af03ce3a-f968-4bd2-8e4b-ca62ea76b818 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cc1c318ae4c47e3aeea13980064843a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:11.123931 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-af03ce3a-f968-4bd2-8e4b-ca62ea76b818 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cc1c318ae4c47e3aeea13980064843a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:11.124752 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-af03ce3a-f968-4bd2-8e4b-ca62ea76b818 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cc1c318ae4c47e3aeea13980064843a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:11.140613 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-af03ce3a-f968-4bd2-8e4b-ca62ea76b818 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cc1c318ae4c47e3aeea13980064843a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:11.141819 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-af03ce3a-f968-4bd2-8e4b-ca62ea76b818 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cc1c318ae4c47e3aeea13980064843a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:11.160749 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1074/2139] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:57:11 2022] DELETE /identity/v3/users/7cc1c318ae4c47e3aeea13980064843a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:11.162263 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc2f3c-70a3-47d0-959d-28772c1d88eb None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:11.162561 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc2f3c-70a3-47d0-959d-28772c1d88eb None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:11.162842 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc2f3c-70a3-47d0-959d-28772c1d88eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:11.195882 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-8cbc2f3c-70a3-47d0-959d-28772c1d88eb None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:11.197871 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-8cbc2f3c-70a3-47d0-959d-28772c1d88eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:11.200774 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af16be1-9741-4bbb-9b69-b7e60e0018e3 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:11.220575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:11.232933 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:11.276439 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c5076-9089-48d5-b537-01ab874ddb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:11.277342 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c5076-9089-48d5-b537-01ab874ddb4f admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:11.277879 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c5076-9089-48d5-b537-01ab874ddb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:11.278737 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c5076-9089-48d5-b537-01ab874ddb4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:11.278997 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1075/2140] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:57:11.279347 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0c5076-9089-48d5-b537-01ab874ddb4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:11.281269 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0c5076-9089-48d5-b537-01ab874ddb4f admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:11.288032 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2a505-13a2-44cf-a967-83e0aa4a7ebc None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:11.288382 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2a505-13a2-44cf-a967-83e0aa4a7ebc None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:11.288675 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2a505-13a2-44cf-a967-83e0aa4a7ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:11.300440 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1066/2141] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:57:11.301594 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c5076-9089-48d5-b537-01ab874ddb4f admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:11.303509 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-0e0c5076-9089-48d5-b537-01ab874ddb4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:11.319868 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-20c2a505-13a2-44cf-a967-83e0aa4a7ebc None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:11.321759 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-20c2a505-13a2-44cf-a967-83e0aa4a7ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:11.323692 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c5076-9089-48d5-b537-01ab874ddb4f admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:11.332744 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1076/2142] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 15:57:11.335354 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af0e06-c911-437b-8d69-9b85b6307879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:11.337248 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af0e06-c911-437b-8d69-9b85b6307879 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:11.337455 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2a505-13a2-44cf-a967-83e0aa4a7ebc None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:11.337656 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af0e06-c911-437b-8d69-9b85b6307879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:11.337951 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af0e06-c911-437b-8d69-9b85b6307879 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:11.338628 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af0e06-c911-437b-8d69-9b85b6307879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:11.342961 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af0e06-c911-437b-8d69-9b85b6307879 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:11.353218 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2a505-13a2-44cf-a967-83e0aa4a7ebc None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:11.354815 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1067/2143] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:57:11.359093 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af0e06-c911-437b-8d69-9b85b6307879 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:11.364134 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb8ad48-189e-4ed2-a43d-f6aee9f49c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:11.364938 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8ad48-189e-4ed2-a43d-f6aee9f49c98 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:11.365293 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8ad48-189e-4ed2-a43d-f6aee9f49c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:11.366039 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8ad48-189e-4ed2-a43d-f6aee9f49c98 admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:11.366258 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb8ad48-189e-4ed2-a43d-f6aee9f49c98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:11.366568 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb8ad48-189e-4ed2-a43d-f6aee9f49c98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:11.368778 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb8ad48-189e-4ed2-a43d-f6aee9f49c98 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:11.372313 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af0e06-c911-437b-8d69-9b85b6307879 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:11.377559 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac90fa-5bca-4213-b1c4-3007bceed253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:11.378328 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac90fa-5bca-4213-b1c4-3007bceed253 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:11.378718 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac90fa-5bca-4213-b1c4-3007bceed253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:11.379221 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac90fa-5bca-4213-b1c4-3007bceed253 admin admin] PATH_INFO: `/v3/projects/de8a4b7f768b4e138e25ba449e44ca92/users/fa112e2dff854278aa80c428eeaaa265/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:11.384955 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1077/2144] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 15:57:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:57:11.389912 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb8ad48-189e-4ed2-a43d-f6aee9f49c98 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:11.403606 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb8ad48-189e-4ed2-a43d-f6aee9f49c98 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:11.407951 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac90fa-5bca-4213-b1c4-3007bceed253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de8a4b7f768b4e138e25ba449e44ca92, user_id=fa112e2dff854278aa80c428eeaaa265, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:11.410645 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f8c916-8ea8-4c1a-8212-30df4ea60a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:11.411413 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8c916-8ea8-4c1a-8212-30df4ea60a11 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:11.411760 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8c916-8ea8-4c1a-8212-30df4ea60a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:11.412120 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8c916-8ea8-4c1a-8212-30df4ea60a11 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:11.412830 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f8c916-8ea8-4c1a-8212-30df4ea60a11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:11.415623 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac90fa-5bca-4213-b1c4-3007bceed253 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:11.415754 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f8c916-8ea8-4c1a-8212-30df4ea60a11 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:11.450213 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1068/2145] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:57:11 2022] PUT /identity/v3/projects/de8a4b7f768b4e138e25ba449e44ca92/users/fa112e2dff854278aa80c428eeaaa265/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 15:57:11.454879 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8db390-81d0-4467-9ecf-90c308944399 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:11.455108 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8db390-81d0-4467-9ecf-90c308944399 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:11.455684 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8db390-81d0-4467-9ecf-90c308944399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:11.466276 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1078/2146] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:57:11 2022] POST /identity/v3/projects => generated 371 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 15:57:11.470250 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f8c916-8ea8-4c1a-8212-30df4ea60a11 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:11.518130 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-bb8db390-81d0-4467-9ecf-90c308944399 None None] MFA Rules not processed for user `fa112e2dff854278aa80c428eeaaa265`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:11.520336 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-bb8db390-81d0-4467-9ecf-90c308944399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:11.573774 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f8c916-8ea8-4c1a-8212-30df4ea60a11 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:11.579536 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd71e3-13c1-4e59-adb2-e75e3825232f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:11.580172 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd71e3-13c1-4e59-adb2-e75e3825232f admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:11.580625 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd71e3-13c1-4e59-adb2-e75e3825232f admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:11.580907 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd71e3-13c1-4e59-adb2-e75e3825232f admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:11.582084 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fd71e3-13c1-4e59-adb2-e75e3825232f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:11.584568 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fd71e3-13c1-4e59-adb2-e75e3825232f admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:11.619836 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1079/2147] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:57:11 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:57:11.620940 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd71e3-13c1-4e59-adb2-e75e3825232f admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:11.635134 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd71e3-13c1-4e59-adb2-e75e3825232f admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:11.641197 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba6c78-2780-48e1-8f46-281e3b773319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:11.641834 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba6c78-2780-48e1-8f46-281e3b773319 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:11.642119 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba6c78-2780-48e1-8f46-281e3b773319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:11.642429 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba6c78-2780-48e1-8f46-281e3b773319 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:11.643088 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aba6c78-2780-48e1-8f46-281e3b773319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:11.645358 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aba6c78-2780-48e1-8f46-281e3b773319 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:11.671509 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1080/2148] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:57:11.672578 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba6c78-2780-48e1-8f46-281e3b773319 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:11.673813 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1069/2149] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 15:57:11.685415 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba6c78-2780-48e1-8f46-281e3b773319 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:11.689695 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8db390-81d0-4467-9ecf-90c308944399 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:11.691190 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-bb8db390-81d0-4467-9ecf-90c308944399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:11.693686 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1dc19b-da76-42ef-822f-1a93e978f8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:11.694349 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dc19b-da76-42ef-822f-1a93e978f8bf admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:11.694634 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dc19b-da76-42ef-822f-1a93e978f8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:11.694944 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dc19b-da76-42ef-822f-1a93e978f8bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:11.696240 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1dc19b-da76-42ef-822f-1a93e978f8bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:11.697199 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1dc19b-da76-42ef-822f-1a93e978f8bf admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:11.711390 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8db390-81d0-4467-9ecf-90c308944399 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:11.721050 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1081/2150] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:57:11.721817 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1dc19b-da76-42ef-822f-1a93e978f8bf admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:11.723943 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-5e1dc19b-da76-42ef-822f-1a93e978f8bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:11.728071 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea2157-3b28-43f3-9ce2-df1cd80fbe03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:11.728969 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea2157-3b28-43f3-9ce2-df1cd80fbe03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:11.729736 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea2157-3b28-43f3-9ce2-df1cd80fbe03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:11.729736 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea2157-3b28-43f3-9ce2-df1cd80fbe03 admin admin] PATH_INFO: `/v3/projects/f956b2ca5dfc4cec8b7d7cbd76ac0fd3` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:11.731332 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afea2157-3b28-43f3-9ce2-df1cd80fbe03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f956b2ca5dfc4cec8b7d7cbd76ac0fd3)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:11.733509 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afea2157-3b28-43f3-9ce2-df1cd80fbe03 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:11.792423 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-afea2157-3b28-43f3-9ce2-df1cd80fbe03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f956b2ca5dfc4cec8b7d7cbd76ac0fd3', 'request_id': 'req-afea2157-3b28-43f3-9ce2-df1cd80fbe03'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:11.798446 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-afea2157-3b28-43f3-9ce2-df1cd80fbe03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f956b2ca5dfc4cec8b7d7cbd76ac0fd3', 'request_id': 'req-afea2157-3b28-43f3-9ce2-df1cd80fbe03'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:11.807305 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-afea2157-3b28-43f3-9ce2-df1cd80fbe03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f956b2ca5dfc4cec8b7d7cbd76ac0fd3', 'request_id': 'req-afea2157-3b28-43f3-9ce2-df1cd80fbe03'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:11.810847 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1dc19b-da76-42ef-822f-1a93e978f8bf admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:11.810996 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:11.833492 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:11.835243 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-afea2157-3b28-43f3-9ce2-df1cd80fbe03 admin admin] The token cache is being invalidate because project f956b2ca5dfc4cec8b7d7cbd76ac0fd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:57:11.835893 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-afea2157-3b28-43f3-9ce2-df1cd80fbe03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:11.837405 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-afea2157-3b28-43f3-9ce2-df1cd80fbe03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:11.841178 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1070/2151] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:57:11 2022] DELETE /identity/v3/projects/f956b2ca5dfc4cec8b7d7cbd76ac0fd3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 15:57:11.843280 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea2157-3b28-43f3-9ce2-df1cd80fbe03 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:11.845812 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-afea2157-3b28-43f3-9ce2-df1cd80fbe03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:11.886142 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e0ae4-c1ca-4b4e-82ec-c48ca469154b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:11.887264 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e0ae4-c1ca-4b4e-82ec-c48ca469154b service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:11.887564 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e0ae4-c1ca-4b4e-82ec-c48ca469154b service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:11.887846 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e0ae4-c1ca-4b4e-82ec-c48ca469154b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:11.890452 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-d64e0ae4-c1ca-4b4e-82ec-c48ca469154b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:11.929976 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea2157-3b28-43f3-9ce2-df1cd80fbe03 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:11.935243 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd5f98-4c83-4012-835b-96deded2786d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:11.935911 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd5f98-4c83-4012-835b-96deded2786d admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:11.936222 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd5f98-4c83-4012-835b-96deded2786d admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:11.936500 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd5f98-4c83-4012-835b-96deded2786d admin admin] PATH_INFO: `/v3/projects/a010a02a23244f96813dd17ae14c06ea/users/e3c9600c9e8b458abf91a9aebdbac736/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:11.957097 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd5f98-4c83-4012-835b-96deded2786d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a010a02a23244f96813dd17ae14c06ea, user_id=e3c9600c9e8b458abf91a9aebdbac736, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:11.960237 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd5f98-4c83-4012-835b-96deded2786d admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:11.979133 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1071/2152] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:57:11 2022] PUT /identity/v3/projects/a010a02a23244f96813dd17ae14c06ea/users/e3c9600c9e8b458abf91a9aebdbac736/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:11.980575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd5f98-4c83-4012-835b-96deded2786d admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:11.982466 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-42bd5f98-4c83-4012-835b-96deded2786d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:11.989607 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e0ae4-c1ca-4b4e-82ec-c48ca469154b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:11.992415 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e0ae4-c1ca-4b4e-82ec-c48ca469154b service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:12.003511 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1082/2153] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:57:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:57:12.004660 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270dc17a-e366-4656-9d65-7b25688f6654 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:12.004948 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270dc17a-e366-4656-9d65-7b25688f6654 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:12.005239 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270dc17a-e366-4656-9d65-7b25688f6654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:12.055727 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-270dc17a-e366-4656-9d65-7b25688f6654 None None] MFA Rules not processed for user `e3c9600c9e8b458abf91a9aebdbac736`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:12.057071 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-270dc17a-e366-4656-9d65-7b25688f6654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:12.142063 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd5f98-4c83-4012-835b-96deded2786d admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:12.148633 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1083/2154] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:57:12.149688 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b54ad9-fe0b-487a-91aa-5b3c8b9d31c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:12.150529 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b54ad9-fe0b-487a-91aa-5b3c8b9d31c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:12.150814 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b54ad9-fe0b-487a-91aa-5b3c8b9d31c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:12.151088 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b54ad9-fe0b-487a-91aa-5b3c8b9d31c3 admin admin] PATH_INFO: `/v3/users/008a5d7727c740088cd419d4b8c9ba7a` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:12.153011 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b54ad9-fe0b-487a-91aa-5b3c8b9d31c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=008a5d7727c740088cd419d4b8c9ba7a)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:12.155020 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b54ad9-fe0b-487a-91aa-5b3c8b9d31c3 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:12.161007 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270dc17a-e366-4656-9d65-7b25688f6654 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:12.163714 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-270dc17a-e366-4656-9d65-7b25688f6654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:12.219523 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-f7b54ad9-fe0b-487a-91aa-5b3c8b9d31c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '008a5d7727c740088cd419d4b8c9ba7a'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:12.239194 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-f7b54ad9-fe0b-487a-91aa-5b3c8b9d31c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '008a5d7727c740088cd419d4b8c9ba7a'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:12.239925 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-f7b54ad9-fe0b-487a-91aa-5b3c8b9d31c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '008a5d7727c740088cd419d4b8c9ba7a'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:12.253509 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270dc17a-e366-4656-9d65-7b25688f6654 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:12.258412 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e54a8b-122f-4f03-969c-447d03e21da0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5753fea47f5944cd93dbea90fb9ad9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:12.259049 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e54a8b-122f-4f03-969c-447d03e21da0 service glance] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:12.259327 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e54a8b-122f-4f03-969c-447d03e21da0 service glance] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:12.259599 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e54a8b-122f-4f03-969c-447d03e21da0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:12.261888 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-52e54a8b-122f-4f03-969c-447d03e21da0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:12.268917 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-f7b54ad9-fe0b-487a-91aa-5b3c8b9d31c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '008a5d7727c740088cd419d4b8c9ba7a'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:12.271886 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-f7b54ad9-fe0b-487a-91aa-5b3c8b9d31c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '008a5d7727c740088cd419d4b8c9ba7a'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:12.275201 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e54a8b-122f-4f03-969c-447d03e21da0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:12.277148 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e54a8b-122f-4f03-969c-447d03e21da0 service glance] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:12.294516 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1084/2155] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:57:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 15:57:12.318263 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:12.335093 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1072/2156] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:57:11 2022] DELETE /identity/v3/users/008a5d7727c740088cd419d4b8c9ba7a => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:12.855481 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e54a8b-122f-4f03-969c-447d03e21da0 service glance] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:12.856930 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-52e54a8b-122f-4f03-969c-447d03e21da0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:12.868510 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:12.873759 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e54a8b-122f-4f03-969c-447d03e21da0 service glance] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:12.956333 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5a0ac-3cbf-411e-a19d-66cfadca75de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:12.957523 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5a0ac-3cbf-411e-a19d-66cfadca75de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:12.957877 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5a0ac-3cbf-411e-a19d-66cfadca75de admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:12.958252 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5a0ac-3cbf-411e-a19d-66cfadca75de admin admin] PATH_INFO: `/v3/projects/8215a0c44225453481e40049988ad506` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:12.960019 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5a0ac-3cbf-411e-a19d-66cfadca75de admin admin] RBAC: Authorizing `identity:delete_project(project_id=8215a0c44225453481e40049988ad506)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:12.962570 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5a0ac-3cbf-411e-a19d-66cfadca75de admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:13.044838 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-0fe5a0ac-3cbf-411e-a19d-66cfadca75de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8215a0c44225453481e40049988ad506', 'request_id': 'req-0fe5a0ac-3cbf-411e-a19d-66cfadca75de'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:13.051837 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-0fe5a0ac-3cbf-411e-a19d-66cfadca75de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8215a0c44225453481e40049988ad506', 'request_id': 'req-0fe5a0ac-3cbf-411e-a19d-66cfadca75de'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:13.060524 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-0fe5a0ac-3cbf-411e-a19d-66cfadca75de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8215a0c44225453481e40049988ad506', 'request_id': 'req-0fe5a0ac-3cbf-411e-a19d-66cfadca75de'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:13.099471 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-0fe5a0ac-3cbf-411e-a19d-66cfadca75de admin admin] The token cache is being invalidate because project 8215a0c44225453481e40049988ad506 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:57:13.099767 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-0fe5a0ac-3cbf-411e-a19d-66cfadca75de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:13.100454 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-0fe5a0ac-3cbf-411e-a19d-66cfadca75de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:13.113894 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1085/2157] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:57:12 2022] DELETE /identity/v3/projects/8215a0c44225453481e40049988ad506 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:16.062398 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b54ad9-fe0b-487a-91aa-5b3c8b9d31c3 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:16.064078 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-f7b54ad9-fe0b-487a-91aa-5b3c8b9d31c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:16.079031 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b54ad9-fe0b-487a-91aa-5b3c8b9d31c3 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:16.141528 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def0a7ac-1af1-421e-a4ee-fdca4bc74387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:16.142253 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0a7ac-1af1-421e-a4ee-fdca4bc74387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:16.142556 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0a7ac-1af1-421e-a4ee-fdca4bc74387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:16.142826 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0a7ac-1af1-421e-a4ee-fdca4bc74387 admin admin] PATH_INFO: `/v3/users/20ee77db82594e6da5fe36d155120edd` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:16.144000 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def0a7ac-1af1-421e-a4ee-fdca4bc74387 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20ee77db82594e6da5fe36d155120edd)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:16.145953 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def0a7ac-1af1-421e-a4ee-fdca4bc74387 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:16.193394 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-def0a7ac-1af1-421e-a4ee-fdca4bc74387 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20ee77db82594e6da5fe36d155120edd'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:16.201216 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-def0a7ac-1af1-421e-a4ee-fdca4bc74387 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20ee77db82594e6da5fe36d155120edd'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:16.201837 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-def0a7ac-1af1-421e-a4ee-fdca4bc74387 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20ee77db82594e6da5fe36d155120edd'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:16.208722 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-def0a7ac-1af1-421e-a4ee-fdca4bc74387 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20ee77db82594e6da5fe36d155120edd'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:16.209419 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-def0a7ac-1af1-421e-a4ee-fdca4bc74387 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20ee77db82594e6da5fe36d155120edd'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:16.227662 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1073/2158] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:57:16 2022] DELETE /identity/v3/users/20ee77db82594e6da5fe36d155120edd => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:16.410001 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5a0ac-3cbf-411e-a19d-66cfadca75de admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:16.411525 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-0fe5a0ac-3cbf-411e-a19d-66cfadca75de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:16.424936 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5a0ac-3cbf-411e-a19d-66cfadca75de admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:16.488879 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f7140-427e-494d-8ebc-9056d4962afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:16.489519 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f7140-427e-494d-8ebc-9056d4962afe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:16.489800 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f7140-427e-494d-8ebc-9056d4962afe admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:16.490078 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f7140-427e-494d-8ebc-9056d4962afe admin admin] PATH_INFO: `/v3/projects/a9d2782c7b0a473a90fb907a1b8aedf1` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:16.491236 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f7140-427e-494d-8ebc-9056d4962afe admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9d2782c7b0a473a90fb907a1b8aedf1)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:16.493894 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f7140-427e-494d-8ebc-9056d4962afe admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:16.535802 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:16.547362 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-157f7140-427e-494d-8ebc-9056d4962afe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9d2782c7b0a473a90fb907a1b8aedf1', 'request_id': 'req-157f7140-427e-494d-8ebc-9056d4962afe'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:16.552842 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-157f7140-427e-494d-8ebc-9056d4962afe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9d2782c7b0a473a90fb907a1b8aedf1', 'request_id': 'req-157f7140-427e-494d-8ebc-9056d4962afe'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:16.559550 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-157f7140-427e-494d-8ebc-9056d4962afe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9d2782c7b0a473a90fb907a1b8aedf1', 'request_id': 'req-157f7140-427e-494d-8ebc-9056d4962afe'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:16.571534 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-157f7140-427e-494d-8ebc-9056d4962afe admin admin] The token cache is being invalidate because project a9d2782c7b0a473a90fb907a1b8aedf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:57:16.571822 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-157f7140-427e-494d-8ebc-9056d4962afe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:16.572437 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-157f7140-427e-494d-8ebc-9056d4962afe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:16.573949 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1086/2159] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:57:16 2022] DELETE /identity/v3/projects/a9d2782c7b0a473a90fb907a1b8aedf1 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:16.579037 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf0499-2770-4d7a-8392-1cc199d353da None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:16.579325 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf0499-2770-4d7a-8392-1cc199d353da None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:16.579607 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf0499-2770-4d7a-8392-1cc199d353da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:16.599727 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-f6bf0499-2770-4d7a-8392-1cc199d353da None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:16.600850 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-f6bf0499-2770-4d7a-8392-1cc199d353da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:16.660579 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1074/2160] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:57:16.668915 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75a436-238a-4417-9592-4d2f3bc72ff5 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:16.669199 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75a436-238a-4417-9592-4d2f3bc72ff5 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:16.669477 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75a436-238a-4417-9592-4d2f3bc72ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:16.689898 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-1c75a436-238a-4417-9592-4d2f3bc72ff5 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:16.691263 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-1c75a436-238a-4417-9592-4d2f3bc72ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:16.699442 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1087/2161] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:57:16.703702 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf0499-2770-4d7a-8392-1cc199d353da None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:16.713889 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf0499-2770-4d7a-8392-1cc199d353da None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:16.719358 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fff7a9-b36a-49a3-887c-91603d030349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:16.720042 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fff7a9-b36a-49a3-887c-91603d030349 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:16.720321 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fff7a9-b36a-49a3-887c-91603d030349 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:16.720590 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fff7a9-b36a-49a3-887c-91603d030349 admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:16.721243 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fff7a9-b36a-49a3-887c-91603d030349 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:16.721546 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fff7a9-b36a-49a3-887c-91603d030349 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:16.723291 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fff7a9-b36a-49a3-887c-91603d030349 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:16.737969 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1075/2162] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 15:57:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:16.740744 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c75a436-238a-4417-9592-4d2f3bc72ff5 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:16.753152 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c75a436-238a-4417-9592-4d2f3bc72ff5 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:16.757848 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea29cf-dfab-4365-af4f-ce67859110a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:16.760086 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea29cf-dfab-4365-af4f-ce67859110a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:16.760399 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea29cf-dfab-4365-af4f-ce67859110a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:16.760668 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea29cf-dfab-4365-af4f-ce67859110a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:16.761312 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea29cf-dfab-4365-af4f-ce67859110a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:16.763275 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea29cf-dfab-4365-af4f-ce67859110a3 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:16.799832 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1088/2163] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:57:16 2022] POST /identity/v3/projects => generated 387 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 15:57:16.801099 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fff7a9-b36a-49a3-887c-91603d030349 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:16.806557 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:16.813056 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fff7a9-b36a-49a3-887c-91603d030349 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:16.904592 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d353a-5c9a-40d1-8633-ee0e33995f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:16.905348 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d353a-5c9a-40d1-8633-ee0e33995f76 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:16.905715 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d353a-5c9a-40d1-8633-ee0e33995f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:16.906082 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d353a-5c9a-40d1-8633-ee0e33995f76 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:16.906798 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d353a-5c9a-40d1-8633-ee0e33995f76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:16.909243 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d353a-5c9a-40d1-8633-ee0e33995f76 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:16.941596 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1076/2164] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:57:16 2022] POST /identity/v3/users => generated 294 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:57:16.948053 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea29cf-dfab-4365-af4f-ce67859110a3 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:16.960195 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea29cf-dfab-4365-af4f-ce67859110a3 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:16.967944 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521149f-0264-486f-9027-48fca1355d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:16.968678 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521149f-0264-486f-9027-48fca1355d8b admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:16.969035 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521149f-0264-486f-9027-48fca1355d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:16.969379 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521149f-0264-486f-9027-48fca1355d8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:16.970110 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d521149f-0264-486f-9027-48fca1355d8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:16.971869 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d521149f-0264-486f-9027-48fca1355d8b admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:16.986384 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1089/2165] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:57:16.989949 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d353a-5c9a-40d1-8633-ee0e33995f76 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:17.001055 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d353a-5c9a-40d1-8633-ee0e33995f76 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:17.006164 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ba9e0-6066-4b4b-94cb-b5fedf79631b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:17.007165 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ba9e0-6066-4b4b-94cb-b5fedf79631b admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:17.008329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ba9e0-6066-4b4b-94cb-b5fedf79631b admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:17.008777 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ba9e0-6066-4b4b-94cb-b5fedf79631b admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:17.009543 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ba9e0-6066-4b4b-94cb-b5fedf79631b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:17.011297 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ba9e0-6066-4b4b-94cb-b5fedf79631b admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:17.023877 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1077/2166] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:57:17.028293 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521149f-0264-486f-9027-48fca1355d8b admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:17.049266 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521149f-0264-486f-9027-48fca1355d8b admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:17.054409 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d879de02-9c30-4874-a903-2d5718caaff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:17.055405 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879de02-9c30-4874-a903-2d5718caaff3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:17.055754 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879de02-9c30-4874-a903-2d5718caaff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:17.056100 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879de02-9c30-4874-a903-2d5718caaff3 admin admin] PATH_INFO: `/v3/projects/30ec200de0b6435d8bf1e94fd5d1c977/users/a9236158d121445a9a53bce23616cc80/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:17.074427 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d879de02-9c30-4874-a903-2d5718caaff3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30ec200de0b6435d8bf1e94fd5d1c977, user_id=a9236158d121445a9a53bce23616cc80, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:17.078031 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d879de02-9c30-4874-a903-2d5718caaff3 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:17.097363 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1090/2167] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:57:17 2022] PUT /identity/v3/projects/30ec200de0b6435d8bf1e94fd5d1c977/users/a9236158d121445a9a53bce23616cc80/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:17.102617 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e131e46-e8af-4128-b7af-c233aed67683 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:17.103078 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e131e46-e8af-4128-b7af-c233aed67683 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:17.103165 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e131e46-e8af-4128-b7af-c233aed67683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:17.125784 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-2e131e46-e8af-4128-b7af-c233aed67683 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:17.128560 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-2e131e46-e8af-4128-b7af-c233aed67683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:17.206017 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1078/2168] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:57:17.215892 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d879de02-9c30-4874-a903-2d5718caaff3 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:17.217974 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-d879de02-9c30-4874-a903-2d5718caaff3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:17.306924 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d879de02-9c30-4874-a903-2d5718caaff3 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:17.314520 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48cd0d6-9d04-430a-8431-4d04adb8d610 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:17.315162 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cd0d6-9d04-430a-8431-4d04adb8d610 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:17.315442 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cd0d6-9d04-430a-8431-4d04adb8d610 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:17.315723 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cd0d6-9d04-430a-8431-4d04adb8d610 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:17.326873 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48cd0d6-9d04-430a-8431-4d04adb8d610 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:17.328316 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48cd0d6-9d04-430a-8431-4d04adb8d610 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:17.341781 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1091/2169] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:57:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:57:18.001474 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e131e46-e8af-4128-b7af-c233aed67683 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:18.003210 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-2e131e46-e8af-4128-b7af-c233aed67683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:18.017162 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e131e46-e8af-4128-b7af-c233aed67683 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:18.027549 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9697babf-21b5-4613-9f32-b369c172240c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:18.028352 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9697babf-21b5-4613-9f32-b369c172240c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:18.028735 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9697babf-21b5-4613-9f32-b369c172240c admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:18.029134 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9697babf-21b5-4613-9f32-b369c172240c admin admin] PATH_INFO: `/v3/users/fa112e2dff854278aa80c428eeaaa265` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:18.037599 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9697babf-21b5-4613-9f32-b369c172240c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa112e2dff854278aa80c428eeaaa265)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:18.037599 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9697babf-21b5-4613-9f32-b369c172240c admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:18.098168 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-9697babf-21b5-4613-9f32-b369c172240c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa112e2dff854278aa80c428eeaaa265'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:18.106688 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-9697babf-21b5-4613-9f32-b369c172240c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa112e2dff854278aa80c428eeaaa265'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:18.107900 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-9697babf-21b5-4613-9f32-b369c172240c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa112e2dff854278aa80c428eeaaa265'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:18.117197 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-9697babf-21b5-4613-9f32-b369c172240c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa112e2dff854278aa80c428eeaaa265'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:18.117955 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-9697babf-21b5-4613-9f32-b369c172240c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa112e2dff854278aa80c428eeaaa265'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:18.135733 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:18.149819 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1079/2170] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:57:18 2022] DELETE /identity/v3/users/fa112e2dff854278aa80c428eeaaa265 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:18.151546 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42cac3-d40a-4dde-a079-f8a966ba89c0 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:18.152030 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42cac3-d40a-4dde-a079-f8a966ba89c0 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:18.152135 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42cac3-d40a-4dde-a079-f8a966ba89c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:18.173339 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-ff42cac3-d40a-4dde-a079-f8a966ba89c0 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:18.175045 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-ff42cac3-d40a-4dde-a079-f8a966ba89c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:18.289972 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1092/2171] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:57:18.296611 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9697babf-21b5-4613-9f32-b369c172240c admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:18.298138 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-9697babf-21b5-4613-9f32-b369c172240c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:18.391988 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9697babf-21b5-4613-9f32-b369c172240c admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:18.402683 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d73e9e-6757-4043-9165-e937aa79d2ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:18.403317 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d73e9e-6757-4043-9165-e937aa79d2ee service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:18.403600 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d73e9e-6757-4043-9165-e937aa79d2ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:18.404000 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d73e9e-6757-4043-9165-e937aa79d2ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:18.414690 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d73e9e-6757-4043-9165-e937aa79d2ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:18.416136 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d73e9e-6757-4043-9165-e937aa79d2ee service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:18.432893 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1080/2172] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:57:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 15:57:18.843375 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff42cac3-d40a-4dde-a079-f8a966ba89c0 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:18.845424 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-ff42cac3-d40a-4dde-a079-f8a966ba89c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:18.860629 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:18.871784 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff42cac3-d40a-4dde-a079-f8a966ba89c0 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:18.888644 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e3b01-3aee-42a1-a4c6-a0099c9e837b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:18.889511 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e3b01-3aee-42a1-a4c6-a0099c9e837b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:18.891019 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e3b01-3aee-42a1-a4c6-a0099c9e837b admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:18.891321 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e3b01-3aee-42a1-a4c6-a0099c9e837b admin admin] PATH_INFO: `/v3/projects/de8a4b7f768b4e138e25ba449e44ca92` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:18.894557 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e3b01-3aee-42a1-a4c6-a0099c9e837b admin admin] RBAC: Authorizing `identity:delete_project(project_id=de8a4b7f768b4e138e25ba449e44ca92)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:18.896805 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e3b01-3aee-42a1-a4c6-a0099c9e837b admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:18.980674 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-224e3b01-3aee-42a1-a4c6-a0099c9e837b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de8a4b7f768b4e138e25ba449e44ca92', 'request_id': 'req-224e3b01-3aee-42a1-a4c6-a0099c9e837b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:18.988767 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-224e3b01-3aee-42a1-a4c6-a0099c9e837b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de8a4b7f768b4e138e25ba449e44ca92', 'request_id': 'req-224e3b01-3aee-42a1-a4c6-a0099c9e837b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:18.997919 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-224e3b01-3aee-42a1-a4c6-a0099c9e837b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de8a4b7f768b4e138e25ba449e44ca92', 'request_id': 'req-224e3b01-3aee-42a1-a4c6-a0099c9e837b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:19.012417 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-224e3b01-3aee-42a1-a4c6-a0099c9e837b admin admin] The token cache is being invalidate because project de8a4b7f768b4e138e25ba449e44ca92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:57:19.012722 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-224e3b01-3aee-42a1-a4c6-a0099c9e837b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:19.013654 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-224e3b01-3aee-42a1-a4c6-a0099c9e837b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:19.015603 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1093/2173] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:57:18 2022] DELETE /identity/v3/projects/de8a4b7f768b4e138e25ba449e44ca92 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:19.020739 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa508e-fb86-45ad-a28a-eea995200b0b None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:19.021017 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa508e-fb86-45ad-a28a-eea995200b0b None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:19.021294 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa508e-fb86-45ad-a28a-eea995200b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:19.071942 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-2efa508e-fb86-45ad-a28a-eea995200b0b None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:19.073345 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-2efa508e-fb86-45ad-a28a-eea995200b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:19.156398 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1081/2174] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:57:19.166948 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceab32b-ac6d-482b-8249-1f92e3f05cce None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:19.168318 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceab32b-ac6d-482b-8249-1f92e3f05cce None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:19.168779 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceab32b-ac6d-482b-8249-1f92e3f05cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:19.200026 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-bceab32b-ac6d-482b-8249-1f92e3f05cce None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:19.201536 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-bceab32b-ac6d-482b-8249-1f92e3f05cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:19.212716 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1094/2175] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:57:19.216485 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa508e-fb86-45ad-a28a-eea995200b0b None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:19.229731 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa508e-fb86-45ad-a28a-eea995200b0b None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:19.255927 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc39d3d-4dd6-4a7e-b82c-0cfed1133b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:19.256604 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc39d3d-4dd6-4a7e-b82c-0cfed1133b76 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:19.256889 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc39d3d-4dd6-4a7e-b82c-0cfed1133b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:19.257737 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc39d3d-4dd6-4a7e-b82c-0cfed1133b76 admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:19.258585 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc39d3d-4dd6-4a7e-b82c-0cfed1133b76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:19.258847 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc39d3d-4dd6-4a7e-b82c-0cfed1133b76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:19.260485 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc39d3d-4dd6-4a7e-b82c-0cfed1133b76 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:19.280141 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1082/2176] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 15:57:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:19.284919 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceab32b-ac6d-482b-8249-1f92e3f05cce None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:19.300528 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceab32b-ac6d-482b-8249-1f92e3f05cce None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:19.312461 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14f431-1346-4e3c-befc-87c08634900f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:19.313094 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14f431-1346-4e3c-befc-87c08634900f admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:19.313375 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14f431-1346-4e3c-befc-87c08634900f admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:19.313648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14f431-1346-4e3c-befc-87c08634900f admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:19.314380 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc14f431-1346-4e3c-befc-87c08634900f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:19.316530 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc14f431-1346-4e3c-befc-87c08634900f admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:19.382738 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1095/2177] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:57:19 2022] POST /identity/v3/projects => generated 371 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:57:19.387409 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc39d3d-4dd6-4a7e-b82c-0cfed1133b76 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:19.401251 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc39d3d-4dd6-4a7e-b82c-0cfed1133b76 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:19.500163 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a58b6cd-af29-41ca-8cff-8f4afd70be36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:19.500771 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58b6cd-af29-41ca-8cff-8f4afd70be36 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:19.501057 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58b6cd-af29-41ca-8cff-8f4afd70be36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:19.501343 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58b6cd-af29-41ca-8cff-8f4afd70be36 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:19.502002 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a58b6cd-af29-41ca-8cff-8f4afd70be36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:19.504074 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a58b6cd-af29-41ca-8cff-8f4afd70be36 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:19.526719 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1083/2178] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:57:19 2022] POST /identity/v3/users => generated 286 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:57:19.530991 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14f431-1346-4e3c-befc-87c08634900f admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:19.542147 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14f431-1346-4e3c-befc-87c08634900f admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:19.546952 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f24f22-f158-4706-9ca9-0155a75fef1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:19.547740 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f24f22-f158-4706-9ca9-0155a75fef1a admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:19.548021 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f24f22-f158-4706-9ca9-0155a75fef1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:19.548295 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f24f22-f158-4706-9ca9-0155a75fef1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:19.548945 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f24f22-f158-4706-9ca9-0155a75fef1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:19.550582 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f24f22-f158-4706-9ca9-0155a75fef1a admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:19.561581 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1096/2179] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:57:19.565750 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a58b6cd-af29-41ca-8cff-8f4afd70be36 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:19.578920 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a58b6cd-af29-41ca-8cff-8f4afd70be36 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:19.583726 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19371b18-a6d3-4920-94c1-bed880c59f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:19.584335 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19371b18-a6d3-4920-94c1-bed880c59f20 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:19.584617 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19371b18-a6d3-4920-94c1-bed880c59f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:19.584918 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19371b18-a6d3-4920-94c1-bed880c59f20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:19.585607 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19371b18-a6d3-4920-94c1-bed880c59f20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:19.587243 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19371b18-a6d3-4920-94c1-bed880c59f20 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:19.604767 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1084/2180] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 15:57:19.605183 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f24f22-f158-4706-9ca9-0155a75fef1a admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:19.618740 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f24f22-f158-4706-9ca9-0155a75fef1a admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:19.638931 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a505ef-6581-46a1-9f46-3ebab9b71db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:19.639777 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a505ef-6581-46a1-9f46-3ebab9b71db9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:19.640157 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a505ef-6581-46a1-9f46-3ebab9b71db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:19.640550 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a505ef-6581-46a1-9f46-3ebab9b71db9 admin admin] PATH_INFO: `/v3/projects/8f2256be5d3f4558a74c2d01cc460dd6/users/193d12aa1ed74103bfee69ca469b23b5/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:19.663196 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a505ef-6581-46a1-9f46-3ebab9b71db9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f2256be5d3f4558a74c2d01cc460dd6, user_id=193d12aa1ed74103bfee69ca469b23b5, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:19.666295 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a505ef-6581-46a1-9f46-3ebab9b71db9 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:19.704930 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1097/2181] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:57:19 2022] PUT /identity/v3/projects/8f2256be5d3f4558a74c2d01cc460dd6/users/193d12aa1ed74103bfee69ca469b23b5/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 15:57:19.706137 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034cb7f-f979-4eeb-82a5-81dedd4c55c9 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:19.706608 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034cb7f-f979-4eeb-82a5-81dedd4c55c9 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:19.707049 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034cb7f-f979-4eeb-82a5-81dedd4c55c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:19.717689 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:19.744528 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-e034cb7f-f979-4eeb-82a5-81dedd4c55c9 None None] MFA Rules not processed for user `193d12aa1ed74103bfee69ca469b23b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:19.746195 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-e034cb7f-f979-4eeb-82a5-81dedd4c55c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:19.863019 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1085/2182] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:57:19.872341 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a505ef-6581-46a1-9f46-3ebab9b71db9 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:19.876931 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-a4a505ef-6581-46a1-9f46-3ebab9b71db9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:19.974370 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a505ef-6581-46a1-9f46-3ebab9b71db9 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:19.979015 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a89607-d162-4a46-8ebd-ed74f9149a55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:19.979655 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a89607-d162-4a46-8ebd-ed74f9149a55 service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:19.979937 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a89607-d162-4a46-8ebd-ed74f9149a55 service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:19.980213 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a89607-d162-4a46-8ebd-ed74f9149a55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:19.991355 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a89607-d162-4a46-8ebd-ed74f9149a55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:19.994293 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a89607-d162-4a46-8ebd-ed74f9149a55 service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:20.013126 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1098/2183] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:57:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:57:20.053217 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034cb7f-f979-4eeb-82a5-81dedd4c55c9 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:20.157845 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034cb7f-f979-4eeb-82a5-81dedd4c55c9 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:20.164301 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf469dd-0d45-45b1-b739-92a415571b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:20.165274 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf469dd-0d45-45b1-b739-92a415571b11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:20.165563 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf469dd-0d45-45b1-b739-92a415571b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:20.165843 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf469dd-0d45-45b1-b739-92a415571b11 admin admin] PATH_INFO: `/v3/users/193d12aa1ed74103bfee69ca469b23b5` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:20.167130 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf469dd-0d45-45b1-b739-92a415571b11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=193d12aa1ed74103bfee69ca469b23b5)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:20.169550 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf469dd-0d45-45b1-b739-92a415571b11 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:20.254752 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-1bf469dd-0d45-45b1-b739-92a415571b11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '193d12aa1ed74103bfee69ca469b23b5'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:20.268248 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-1bf469dd-0d45-45b1-b739-92a415571b11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '193d12aa1ed74103bfee69ca469b23b5'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:20.269119 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-1bf469dd-0d45-45b1-b739-92a415571b11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '193d12aa1ed74103bfee69ca469b23b5'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:20.280500 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-1bf469dd-0d45-45b1-b739-92a415571b11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '193d12aa1ed74103bfee69ca469b23b5'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:20.281245 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-1bf469dd-0d45-45b1-b739-92a415571b11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '193d12aa1ed74103bfee69ca469b23b5'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:20.313423 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1086/2184] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:57:20 2022] DELETE /identity/v3/users/193d12aa1ed74103bfee69ca469b23b5 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:20.317818 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2a1db-c124-4077-ba3f-9654334b6ff8 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:20.318791 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2a1db-c124-4077-ba3f-9654334b6ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:20.319203 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2a1db-c124-4077-ba3f-9654334b6ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:20.344183 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-90e2a1db-c124-4077-ba3f-9654334b6ff8 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:20.346991 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-90e2a1db-c124-4077-ba3f-9654334b6ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:20.380757 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:20.476005 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1099/2185] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 15:57:20.485599 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf469dd-0d45-45b1-b739-92a415571b11 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:20.487672 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-1bf469dd-0d45-45b1-b739-92a415571b11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:20.519198 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:20.542493 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e2a1db-c124-4077-ba3f-9654334b6ff8 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:20.544386 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-90e2a1db-c124-4077-ba3f-9654334b6ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:20.574974 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e2a1db-c124-4077-ba3f-9654334b6ff8 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:20.591334 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054fe587-6bfb-4701-aab4-51f48a4aedf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:20.592648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054fe587-6bfb-4701-aab4-51f48a4aedf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:20.592932 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054fe587-6bfb-4701-aab4-51f48a4aedf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:20.593211 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054fe587-6bfb-4701-aab4-51f48a4aedf1 admin admin] PATH_INFO: `/v3/users/91c8d997fc834fbcb56ea40e6599881c` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:20.595580 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054fe587-6bfb-4701-aab4-51f48a4aedf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91c8d997fc834fbcb56ea40e6599881c)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:20.599229 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054fe587-6bfb-4701-aab4-51f48a4aedf1 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:20.657754 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf469dd-0d45-45b1-b739-92a415571b11 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:20.670518 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3501a-3dbe-4a5c-909f-ce865c9a3b77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:20.671490 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3501a-3dbe-4a5c-909f-ce865c9a3b77 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:20.676739 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3501a-3dbe-4a5c-909f-ce865c9a3b77 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:20.677320 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3501a-3dbe-4a5c-909f-ce865c9a3b77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:20.700174 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3501a-3dbe-4a5c-909f-ce865c9a3b77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:20.701059 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-054fe587-6bfb-4701-aab4-51f48a4aedf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91c8d997fc834fbcb56ea40e6599881c'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:20.701176 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3501a-3dbe-4a5c-909f-ce865c9a3b77 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:20.714376 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-054fe587-6bfb-4701-aab4-51f48a4aedf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91c8d997fc834fbcb56ea40e6599881c'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:20.717265 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-054fe587-6bfb-4701-aab4-51f48a4aedf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91c8d997fc834fbcb56ea40e6599881c'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:20.749588 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1087/2186] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:57:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:57:20.749912 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-054fe587-6bfb-4701-aab4-51f48a4aedf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91c8d997fc834fbcb56ea40e6599881c'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:20.749912 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-054fe587-6bfb-4701-aab4-51f48a4aedf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91c8d997fc834fbcb56ea40e6599881c'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:20.770256 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1100/2187] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:57:20 2022] DELETE /identity/v3/users/91c8d997fc834fbcb56ea40e6599881c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:20.772367 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844351ff-d868-4a41-a964-a35baca2e207 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:20.772696 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844351ff-d868-4a41-a964-a35baca2e207 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:20.772971 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844351ff-d868-4a41-a964-a35baca2e207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:20.838448 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-844351ff-d868-4a41-a964-a35baca2e207 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:20.839749 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-844351ff-d868-4a41-a964-a35baca2e207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:20.957851 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1088/2188] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:57:20.994066 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054fe587-6bfb-4701-aab4-51f48a4aedf1 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:20.997078 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-054fe587-6bfb-4701-aab4-51f48a4aedf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:21.092160 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054fe587-6bfb-4701-aab4-51f48a4aedf1 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:21.097844 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31cfcee-64c2-4d6d-b4c8-e80b5fc4273b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:21.098527 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31cfcee-64c2-4d6d-b4c8-e80b5fc4273b service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:21.098811 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31cfcee-64c2-4d6d-b4c8-e80b5fc4273b service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:21.099088 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31cfcee-64c2-4d6d-b4c8-e80b5fc4273b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:21.122969 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31cfcee-64c2-4d6d-b4c8-e80b5fc4273b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:21.124299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31cfcee-64c2-4d6d-b4c8-e80b5fc4273b service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:21.136718 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1101/2189] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:57:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:57:21.224756 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844351ff-d868-4a41-a964-a35baca2e207 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:21.226608 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-844351ff-d868-4a41-a964-a35baca2e207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:21.243262 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844351ff-d868-4a41-a964-a35baca2e207 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:21.249513 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd97bf-26a3-418c-a81a-0e167b52e731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:21.250924 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd97bf-26a3-418c-a81a-0e167b52e731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:21.251459 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd97bf-26a3-418c-a81a-0e167b52e731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:21.251915 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd97bf-26a3-418c-a81a-0e167b52e731 admin admin] PATH_INFO: `/v3/projects/8f2256be5d3f4558a74c2d01cc460dd6` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:21.256200 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd97bf-26a3-418c-a81a-0e167b52e731 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f2256be5d3f4558a74c2d01cc460dd6)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:21.259831 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd97bf-26a3-418c-a81a-0e167b52e731 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:21.347594 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-2fcd97bf-26a3-418c-a81a-0e167b52e731 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f2256be5d3f4558a74c2d01cc460dd6', 'request_id': 'req-2fcd97bf-26a3-418c-a81a-0e167b52e731'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:21.356451 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-2fcd97bf-26a3-418c-a81a-0e167b52e731 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f2256be5d3f4558a74c2d01cc460dd6', 'request_id': 'req-2fcd97bf-26a3-418c-a81a-0e167b52e731'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:21.364570 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-2fcd97bf-26a3-418c-a81a-0e167b52e731 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f2256be5d3f4558a74c2d01cc460dd6', 'request_id': 'req-2fcd97bf-26a3-418c-a81a-0e167b52e731'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:21.398322 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-2fcd97bf-26a3-418c-a81a-0e167b52e731 admin admin] The token cache is being invalidate because project 8f2256be5d3f4558a74c2d01cc460dd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:57:21.400262 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-2fcd97bf-26a3-418c-a81a-0e167b52e731 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:21.401017 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-2fcd97bf-26a3-418c-a81a-0e167b52e731 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:21.403442 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1089/2190] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:57:21 2022] DELETE /identity/v3/projects/8f2256be5d3f4558a74c2d01cc460dd6 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:21.410219 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa5ffe-75dd-402b-b42a-3fb1ad2e4a5b None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:21.410838 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa5ffe-75dd-402b-b42a-3fb1ad2e4a5b None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:21.411276 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa5ffe-75dd-402b-b42a-3fb1ad2e4a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:21.447411 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-8bfa5ffe-75dd-402b-b42a-3fb1ad2e4a5b None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:21.448662 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-8bfa5ffe-75dd-402b-b42a-3fb1ad2e4a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:21.522403 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:21.559786 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1102/2191] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 15:57:21.567774 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c99ba-0992-44b1-bb1a-789703c8948a None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:21.570777 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c99ba-0992-44b1-bb1a-789703c8948a None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:21.570777 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c99ba-0992-44b1-bb1a-789703c8948a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:21.572645 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa5ffe-75dd-402b-b42a-3fb1ad2e4a5b None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:21.574476 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-8bfa5ffe-75dd-402b-b42a-3fb1ad2e4a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:21.600249 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa5ffe-75dd-402b-b42a-3fb1ad2e4a5b None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:21.604363 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-364c99ba-0992-44b1-bb1a-789703c8948a None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:21.606336 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-364c99ba-0992-44b1-bb1a-789703c8948a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:21.608362 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bbf131-8d4b-4e6e-b1cd-d3d1ceda1617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:21.609169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bbf131-8d4b-4e6e-b1cd-d3d1ceda1617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:21.609454 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bbf131-8d4b-4e6e-b1cd-d3d1ceda1617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:21.609799 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bbf131-8d4b-4e6e-b1cd-d3d1ceda1617 admin admin] PATH_INFO: `/v3/projects/331a24450b314fb4b85610439c08200a` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:21.611842 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bbf131-8d4b-4e6e-b1cd-d3d1ceda1617 admin admin] RBAC: Authorizing `identity:delete_project(project_id=331a24450b314fb4b85610439c08200a)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:21.614262 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bbf131-8d4b-4e6e-b1cd-d3d1ceda1617 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:21.628016 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1090/2192] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:57:21.632888 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c99ba-0992-44b1-bb1a-789703c8948a None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:21.649337 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c99ba-0992-44b1-bb1a-789703c8948a None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:21.655061 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831c391-74d7-4412-830f-30f276931f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:21.655679 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831c391-74d7-4412-830f-30f276931f10 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:21.656041 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831c391-74d7-4412-830f-30f276931f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:21.656328 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831c391-74d7-4412-830f-30f276931f10 admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:21.656990 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9831c391-74d7-4412-830f-30f276931f10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:21.657293 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9831c391-74d7-4412-830f-30f276931f10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:21.658994 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9831c391-74d7-4412-830f-30f276931f10 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:21.697225 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1091/2193] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 15:57:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:21.699145 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831c391-74d7-4412-830f-30f276931f10 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:21.721917 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-48bbf131-8d4b-4e6e-b1cd-d3d1ceda1617 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '331a24450b314fb4b85610439c08200a', 'request_id': 'req-48bbf131-8d4b-4e6e-b1cd-d3d1ceda1617'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:21.725002 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831c391-74d7-4412-830f-30f276931f10 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:21.739030 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-48bbf131-8d4b-4e6e-b1cd-d3d1ceda1617 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '331a24450b314fb4b85610439c08200a', 'request_id': 'req-48bbf131-8d4b-4e6e-b1cd-d3d1ceda1617'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:21.743966 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:21.796513 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-48bbf131-8d4b-4e6e-b1cd-d3d1ceda1617 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '331a24450b314fb4b85610439c08200a', 'request_id': 'req-48bbf131-8d4b-4e6e-b1cd-d3d1ceda1617'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:21.821269 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac564ec-4939-4e8d-83ac-ec59387c0e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:21.822096 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac564ec-4939-4e8d-83ac-ec59387c0e9a admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:21.822709 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac564ec-4939-4e8d-83ac-ec59387c0e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:21.823125 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac564ec-4939-4e8d-83ac-ec59387c0e9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:21.824044 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac564ec-4939-4e8d-83ac-ec59387c0e9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:21.826602 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac564ec-4939-4e8d-83ac-ec59387c0e9a admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:21.832572 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-48bbf131-8d4b-4e6e-b1cd-d3d1ceda1617 admin admin] The token cache is being invalidate because project 331a24450b314fb4b85610439c08200a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:57:21.832893 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-48bbf131-8d4b-4e6e-b1cd-d3d1ceda1617 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:21.833666 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-48bbf131-8d4b-4e6e-b1cd-d3d1ceda1617 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:21.838016 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1103/2194] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:57:21 2022] DELETE /identity/v3/projects/331a24450b314fb4b85610439c08200a => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 15:57:21.842921 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bbf131-8d4b-4e6e-b1cd-d3d1ceda1617 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:21.848245 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-48bbf131-8d4b-4e6e-b1cd-d3d1ceda1617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:21.874364 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bbf131-8d4b-4e6e-b1cd-d3d1ceda1617 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:21.875234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1092/2195] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:57:21 2022] POST /identity/v3/projects => generated 383 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 15:57:21.877282 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac564ec-4939-4e8d-83ac-ec59387c0e9a admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:21.892563 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-aac564ec-4939-4e8d-83ac-ec59387c0e9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:21.981968 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969087c1-e095-485d-89c1-1da82d4dbed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:21.982904 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969087c1-e095-485d-89c1-1da82d4dbed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:21.983182 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969087c1-e095-485d-89c1-1da82d4dbed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:21.983454 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969087c1-e095-485d-89c1-1da82d4dbed2 admin admin] PATH_INFO: `/v3/users/cb59d662d3f34802991d7c8b95a7f1d6` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:21.984633 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969087c1-e095-485d-89c1-1da82d4dbed2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb59d662d3f34802991d7c8b95a7f1d6)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:21.986635 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969087c1-e095-485d-89c1-1da82d4dbed2 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:22.014112 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac564ec-4939-4e8d-83ac-ec59387c0e9a admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:22.021952 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f926f0-1ae1-47e7-8124-57685b8fc1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:22.023139 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f926f0-1ae1-47e7-8124-57685b8fc1d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:22.023554 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f926f0-1ae1-47e7-8124-57685b8fc1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:22.023735 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f926f0-1ae1-47e7-8124-57685b8fc1d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:22.024340 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f926f0-1ae1-47e7-8124-57685b8fc1d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:22.026508 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f926f0-1ae1-47e7-8124-57685b8fc1d9 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:22.071453 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1093/2196] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:57:21 2022] POST /identity/v3/users => generated 292 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:57:22.076056 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f926f0-1ae1-47e7-8124-57685b8fc1d9 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:22.093423 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f926f0-1ae1-47e7-8124-57685b8fc1d9 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:22.102282 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-969087c1-e095-485d-89c1-1da82d4dbed2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb59d662d3f34802991d7c8b95a7f1d6'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:22.103983 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97228e1-ce0a-4aca-b0dc-be4858fd15d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:22.104906 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97228e1-ce0a-4aca-b0dc-be4858fd15d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:22.106045 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97228e1-ce0a-4aca-b0dc-be4858fd15d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:22.106376 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97228e1-ce0a-4aca-b0dc-be4858fd15d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:22.107925 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97228e1-ce0a-4aca-b0dc-be4858fd15d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:22.112080 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97228e1-ce0a-4aca-b0dc-be4858fd15d1 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:22.120152 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-969087c1-e095-485d-89c1-1da82d4dbed2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb59d662d3f34802991d7c8b95a7f1d6'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:22.121575 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-969087c1-e095-485d-89c1-1da82d4dbed2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb59d662d3f34802991d7c8b95a7f1d6'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:22.157788 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1094/2197] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:57:22.159938 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97228e1-ce0a-4aca-b0dc-be4858fd15d1 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:22.163133 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-c97228e1-ce0a-4aca-b0dc-be4858fd15d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:22.167557 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:22.170008 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-969087c1-e095-485d-89c1-1da82d4dbed2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb59d662d3f34802991d7c8b95a7f1d6'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:22.170902 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-969087c1-e095-485d-89c1-1da82d4dbed2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb59d662d3f34802991d7c8b95a7f1d6'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:22.188361 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97228e1-ce0a-4aca-b0dc-be4858fd15d1 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:22.192311 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1104/2198] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:57:21 2022] DELETE /identity/v3/users/cb59d662d3f34802991d7c8b95a7f1d6 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:22.196207 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef5b25-97ca-4107-bebe-656d3c90dd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:22.196207 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef5b25-97ca-4107-bebe-656d3c90dd8c admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:22.196499 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef5b25-97ca-4107-bebe-656d3c90dd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:22.196745 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef5b25-97ca-4107-bebe-656d3c90dd8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:22.197491 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef5b25-97ca-4107-bebe-656d3c90dd8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:22.199069 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef5b25-97ca-4107-bebe-656d3c90dd8c admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:22.213507 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1095/2199] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:57:22.218233 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969087c1-e095-485d-89c1-1da82d4dbed2 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:22.308151 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969087c1-e095-485d-89c1-1da82d4dbed2 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:22.313382 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be2af62-a649-4e45-a0f9-1d46926edbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:22.314114 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2af62-a649-4e45-a0f9-1d46926edbbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:22.314489 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2af62-a649-4e45-a0f9-1d46926edbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:22.314835 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2af62-a649-4e45-a0f9-1d46926edbbb admin admin] PATH_INFO: `/v3/projects/dce6a67acb6e40f6a453e433494445a7/users/170cf8b1448e4a9ba9ef3350cd24f8a9/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:22.338005 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be2af62-a649-4e45-a0f9-1d46926edbbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=dce6a67acb6e40f6a453e433494445a7, user_id=170cf8b1448e4a9ba9ef3350cd24f8a9, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:22.341131 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be2af62-a649-4e45-a0f9-1d46926edbbb admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:22.364975 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1105/2200] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:57:22 2022] PUT /identity/v3/projects/dce6a67acb6e40f6a453e433494445a7/users/170cf8b1448e4a9ba9ef3350cd24f8a9/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:22.370413 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80202b7-75b1-4b88-8bb4-20e957ba5af1 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:22.370906 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80202b7-75b1-4b88-8bb4-20e957ba5af1 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:22.371289 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80202b7-75b1-4b88-8bb4-20e957ba5af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:22.403906 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-d80202b7-75b1-4b88-8bb4-20e957ba5af1 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:22.405272 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-d80202b7-75b1-4b88-8bb4-20e957ba5af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:22.486531 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1096/2201] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:57:22.494826 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be2af62-a649-4e45-a0f9-1d46926edbbb admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:22.497494 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-9be2af62-a649-4e45-a0f9-1d46926edbbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:22.583656 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be2af62-a649-4e45-a0f9-1d46926edbbb admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:22.596462 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e12e9-42b5-44b5-b4d1-0e223e400d9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:22.600022 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e12e9-42b5-44b5-b4d1-0e223e400d9d service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:22.600576 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e12e9-42b5-44b5-b4d1-0e223e400d9d service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:22.601293 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e12e9-42b5-44b5-b4d1-0e223e400d9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:22.619943 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4e12e9-42b5-44b5-b4d1-0e223e400d9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:22.624689 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4e12e9-42b5-44b5-b4d1-0e223e400d9d service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:22.639471 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1106/2202] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:57:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:57:22.813105 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80202b7-75b1-4b88-8bb4-20e957ba5af1 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:22.815207 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-d80202b7-75b1-4b88-8bb4-20e957ba5af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:22.836434 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80202b7-75b1-4b88-8bb4-20e957ba5af1 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:22.865424 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598219e4-74bc-4511-b782-a3372ddc8f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:22.866709 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598219e4-74bc-4511-b782-a3372ddc8f36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:22.867935 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598219e4-74bc-4511-b782-a3372ddc8f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:22.868294 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598219e4-74bc-4511-b782-a3372ddc8f36 admin admin] PATH_INFO: `/v3/projects/ab28cd68742d456dac9da13f7da8b6fd` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:22.869751 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598219e4-74bc-4511-b782-a3372ddc8f36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab28cd68742d456dac9da13f7da8b6fd)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:22.876449 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598219e4-74bc-4511-b782-a3372ddc8f36 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:22.887817 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:22.960025 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-598219e4-74bc-4511-b782-a3372ddc8f36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab28cd68742d456dac9da13f7da8b6fd', 'request_id': 'req-598219e4-74bc-4511-b782-a3372ddc8f36'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:22.967741 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-598219e4-74bc-4511-b782-a3372ddc8f36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab28cd68742d456dac9da13f7da8b6fd', 'request_id': 'req-598219e4-74bc-4511-b782-a3372ddc8f36'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:22.982978 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-598219e4-74bc-4511-b782-a3372ddc8f36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab28cd68742d456dac9da13f7da8b6fd', 'request_id': 'req-598219e4-74bc-4511-b782-a3372ddc8f36'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:23.002853 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-598219e4-74bc-4511-b782-a3372ddc8f36 admin admin] The token cache is being invalidate because project ab28cd68742d456dac9da13f7da8b6fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:57:23.002986 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-598219e4-74bc-4511-b782-a3372ddc8f36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:23.005919 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-598219e4-74bc-4511-b782-a3372ddc8f36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:23.010376 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1097/2203] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:57:22 2022] DELETE /identity/v3/projects/ab28cd68742d456dac9da13f7da8b6fd => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:23.024278 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe98c19-3789-4bc3-8f3f-1ecd06b2ebec None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:23.024437 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe98c19-3789-4bc3-8f3f-1ecd06b2ebec None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:23.024709 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe98c19-3789-4bc3-8f3f-1ecd06b2ebec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:23.082908 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-cbe98c19-3789-4bc3-8f3f-1ecd06b2ebec None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:23.085462 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-cbe98c19-3789-4bc3-8f3f-1ecd06b2ebec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:23.203181 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1107/2204] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:57:23.213162 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15827974-66e1-40d5-a43a-ab8df96fb40d None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:23.213723 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15827974-66e1-40d5-a43a-ab8df96fb40d None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:23.214341 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15827974-66e1-40d5-a43a-ab8df96fb40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:23.262295 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-15827974-66e1-40d5-a43a-ab8df96fb40d None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:23.263662 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-15827974-66e1-40d5-a43a-ab8df96fb40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:23.278289 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1098/2205] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:57:23.279037 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe98c19-3789-4bc3-8f3f-1ecd06b2ebec None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:23.299976 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe98c19-3789-4bc3-8f3f-1ecd06b2ebec None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:23.323013 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbad3fa-0759-4d42-8de3-2e7d7bd3542a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:23.324137 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbad3fa-0759-4d42-8de3-2e7d7bd3542a admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:23.324604 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbad3fa-0759-4d42-8de3-2e7d7bd3542a admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:23.325143 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbad3fa-0759-4d42-8de3-2e7d7bd3542a admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:23.327984 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbad3fa-0759-4d42-8de3-2e7d7bd3542a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:23.328541 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbad3fa-0759-4d42-8de3-2e7d7bd3542a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:23.331397 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbad3fa-0759-4d42-8de3-2e7d7bd3542a admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:23.342252 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:23.346913 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2011a-7c12-4c31-8b42-8530df9168b0 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:23.348132 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2011a-7c12-4c31-8b42-8530df9168b0 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:23.348571 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2011a-7c12-4c31-8b42-8530df9168b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:23.374673 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1108/2206] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 15:57:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 15:57:23.375828 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbad3fa-0759-4d42-8de3-2e7d7bd3542a admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:23.389528 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbad3fa-0759-4d42-8de3-2e7d7bd3542a admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:23.395466 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd5666-9f2e-4038-99ad-38f40e2063d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:23.396184 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd5666-9f2e-4038-99ad-38f40e2063d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:23.396389 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd5666-9f2e-4038-99ad-38f40e2063d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:23.396667 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd5666-9f2e-4038-99ad-38f40e2063d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:23.397397 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbd5666-9f2e-4038-99ad-38f40e2063d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:23.399636 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-ccf2011a-7c12-4c31-8b42-8530df9168b0 None None] MFA Rules not processed for user `a9236158d121445a9a53bce23616cc80`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:23.400118 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbd5666-9f2e-4038-99ad-38f40e2063d5 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:23.401888 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-ccf2011a-7c12-4c31-8b42-8530df9168b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:23.441825 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1109/2207] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:57:23 2022] POST /identity/v3/projects => generated 365 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:57:23.446483 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd5666-9f2e-4038-99ad-38f40e2063d5 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:23.510271 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1099/2208] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 15:57:23.517657 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2011a-7c12-4c31-8b42-8530df9168b0 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:23.519643 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-ccf2011a-7c12-4c31-8b42-8530df9168b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:23.543070 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd5666-9f2e-4038-99ad-38f40e2063d5 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:23.563149 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3a4a7-f60e-48e5-a5fe-f565d5ecc1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:23.564095 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3a4a7-f60e-48e5-a5fe-f565d5ecc1f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:23.564095 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3a4a7-f60e-48e5-a5fe-f565d5ecc1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:23.564378 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3a4a7-f60e-48e5-a5fe-f565d5ecc1f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:23.565019 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3a4a7-f60e-48e5-a5fe-f565d5ecc1f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:23.567384 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3a4a7-f60e-48e5-a5fe-f565d5ecc1f9 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:23.622589 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1110/2209] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:57:23 2022] POST /identity/v3/users => generated 283 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:57:23.623881 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3a4a7-f60e-48e5-a5fe-f565d5ecc1f9 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:23.640076 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3a4a7-f60e-48e5-a5fe-f565d5ecc1f9 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:23.664851 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b9361-3781-4dc1-9897-331fff0492ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:23.666328 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b9361-3781-4dc1-9897-331fff0492ab admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:23.666752 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b9361-3781-4dc1-9897-331fff0492ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:23.667126 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b9361-3781-4dc1-9897-331fff0492ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:23.667946 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b9361-3781-4dc1-9897-331fff0492ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:23.669678 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b9361-3781-4dc1-9897-331fff0492ab admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:23.685724 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1111/2210] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:57:23.689969 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b9361-3781-4dc1-9897-331fff0492ab admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:23.708615 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b9361-3781-4dc1-9897-331fff0492ab admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:23.750624 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2011a-7c12-4c31-8b42-8530df9168b0 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:23.753761 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ee0fb-a91b-4dee-9eec-ab4a646dfadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:23.754612 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ee0fb-a91b-4dee-9eec-ab4a646dfadc admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:23.754995 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ee0fb-a91b-4dee-9eec-ab4a646dfadc admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:23.755392 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ee0fb-a91b-4dee-9eec-ab4a646dfadc admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:23.756150 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ee0fb-a91b-4dee-9eec-ab4a646dfadc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:23.758093 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ee0fb-a91b-4dee-9eec-ab4a646dfadc admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:23.770229 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:23.778248 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1112/2211] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:57:23.782602 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ee0fb-a91b-4dee-9eec-ab4a646dfadc admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:23.794354 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ee0fb-a91b-4dee-9eec-ab4a646dfadc admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:23.801693 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1490131e-61e1-4bde-8c0c-5cc5bc5cd084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:23.802758 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490131e-61e1-4bde-8c0c-5cc5bc5cd084 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:23.803230 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490131e-61e1-4bde-8c0c-5cc5bc5cd084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:23.803620 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490131e-61e1-4bde-8c0c-5cc5bc5cd084 admin admin] PATH_INFO: `/v3/projects/7611a6b6740c4ef5a844dd36752435ab/users/11655cd09f004a34b5682455ed25eae3/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:23.821933 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1490131e-61e1-4bde-8c0c-5cc5bc5cd084 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7611a6b6740c4ef5a844dd36752435ab, user_id=11655cd09f004a34b5682455ed25eae3, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:23.825667 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1490131e-61e1-4bde-8c0c-5cc5bc5cd084 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:23.859807 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1113/2212] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:57:23 2022] PUT /identity/v3/projects/7611a6b6740c4ef5a844dd36752435ab/users/11655cd09f004a34b5682455ed25eae3/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 15:57:23.871696 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf693f89-1111-47a7-b354-fb95224a95f9 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:23.871986 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf693f89-1111-47a7-b354-fb95224a95f9 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:23.872267 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf693f89-1111-47a7-b354-fb95224a95f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:23.885318 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d16db7-b97e-4199-b5c1-6754aaea1180 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:23.887057 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d16db7-b97e-4199-b5c1-6754aaea1180 service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:23.887342 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d16db7-b97e-4199-b5c1-6754aaea1180 service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:23.887811 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d16db7-b97e-4199-b5c1-6754aaea1180 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:23.906347 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-bf693f89-1111-47a7-b354-fb95224a95f9 None None] MFA Rules not processed for user `11655cd09f004a34b5682455ed25eae3`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:23.907705 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-bf693f89-1111-47a7-b354-fb95224a95f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:23.974224 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d16db7-b97e-4199-b5c1-6754aaea1180 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:23.979080 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d16db7-b97e-4199-b5c1-6754aaea1180 service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:23.996303 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1100/2213] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:57:23 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 15:57:24.065294 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1114/2214] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:57:24.071188 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d16db7-b97e-4199-b5c1-6754aaea1180 service nova] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:24.118595 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d16db7-b97e-4199-b5c1-6754aaea1180 service nova] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:24.211321 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a677e-6c87-49e8-99c3-d9dabc85f2fd None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:24.211584 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a677e-6c87-49e8-99c3-d9dabc85f2fd None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:24.212048 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a677e-6c87-49e8-99c3-d9dabc85f2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:24.251718 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:24.277039 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f332ca0-7225-4881-b44d-9ac8555356d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:24.277359 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-a51a677e-6c87-49e8-99c3-d9dabc85f2fd None None] MFA Rules not processed for user `170cf8b1448e4a9ba9ef3350cd24f8a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:24.277821 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f332ca0-7225-4881-b44d-9ac8555356d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:24.278272 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f332ca0-7225-4881-b44d-9ac8555356d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:24.278653 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f332ca0-7225-4881-b44d-9ac8555356d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:24.279126 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-a51a677e-6c87-49e8-99c3-d9dabc85f2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:24.280039 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f332ca0-7225-4881-b44d-9ac8555356d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:24.282076 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f332ca0-7225-4881-b44d-9ac8555356d6 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:24.333062 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1101/2215] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:57:24 2022] POST /identity/v3/projects => generated 365 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:57:24.334128 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f332ca0-7225-4881-b44d-9ac8555356d6 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:24.421314 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1115/2216] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 15:57:24.429149 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:24.432287 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a677e-6c87-49e8-99c3-d9dabc85f2fd None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:24.434061 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-a51a677e-6c87-49e8-99c3-d9dabc85f2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:24.466454 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f332ca0-7225-4881-b44d-9ac8555356d6 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:24.473440 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35411839-4710-42a9-a3c6-f8a179724a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:24.474240 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35411839-4710-42a9-a3c6-f8a179724a54 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:24.474682 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35411839-4710-42a9-a3c6-f8a179724a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:24.475462 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35411839-4710-42a9-a3c6-f8a179724a54 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:24.475835 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35411839-4710-42a9-a3c6-f8a179724a54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:24.478134 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35411839-4710-42a9-a3c6-f8a179724a54 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:24.510763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1102/2217] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:57:24 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:57:24.515451 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35411839-4710-42a9-a3c6-f8a179724a54 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:24.517767 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a677e-6c87-49e8-99c3-d9dabc85f2fd None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:24.528571 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35411839-4710-42a9-a3c6-f8a179724a54 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:24.535241 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a8cb36-a96f-4ab4-91a0-0e926e1c7a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:24.536298 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8cb36-a96f-4ab4-91a0-0e926e1c7a19 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:24.536753 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8cb36-a96f-4ab4-91a0-0e926e1c7a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:24.536875 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8cb36-a96f-4ab4-91a0-0e926e1c7a19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:24.537486 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a8cb36-a96f-4ab4-91a0-0e926e1c7a19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:24.540188 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a8cb36-a96f-4ab4-91a0-0e926e1c7a19 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:24.556683 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1103/2218] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:57:24.561129 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a8cb36-a96f-4ab4-91a0-0e926e1c7a19 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:24.579050 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a8cb36-a96f-4ab4-91a0-0e926e1c7a19 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:24.585831 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec88cf4-45f6-4168-89ee-2779ecdbd196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:24.586840 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec88cf4-45f6-4168-89ee-2779ecdbd196 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:24.587131 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec88cf4-45f6-4168-89ee-2779ecdbd196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:24.587408 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec88cf4-45f6-4168-89ee-2779ecdbd196 admin admin] PATH_INFO: `/v3/projects/a71bf87b4cdb4546bdec39c5319717fa/users/f026071f6e7e44d0a0fa0e85be260337/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:24.594009 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65104ab9-890a-44cf-8360-2b34c6ec0376 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:24.594685 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65104ab9-890a-44cf-8360-2b34c6ec0376 service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:24.595094 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65104ab9-890a-44cf-8360-2b34c6ec0376 service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:24.595386 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65104ab9-890a-44cf-8360-2b34c6ec0376 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:24.606271 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec88cf4-45f6-4168-89ee-2779ecdbd196 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a71bf87b4cdb4546bdec39c5319717fa, user_id=f026071f6e7e44d0a0fa0e85be260337, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:24.610084 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec88cf4-45f6-4168-89ee-2779ecdbd196 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:24.627363 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1104/2219] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:57:24 2022] PUT /identity/v3/projects/a71bf87b4cdb4546bdec39c5319717fa/users/f026071f6e7e44d0a0fa0e85be260337/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:24.631522 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec88cf4-45f6-4168-89ee-2779ecdbd196 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:24.668583 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65104ab9-890a-44cf-8360-2b34c6ec0376 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:24.671148 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65104ab9-890a-44cf-8360-2b34c6ec0376 service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:24.689155 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1116/2220] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:57:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:57:24.715817 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec88cf4-45f6-4168-89ee-2779ecdbd196 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:24.720715 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd40464-1fda-40fd-8537-130cc00fd0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:24.721324 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd40464-1fda-40fd-8537-130cc00fd0a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:24.721601 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd40464-1fda-40fd-8537-130cc00fd0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:24.722634 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd40464-1fda-40fd-8537-130cc00fd0a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:24.722746 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd40464-1fda-40fd-8537-130cc00fd0a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:24.724701 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd40464-1fda-40fd-8537-130cc00fd0a3 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:24.738229 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1105/2221] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 15:57:24.744671 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65104ab9-890a-44cf-8360-2b34c6ec0376 service cinder] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:24.763714 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65104ab9-890a-44cf-8360-2b34c6ec0376 service cinder] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:24.770886 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b341f93-5303-4aff-a18f-1d339435421e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:24.771570 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b341f93-5303-4aff-a18f-1d339435421e admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:24.771979 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b341f93-5303-4aff-a18f-1d339435421e admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:24.772112 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b341f93-5303-4aff-a18f-1d339435421e admin admin] PATH_INFO: `/v3/projects/a71bf87b4cdb4546bdec39c5319717fa/users/f026071f6e7e44d0a0fa0e85be260337/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:24.775006 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b341f93-5303-4aff-a18f-1d339435421e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a71bf87b4cdb4546bdec39c5319717fa, user_id=f026071f6e7e44d0a0fa0e85be260337, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:24.777836 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b341f93-5303-4aff-a18f-1d339435421e admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:24.787086 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:24.797205 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1117/2222] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:57:24 2022] PUT /identity/v3/projects/a71bf87b4cdb4546bdec39c5319717fa/users/f026071f6e7e44d0a0fa0e85be260337/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:24.809316 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8863a39-675c-4bd2-b437-6703f28b1659 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:24.809631 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8863a39-675c-4bd2-b437-6703f28b1659 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:24.810386 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8863a39-675c-4bd2-b437-6703f28b1659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:24.865212 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-c8863a39-675c-4bd2-b437-6703f28b1659 None None] MFA Rules not processed for user `f026071f6e7e44d0a0fa0e85be260337`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:24.867250 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-c8863a39-675c-4bd2-b437-6703f28b1659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:24.986393 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1106/2223] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:24 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:57:24.998319 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b341f93-5303-4aff-a18f-1d339435421e admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:25.000053 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-0b341f93-5303-4aff-a18f-1d339435421e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:25.116240 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b341f93-5303-4aff-a18f-1d339435421e admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:25.121243 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f603ef4-e573-45f0-83bc-1de2f5c400c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:25.121860 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f603ef4-e573-45f0-83bc-1de2f5c400c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:25.122122 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f603ef4-e573-45f0-83bc-1de2f5c400c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:25.122493 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f603ef4-e573-45f0-83bc-1de2f5c400c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:25.136896 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f603ef4-e573-45f0-83bc-1de2f5c400c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:25.138169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f603ef4-e573-45f0-83bc-1de2f5c400c8 service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:25.175171 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1118/2224] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:57:24 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:57:25.287079 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8863a39-675c-4bd2-b437-6703f28b1659 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:25.304208 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8863a39-675c-4bd2-b437-6703f28b1659 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:25.311709 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37331ab-59a5-4199-9aba-66538c0982af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:25.312771 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37331ab-59a5-4199-9aba-66538c0982af service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:25.313163 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37331ab-59a5-4199-9aba-66538c0982af service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:25.313609 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37331ab-59a5-4199-9aba-66538c0982af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:25.327751 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:25.405658 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37331ab-59a5-4199-9aba-66538c0982af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:25.409758 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37331ab-59a5-4199-9aba-66538c0982af service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:25.452286 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1107/2225] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:57:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:57:25.986356 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fa564-d854-4799-a951-2073fc98374f None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:25.987745 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fa564-d854-4799-a951-2073fc98374f None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:25.988187 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fa564-d854-4799-a951-2073fc98374f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:26.009323 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-b64fa564-d854-4799-a951-2073fc98374f None None] MFA Rules not processed for user `a9236158d121445a9a53bce23616cc80`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:26.010655 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-b64fa564-d854-4799-a951-2073fc98374f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:26.095732 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1119/2226] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:57:26.296358 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f566c-be41-4bdd-9fae-686e54fabf9b None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:26.296899 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f566c-be41-4bdd-9fae-686e54fabf9b None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:26.297204 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f566c-be41-4bdd-9fae-686e54fabf9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:26.318495 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-0a9f566c-be41-4bdd-9fae-686e54fabf9b None None] MFA Rules not processed for user `170cf8b1448e4a9ba9ef3350cd24f8a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:26.320546 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-0a9f566c-be41-4bdd-9fae-686e54fabf9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:26.402365 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1108/2227] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:57:28.722960 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64fa564-d854-4799-a951-2073fc98374f None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:28.865744 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64fa564-d854-4799-a951-2073fc98374f None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:28.875744 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8086271-69fc-4cfa-92a7-6d72da37fd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:28.876428 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8086271-69fc-4cfa-92a7-6d72da37fd0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:28.876727 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8086271-69fc-4cfa-92a7-6d72da37fd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:28.877003 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8086271-69fc-4cfa-92a7-6d72da37fd0a admin admin] PATH_INFO: `/v3/users/11655cd09f004a34b5682455ed25eae3` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:28.878485 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8086271-69fc-4cfa-92a7-6d72da37fd0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=11655cd09f004a34b5682455ed25eae3)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:28.880497 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8086271-69fc-4cfa-92a7-6d72da37fd0a admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:28.945802 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:28.947468 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-c8086271-69fc-4cfa-92a7-6d72da37fd0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11655cd09f004a34b5682455ed25eae3'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:28.962602 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-c8086271-69fc-4cfa-92a7-6d72da37fd0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11655cd09f004a34b5682455ed25eae3'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:28.963318 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-c8086271-69fc-4cfa-92a7-6d72da37fd0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11655cd09f004a34b5682455ed25eae3'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:28.976854 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-c8086271-69fc-4cfa-92a7-6d72da37fd0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11655cd09f004a34b5682455ed25eae3'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:28.977504 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-c8086271-69fc-4cfa-92a7-6d72da37fd0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11655cd09f004a34b5682455ed25eae3'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:28.989662 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1120/2228] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:57:28 2022] DELETE /identity/v3/users/11655cd09f004a34b5682455ed25eae3 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 15:57:28.994455 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8a318-7e3c-4234-968f-0d7ee93cc15f None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:28.994946 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8a318-7e3c-4234-968f-0d7ee93cc15f None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:28.995040 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8a318-7e3c-4234-968f-0d7ee93cc15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:29.015351 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-d8e8a318-7e3c-4234-968f-0d7ee93cc15f None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:29.016545 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-d8e8a318-7e3c-4234-968f-0d7ee93cc15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:29.092952 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1109/2229] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:57:29.102707 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8086271-69fc-4cfa-92a7-6d72da37fd0a admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:29.104127 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-c8086271-69fc-4cfa-92a7-6d72da37fd0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:29.162650 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8086271-69fc-4cfa-92a7-6d72da37fd0a admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:29.166405 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea6aaf8-7dec-447f-bc87-c5b2bd59b41c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:29.167011 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6aaf8-7dec-447f-bc87-c5b2bd59b41c service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:29.167291 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6aaf8-7dec-447f-bc87-c5b2bd59b41c service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:29.167562 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6aaf8-7dec-447f-bc87-c5b2bd59b41c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:29.176939 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea6aaf8-7dec-447f-bc87-c5b2bd59b41c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:29.178390 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea6aaf8-7dec-447f-bc87-c5b2bd59b41c service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:29.187817 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1121/2230] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:57:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:57:29.602076 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8a318-7e3c-4234-968f-0d7ee93cc15f None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:29.604477 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-d8e8a318-7e3c-4234-968f-0d7ee93cc15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:29.631873 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8a318-7e3c-4234-968f-0d7ee93cc15f None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:29.641761 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630b6728-307d-44a1-a137-576c09668eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:29.642760 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b6728-307d-44a1-a137-576c09668eb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:29.643246 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b6728-307d-44a1-a137-576c09668eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:29.643904 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b6728-307d-44a1-a137-576c09668eb6 admin admin] PATH_INFO: `/v3/projects/7611a6b6740c4ef5a844dd36752435ab` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:29.645235 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630b6728-307d-44a1-a137-576c09668eb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7611a6b6740c4ef5a844dd36752435ab)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:29.648224 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630b6728-307d-44a1-a137-576c09668eb6 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:29.744064 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-630b6728-307d-44a1-a137-576c09668eb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7611a6b6740c4ef5a844dd36752435ab', 'request_id': 'req-630b6728-307d-44a1-a137-576c09668eb6'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:29.746636 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:29.751551 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-630b6728-307d-44a1-a137-576c09668eb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7611a6b6740c4ef5a844dd36752435ab', 'request_id': 'req-630b6728-307d-44a1-a137-576c09668eb6'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:29.780379 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-630b6728-307d-44a1-a137-576c09668eb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7611a6b6740c4ef5a844dd36752435ab', 'request_id': 'req-630b6728-307d-44a1-a137-576c09668eb6'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:29.818415 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-630b6728-307d-44a1-a137-576c09668eb6 admin admin] The token cache is being invalidate because project 7611a6b6740c4ef5a844dd36752435ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:57:29.818848 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-630b6728-307d-44a1-a137-576c09668eb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:29.819848 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-630b6728-307d-44a1-a137-576c09668eb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:29.821711 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1110/2231] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:57:29 2022] DELETE /identity/v3/projects/7611a6b6740c4ef5a844dd36752435ab => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:29.825981 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea6aaf8-7dec-447f-bc87-c5b2bd59b41c service neutron] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:29.838435 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea6aaf8-7dec-447f-bc87-c5b2bd59b41c service neutron] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:29.922659 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db8a6b-8e6a-41b2-a870-bad7e6dbcc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:29.924865 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db8a6b-8e6a-41b2-a870-bad7e6dbcc68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:29.925145 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db8a6b-8e6a-41b2-a870-bad7e6dbcc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:29.925758 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db8a6b-8e6a-41b2-a870-bad7e6dbcc68 admin admin] PATH_INFO: `/v3/users/f026071f6e7e44d0a0fa0e85be260337` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:29.927085 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db8a6b-8e6a-41b2-a870-bad7e6dbcc68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f026071f6e7e44d0a0fa0e85be260337)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:29.933364 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db8a6b-8e6a-41b2-a870-bad7e6dbcc68 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:30.056096 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-c2db8a6b-8e6a-41b2-a870-bad7e6dbcc68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f026071f6e7e44d0a0fa0e85be260337'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:30.070779 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-c2db8a6b-8e6a-41b2-a870-bad7e6dbcc68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f026071f6e7e44d0a0fa0e85be260337'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:30.071534 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-c2db8a6b-8e6a-41b2-a870-bad7e6dbcc68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f026071f6e7e44d0a0fa0e85be260337'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:30.087671 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:30.091265 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-c2db8a6b-8e6a-41b2-a870-bad7e6dbcc68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f026071f6e7e44d0a0fa0e85be260337'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:30.092986 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-c2db8a6b-8e6a-41b2-a870-bad7e6dbcc68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f026071f6e7e44d0a0fa0e85be260337'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:30.110575 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1122/2232] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:57:29 2022] DELETE /identity/v3/users/f026071f6e7e44d0a0fa0e85be260337 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:30.768140 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630b6728-307d-44a1-a137-576c09668eb6 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:30.769873 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-630b6728-307d-44a1-a137-576c09668eb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:30.788155 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630b6728-307d-44a1-a137-576c09668eb6 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:30.864744 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01eaf04-93f5-457c-b347-bb2b7eea7090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:30.865387 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01eaf04-93f5-457c-b347-bb2b7eea7090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:30.865665 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01eaf04-93f5-457c-b347-bb2b7eea7090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:30.865936 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01eaf04-93f5-457c-b347-bb2b7eea7090 admin admin] PATH_INFO: `/v3/projects/a71bf87b4cdb4546bdec39c5319717fa` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:30.867509 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01eaf04-93f5-457c-b347-bb2b7eea7090 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a71bf87b4cdb4546bdec39c5319717fa)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:30.869794 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01eaf04-93f5-457c-b347-bb2b7eea7090 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:30.920524 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b01eaf04-93f5-457c-b347-bb2b7eea7090 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a71bf87b4cdb4546bdec39c5319717fa', 'request_id': 'req-b01eaf04-93f5-457c-b347-bb2b7eea7090'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:30.925912 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b01eaf04-93f5-457c-b347-bb2b7eea7090 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a71bf87b4cdb4546bdec39c5319717fa', 'request_id': 'req-b01eaf04-93f5-457c-b347-bb2b7eea7090'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:30.933110 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b01eaf04-93f5-457c-b347-bb2b7eea7090 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a71bf87b4cdb4546bdec39c5319717fa', 'request_id': 'req-b01eaf04-93f5-457c-b347-bb2b7eea7090'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:30.948198 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b01eaf04-93f5-457c-b347-bb2b7eea7090 admin admin] The token cache is being invalidate because project a71bf87b4cdb4546bdec39c5319717fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:57:30.948487 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b01eaf04-93f5-457c-b347-bb2b7eea7090 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:30.949112 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b01eaf04-93f5-457c-b347-bb2b7eea7090 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:30.950636 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1111/2233] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:57:30 2022] DELETE /identity/v3/projects/a71bf87b4cdb4546bdec39c5319717fa => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:30.955650 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec894e-1b8e-44ce-800a-727519791057 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:30.956129 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec894e-1b8e-44ce-800a-727519791057 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:30.956223 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec894e-1b8e-44ce-800a-727519791057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:30.976159 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-5dec894e-1b8e-44ce-800a-727519791057 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:30.977623 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-5dec894e-1b8e-44ce-800a-727519791057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:31.042402 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1123/2234] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:57:31.050318 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f4483-5ab8-4dd6-820b-74402562e883 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:31.050606 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f4483-5ab8-4dd6-820b-74402562e883 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:31.050883 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f4483-5ab8-4dd6-820b-74402562e883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:31.072181 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-c11f4483-5ab8-4dd6-820b-74402562e883 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:31.073392 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-c11f4483-5ab8-4dd6-820b-74402562e883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:31.081865 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1112/2235] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:57:31.086657 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec894e-1b8e-44ce-800a-727519791057 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:31.096204 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec894e-1b8e-44ce-800a-727519791057 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:31.101509 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c2f8fa-39a6-4180-8eef-bcf565ab2b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:31.102162 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2f8fa-39a6-4180-8eef-bcf565ab2b10 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:31.102474 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2f8fa-39a6-4180-8eef-bcf565ab2b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:31.102780 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2f8fa-39a6-4180-8eef-bcf565ab2b10 admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:31.103427 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c2f8fa-39a6-4180-8eef-bcf565ab2b10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:31.103728 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c2f8fa-39a6-4180-8eef-bcf565ab2b10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:31.105309 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c2f8fa-39a6-4180-8eef-bcf565ab2b10 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:31.119800 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1124/2236] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 15:57:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:31.124320 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f4483-5ab8-4dd6-820b-74402562e883 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:31.134670 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f4483-5ab8-4dd6-820b-74402562e883 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:31.139328 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6454a88c-450c-4ade-a3d9-c05fc3c4bf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:31.139930 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454a88c-450c-4ade-a3d9-c05fc3c4bf3f admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:31.140209 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454a88c-450c-4ade-a3d9-c05fc3c4bf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:31.140480 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454a88c-450c-4ade-a3d9-c05fc3c4bf3f admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:31.141104 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6454a88c-450c-4ade-a3d9-c05fc3c4bf3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:31.143027 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6454a88c-450c-4ade-a3d9-c05fc3c4bf3f admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:31.173008 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1113/2237] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:57:31 2022] POST /identity/v3/projects => generated 407 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 15:57:31.177748 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c2f8fa-39a6-4180-8eef-bcf565ab2b10 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:31.188139 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c2f8fa-39a6-4180-8eef-bcf565ab2b10 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:31.249637 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ff60f-4ea1-46aa-8b0f-e3031d8fc7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:31.250285 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ff60f-4ea1-46aa-8b0f-e3031d8fc7f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:31.250572 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ff60f-4ea1-46aa-8b0f-e3031d8fc7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:31.250839 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ff60f-4ea1-46aa-8b0f-e3031d8fc7f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:31.251460 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44ff60f-4ea1-46aa-8b0f-e3031d8fc7f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:31.253466 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44ff60f-4ea1-46aa-8b0f-e3031d8fc7f4 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:31.276102 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1125/2238] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:57:31 2022] POST /identity/v3/users => generated 304 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 15:57:31.280426 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6454a88c-450c-4ade-a3d9-c05fc3c4bf3f admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:31.290588 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6454a88c-450c-4ade-a3d9-c05fc3c4bf3f admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:31.295153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb24154-ab72-4f9d-9128-afd7072dba03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:31.295689 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb24154-ab72-4f9d-9128-afd7072dba03 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:31.295964 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb24154-ab72-4f9d-9128-afd7072dba03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:31.296236 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb24154-ab72-4f9d-9128-afd7072dba03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:31.296871 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb24154-ab72-4f9d-9128-afd7072dba03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:31.298488 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb24154-ab72-4f9d-9128-afd7072dba03 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:31.309817 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1114/2239] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:57:31.314166 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ff60f-4ea1-46aa-8b0f-e3031d8fc7f4 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:31.327208 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ff60f-4ea1-46aa-8b0f-e3031d8fc7f4 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:31.331824 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d2c5d-5463-4fcf-bde9-3246295e9dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:31.332474 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d2c5d-5463-4fcf-bde9-3246295e9dd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:31.332755 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d2c5d-5463-4fcf-bde9-3246295e9dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:31.333029 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d2c5d-5463-4fcf-bde9-3246295e9dd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:31.333975 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799d2c5d-5463-4fcf-bde9-3246295e9dd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:31.336373 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799d2c5d-5463-4fcf-bde9-3246295e9dd5 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:31.349323 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1126/2240] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 15:57:31.354244 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb24154-ab72-4f9d-9128-afd7072dba03 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:31.366503 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb24154-ab72-4f9d-9128-afd7072dba03 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:31.372429 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed73d4f-82f8-4189-ab2b-11563ced45b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:31.373180 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed73d4f-82f8-4189-ab2b-11563ced45b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:31.373631 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed73d4f-82f8-4189-ab2b-11563ced45b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:31.374001 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed73d4f-82f8-4189-ab2b-11563ced45b2 admin admin] PATH_INFO: `/v3/projects/fc0022986a8042338c955be3831b0cf7/users/880a3b8c0dfc427a9ce2e67a3d43356a/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:31.396333 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed73d4f-82f8-4189-ab2b-11563ced45b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc0022986a8042338c955be3831b0cf7, user_id=880a3b8c0dfc427a9ce2e67a3d43356a, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:31.399963 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed73d4f-82f8-4189-ab2b-11563ced45b2 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:31.414737 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1115/2241] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:57:31 2022] PUT /identity/v3/projects/fc0022986a8042338c955be3831b0cf7/users/880a3b8c0dfc427a9ce2e67a3d43356a/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 15:57:31.425317 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45c05d-91ae-4d62-a3b3-7846637ac832 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:31.425685 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45c05d-91ae-4d62-a3b3-7846637ac832 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:31.425980 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45c05d-91ae-4d62-a3b3-7846637ac832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:31.462472 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-ed45c05d-91ae-4d62-a3b3-7846637ac832 None None] MFA Rules not processed for user `880a3b8c0dfc427a9ce2e67a3d43356a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:31.463854 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-ed45c05d-91ae-4d62-a3b3-7846637ac832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:31.528662 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:31.561165 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1127/2242] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:31 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:57:31.565841 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed73d4f-82f8-4189-ab2b-11563ced45b2 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:31.577341 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:31.655300 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed73d4f-82f8-4189-ab2b-11563ced45b2 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:31.660882 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37f2e6-0ce2-489c-9cc7-1b26f133a8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:31.661505 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37f2e6-0ce2-489c-9cc7-1b26f133a8a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:31.661815 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37f2e6-0ce2-489c-9cc7-1b26f133a8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:31.662156 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37f2e6-0ce2-489c-9cc7-1b26f133a8a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:31.662946 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37f2e6-0ce2-489c-9cc7-1b26f133a8a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:31.665837 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37f2e6-0ce2-489c-9cc7-1b26f133a8a5 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:31.713145 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1116/2243] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:57:31 2022] POST /identity/v3/projects => generated 409 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:57:31.714633 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed45c05d-91ae-4d62-a3b3-7846637ac832 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:31.726348 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed45c05d-91ae-4d62-a3b3-7846637ac832 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:31.798722 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf363c61-34b8-4c44-b259-b80362ef964c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:31.799495 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf363c61-34b8-4c44-b259-b80362ef964c admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:31.799789 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf363c61-34b8-4c44-b259-b80362ef964c admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:31.800063 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf363c61-34b8-4c44-b259-b80362ef964c admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:31.800690 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf363c61-34b8-4c44-b259-b80362ef964c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:31.803095 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf363c61-34b8-4c44-b259-b80362ef964c admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:31.831485 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1128/2244] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:57:31 2022] POST /identity/v3/users => generated 311 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:57:31.839730 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37f2e6-0ce2-489c-9cc7-1b26f133a8a5 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:31.853452 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37f2e6-0ce2-489c-9cc7-1b26f133a8a5 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:31.858995 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d86e50-d367-463d-8eca-bbd5190258c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:31.859867 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d86e50-d367-463d-8eca-bbd5190258c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:31.860156 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d86e50-d367-463d-8eca-bbd5190258c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:31.860437 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d86e50-d367-463d-8eca-bbd5190258c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:31.861399 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d86e50-d367-463d-8eca-bbd5190258c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:31.863265 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d86e50-d367-463d-8eca-bbd5190258c9 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:31.878448 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1117/2245] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:57:31.880518 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf363c61-34b8-4c44-b259-b80362ef964c admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:31.892470 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf363c61-34b8-4c44-b259-b80362ef964c admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:31.897806 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24df68-1bde-4e07-972e-253f04d4b995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:31.898915 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24df68-1bde-4e07-972e-253f04d4b995 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:31.899278 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24df68-1bde-4e07-972e-253f04d4b995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:31.899627 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24df68-1bde-4e07-972e-253f04d4b995 admin admin] PATH_INFO: `/v3/projects/649640d1629d4d74b059fa0e9c2be271/users/ab70bafc60844498afc2f1343472d095/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:31.919424 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed24df68-1bde-4e07-972e-253f04d4b995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=649640d1629d4d74b059fa0e9c2be271, user_id=ab70bafc60844498afc2f1343472d095, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:31.921786 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed24df68-1bde-4e07-972e-253f04d4b995 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:31.940480 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1129/2246] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:57:31 2022] PUT /identity/v3/projects/649640d1629d4d74b059fa0e9c2be271/users/ab70bafc60844498afc2f1343472d095/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 15:57:31.944993 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d86e50-d367-463d-8eca-bbd5190258c9 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:31.956434 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d86e50-d367-463d-8eca-bbd5190258c9 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:32.024650 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2604429-1d85-40ef-9f11-2a6684ea6259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:32.025375 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2604429-1d85-40ef-9f11-2a6684ea6259 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:32.025735 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2604429-1d85-40ef-9f11-2a6684ea6259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:32.026081 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2604429-1d85-40ef-9f11-2a6684ea6259 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:32.027342 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2604429-1d85-40ef-9f11-2a6684ea6259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:32.028546 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2604429-1d85-40ef-9f11-2a6684ea6259 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:32.046365 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1118/2247] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:57:32.047833 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24df68-1bde-4e07-972e-253f04d4b995 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:32.062793 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24df68-1bde-4e07-972e-253f04d4b995 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:32.067733 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b4853-5382-418a-81b7-ec8cf88a9ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:32.068482 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b4853-5382-418a-81b7-ec8cf88a9ca7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:32.068838 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b4853-5382-418a-81b7-ec8cf88a9ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:32.069275 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b4853-5382-418a-81b7-ec8cf88a9ca7 admin admin] PATH_INFO: `/v3/projects/649640d1629d4d74b059fa0e9c2be271/users/ab70bafc60844498afc2f1343472d095/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:32.071704 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b4853-5382-418a-81b7-ec8cf88a9ca7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=649640d1629d4d74b059fa0e9c2be271, user_id=ab70bafc60844498afc2f1343472d095, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:32.076325 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b4853-5382-418a-81b7-ec8cf88a9ca7 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:32.098334 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1130/2248] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:57:32 2022] PUT /identity/v3/projects/649640d1629d4d74b059fa0e9c2be271/users/ab70bafc60844498afc2f1343472d095/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:32.101060 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c743a59-9fef-4d9e-9a28-0759afdbad9d None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:32.101349 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c743a59-9fef-4d9e-9a28-0759afdbad9d None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:32.101631 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c743a59-9fef-4d9e-9a28-0759afdbad9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:32.150664 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-7c743a59-9fef-4d9e-9a28-0759afdbad9d None None] MFA Rules not processed for user `ab70bafc60844498afc2f1343472d095`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:32.150664 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-7c743a59-9fef-4d9e-9a28-0759afdbad9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:32.234227 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1119/2249] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:32 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:57:32.247095 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b4853-5382-418a-81b7-ec8cf88a9ca7 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:32.248837 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-5e6b4853-5382-418a-81b7-ec8cf88a9ca7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:32.321552 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b4853-5382-418a-81b7-ec8cf88a9ca7 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:32.326548 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04800d66-c91c-4a45-ab48-ec1729d4aaa2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:32.327117 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04800d66-c91c-4a45-ab48-ec1729d4aaa2 service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:32.327516 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04800d66-c91c-4a45-ab48-ec1729d4aaa2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:32.327906 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04800d66-c91c-4a45-ab48-ec1729d4aaa2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:32.341119 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04800d66-c91c-4a45-ab48-ec1729d4aaa2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:32.342702 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04800d66-c91c-4a45-ab48-ec1729d4aaa2 service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:32.354350 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1131/2250] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:57:32 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:57:32.547321 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c743a59-9fef-4d9e-9a28-0759afdbad9d None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:32.552154 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:32.559060 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c743a59-9fef-4d9e-9a28-0759afdbad9d None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:32.569839 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece30261-b535-4270-b435-fd17863de494 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:32.570811 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece30261-b535-4270-b435-fd17863de494 service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:32.571005 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece30261-b535-4270-b435-fd17863de494 service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:32.571283 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece30261-b535-4270-b435-fd17863de494 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:32.636255 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece30261-b535-4270-b435-fd17863de494 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:32.637816 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece30261-b535-4270-b435-fd17863de494 service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:32.646806 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1120/2251] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:57:32 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:57:35.797068 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04800d66-c91c-4a45-ab48-ec1729d4aaa2 service cinder] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:35.800475 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-04800d66-c91c-4a45-ab48-ec1729d4aaa2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:35.863043 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:35.892080 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04800d66-c91c-4a45-ab48-ec1729d4aaa2 service cinder] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:35.896952 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc7fd0-65c0-451b-b796-3c7d2c5b3158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:35.898241 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc7fd0-65c0-451b-b796-3c7d2c5b3158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:35.898532 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc7fd0-65c0-451b-b796-3c7d2c5b3158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:35.898791 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc7fd0-65c0-451b-b796-3c7d2c5b3158 admin admin] PATH_INFO: `/v3/users/5fa44f2ae691477eb62a084c82144a61` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:35.899943 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dc7fd0-65c0-451b-b796-3c7d2c5b3158 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fa44f2ae691477eb62a084c82144a61)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:35.902024 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dc7fd0-65c0-451b-b796-3c7d2c5b3158 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:35.951655 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-93dc7fd0-65c0-451b-b796-3c7d2c5b3158 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fa44f2ae691477eb62a084c82144a61'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:35.959541 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-93dc7fd0-65c0-451b-b796-3c7d2c5b3158 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fa44f2ae691477eb62a084c82144a61'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:35.960796 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-93dc7fd0-65c0-451b-b796-3c7d2c5b3158 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fa44f2ae691477eb62a084c82144a61'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:35.972968 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-93dc7fd0-65c0-451b-b796-3c7d2c5b3158 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fa44f2ae691477eb62a084c82144a61'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:35.973620 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-93dc7fd0-65c0-451b-b796-3c7d2c5b3158 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fa44f2ae691477eb62a084c82144a61'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:35.988330 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1132/2252] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:57:35 2022] DELETE /identity/v3/users/5fa44f2ae691477eb62a084c82144a61 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:35.993604 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542cf625-c9e0-49ce-9c35-1141d2b775cd None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:35.994095 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542cf625-c9e0-49ce-9c35-1141d2b775cd None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:35.994206 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542cf625-c9e0-49ce-9c35-1141d2b775cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:36.014013 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-542cf625-c9e0-49ce-9c35-1141d2b775cd None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:36.015265 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-542cf625-c9e0-49ce-9c35-1141d2b775cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:36.075715 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1121/2253] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:57:36.085559 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc7fd0-65c0-451b-b796-3c7d2c5b3158 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:36.087048 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-93dc7fd0-65c0-451b-b796-3c7d2c5b3158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:36.145073 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc7fd0-65c0-451b-b796-3c7d2c5b3158 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:36.148865 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5834b-ce5f-4730-8b3c-dbe216d1fd11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:36.149465 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5834b-ce5f-4730-8b3c-dbe216d1fd11 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:36.149742 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5834b-ce5f-4730-8b3c-dbe216d1fd11 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:36.150014 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5834b-ce5f-4730-8b3c-dbe216d1fd11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:36.158779 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5834b-ce5f-4730-8b3c-dbe216d1fd11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:36.160197 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5834b-ce5f-4730-8b3c-dbe216d1fd11 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:36.169731 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1133/2254] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:57:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:57:36.474638 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542cf625-c9e0-49ce-9c35-1141d2b775cd None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:36.477512 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-542cf625-c9e0-49ce-9c35-1141d2b775cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:36.492860 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542cf625-c9e0-49ce-9c35-1141d2b775cd None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:36.497921 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d73bc-8f73-4f00-a9c3-2410a24fb8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:36.498605 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d73bc-8f73-4f00-a9c3-2410a24fb8d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:36.498896 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d73bc-8f73-4f00-a9c3-2410a24fb8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:36.499286 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d73bc-8f73-4f00-a9c3-2410a24fb8d2 admin admin] PATH_INFO: `/v3/projects/a858abe7d80548f2ba5c534505fd058e` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:36.500524 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6d73bc-8f73-4f00-a9c3-2410a24fb8d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a858abe7d80548f2ba5c534505fd058e)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:36.502854 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6d73bc-8f73-4f00-a9c3-2410a24fb8d2 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:36.561910 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-7e6d73bc-8f73-4f00-a9c3-2410a24fb8d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a858abe7d80548f2ba5c534505fd058e', 'request_id': 'req-7e6d73bc-8f73-4f00-a9c3-2410a24fb8d2'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:36.568660 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-7e6d73bc-8f73-4f00-a9c3-2410a24fb8d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a858abe7d80548f2ba5c534505fd058e', 'request_id': 'req-7e6d73bc-8f73-4f00-a9c3-2410a24fb8d2'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:36.577440 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-7e6d73bc-8f73-4f00-a9c3-2410a24fb8d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a858abe7d80548f2ba5c534505fd058e', 'request_id': 'req-7e6d73bc-8f73-4f00-a9c3-2410a24fb8d2'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:36.590957 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-7e6d73bc-8f73-4f00-a9c3-2410a24fb8d2 admin admin] The token cache is being invalidate because project a858abe7d80548f2ba5c534505fd058e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:57:36.594445 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-7e6d73bc-8f73-4f00-a9c3-2410a24fb8d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:36.595735 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-7e6d73bc-8f73-4f00-a9c3-2410a24fb8d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:36.597263 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1122/2255] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:57:36 2022] DELETE /identity/v3/projects/a858abe7d80548f2ba5c534505fd058e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:36.602831 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c2e30-b955-441d-a155-b8e4ea3fe1fc None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:36.603195 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c2e30-b955-441d-a155-b8e4ea3fe1fc None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:36.603538 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c2e30-b955-441d-a155-b8e4ea3fe1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:36.626426 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-d39c2e30-b955-441d-a155-b8e4ea3fe1fc None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:36.627685 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-d39c2e30-b955-441d-a155-b8e4ea3fe1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:36.687533 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:36.702629 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1134/2256] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:57:36.706810 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78665b38-8d0a-467d-a15a-a75afdbee018 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:36.707102 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78665b38-8d0a-467d-a15a-a75afdbee018 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:36.707382 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78665b38-8d0a-467d-a15a-a75afdbee018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:36.729426 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-78665b38-8d0a-467d-a15a-a75afdbee018 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:36.731192 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-78665b38-8d0a-467d-a15a-a75afdbee018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:36.741888 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1123/2257] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:57:36.746112 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39c2e30-b955-441d-a155-b8e4ea3fe1fc None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:36.756019 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39c2e30-b955-441d-a155-b8e4ea3fe1fc None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:36.762278 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80f1ab-8ed1-4173-bcd5-186bbd4469fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:36.763044 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80f1ab-8ed1-4173-bcd5-186bbd4469fc admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:36.763328 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80f1ab-8ed1-4173-bcd5-186bbd4469fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:36.763603 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80f1ab-8ed1-4173-bcd5-186bbd4469fc admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:36.764989 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a80f1ab-8ed1-4173-bcd5-186bbd4469fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:36.764989 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a80f1ab-8ed1-4173-bcd5-186bbd4469fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:36.766568 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a80f1ab-8ed1-4173-bcd5-186bbd4469fc admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:36.783470 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78665b38-8d0a-467d-a15a-a75afdbee018 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:36.784989 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1135/2258] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 15:57:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:36.794371 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78665b38-8d0a-467d-a15a-a75afdbee018 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:36.799957 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552092e6-1e12-41ec-bd17-1017f5631bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:36.800573 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552092e6-1e12-41ec-bd17-1017f5631bd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:36.800853 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552092e6-1e12-41ec-bd17-1017f5631bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:36.801127 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552092e6-1e12-41ec-bd17-1017f5631bd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:36.801791 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552092e6-1e12-41ec-bd17-1017f5631bd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:36.803775 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552092e6-1e12-41ec-bd17-1017f5631bd1 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:36.822665 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:36.838058 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1124/2259] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:57:36 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 15:57:36.843537 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80f1ab-8ed1-4173-bcd5-186bbd4469fc admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:36.864808 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80f1ab-8ed1-4173-bcd5-186bbd4469fc admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:36.971363 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bfbd45-06cd-42d9-952e-c8b60e3ac01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:36.972237 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bfbd45-06cd-42d9-952e-c8b60e3ac01d admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:36.972834 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bfbd45-06cd-42d9-952e-c8b60e3ac01d admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:36.973263 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bfbd45-06cd-42d9-952e-c8b60e3ac01d admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:36.974166 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bfbd45-06cd-42d9-952e-c8b60e3ac01d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:36.976404 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bfbd45-06cd-42d9-952e-c8b60e3ac01d admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:37.015321 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1136/2260] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:57:36 2022] POST /identity/v3/users => generated 288 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 15:57:37.019642 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552092e6-1e12-41ec-bd17-1017f5631bd1 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:37.052944 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552092e6-1e12-41ec-bd17-1017f5631bd1 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:37.066653 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6aef5a-b9ba-4d26-b1bf-9947d2c9d814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:37.067318 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6aef5a-b9ba-4d26-b1bf-9947d2c9d814 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:37.067687 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6aef5a-b9ba-4d26-b1bf-9947d2c9d814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:37.068072 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6aef5a-b9ba-4d26-b1bf-9947d2c9d814 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:37.073116 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6aef5a-b9ba-4d26-b1bf-9947d2c9d814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:37.074812 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6aef5a-b9ba-4d26-b1bf-9947d2c9d814 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:37.108679 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1125/2261] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:57:37.111268 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bfbd45-06cd-42d9-952e-c8b60e3ac01d admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:37.125469 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bfbd45-06cd-42d9-952e-c8b60e3ac01d admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:37.145838 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96096f8e-b2fd-4568-9b93-91176d73806d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:37.146505 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96096f8e-b2fd-4568-9b93-91176d73806d admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:37.146791 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96096f8e-b2fd-4568-9b93-91176d73806d admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:37.147072 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96096f8e-b2fd-4568-9b93-91176d73806d admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:37.147764 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96096f8e-b2fd-4568-9b93-91176d73806d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:37.149658 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96096f8e-b2fd-4568-9b93-91176d73806d admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:37.163571 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1137/2262] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 15:57:37.167414 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6aef5a-b9ba-4d26-b1bf-9947d2c9d814 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:37.178225 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6aef5a-b9ba-4d26-b1bf-9947d2c9d814 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:37.184998 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f524ee-9934-440d-ada2-5e080340fbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:37.186103 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f524ee-9934-440d-ada2-5e080340fbb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:37.186481 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f524ee-9934-440d-ada2-5e080340fbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:37.186779 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f524ee-9934-440d-ada2-5e080340fbb6 admin admin] PATH_INFO: `/v3/projects/c1d4e6748d8d4e8b986e6a592589a250/users/700416baff4c40b2b65cafebf7cb1904/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:37.206385 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f524ee-9934-440d-ada2-5e080340fbb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1d4e6748d8d4e8b986e6a592589a250, user_id=700416baff4c40b2b65cafebf7cb1904, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:37.214190 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f524ee-9934-440d-ada2-5e080340fbb6 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:37.229289 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1126/2263] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:57:37 2022] PUT /identity/v3/projects/c1d4e6748d8d4e8b986e6a592589a250/users/700416baff4c40b2b65cafebf7cb1904/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:37.240369 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf2b6b-aafa-4924-9437-06545154570a None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:37.240799 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf2b6b-aafa-4924-9437-06545154570a None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:37.242036 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf2b6b-aafa-4924-9437-06545154570a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:37.271395 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-2bbf2b6b-aafa-4924-9437-06545154570a None None] MFA Rules not processed for user `700416baff4c40b2b65cafebf7cb1904`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:37.272922 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-2bbf2b6b-aafa-4924-9437-06545154570a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:37.351324 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1138/2264] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:57:37.362306 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f524ee-9934-440d-ada2-5e080340fbb6 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:37.364898 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-43f524ee-9934-440d-ada2-5e080340fbb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:37.429236 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f524ee-9934-440d-ada2-5e080340fbb6 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:37.433241 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45a1c0-d07a-432a-9a3d-099eac6c4beb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:37.433904 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45a1c0-d07a-432a-9a3d-099eac6c4beb service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:37.434214 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45a1c0-d07a-432a-9a3d-099eac6c4beb service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:37.434497 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45a1c0-d07a-432a-9a3d-099eac6c4beb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:37.443076 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b45a1c0-d07a-432a-9a3d-099eac6c4beb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:37.445176 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b45a1c0-d07a-432a-9a3d-099eac6c4beb service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:37.454513 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1127/2265] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:57:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:57:38.303503 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf2b6b-aafa-4924-9437-06545154570a None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:38.305271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-2bbf2b6b-aafa-4924-9437-06545154570a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:38.411157 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:38.432941 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf2b6b-aafa-4924-9437-06545154570a None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:38.441213 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a76bcc6-4c23-458c-83bc-921b7b119705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:38.442728 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76bcc6-4c23-458c-83bc-921b7b119705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:38.443017 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76bcc6-4c23-458c-83bc-921b7b119705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:38.443423 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76bcc6-4c23-458c-83bc-921b7b119705 admin admin] PATH_INFO: `/v3/users/880a3b8c0dfc427a9ce2e67a3d43356a` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:38.444953 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a76bcc6-4c23-458c-83bc-921b7b119705 admin admin] RBAC: Authorizing `identity:delete_user(user_id=880a3b8c0dfc427a9ce2e67a3d43356a)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:38.447320 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a76bcc6-4c23-458c-83bc-921b7b119705 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:38.514708 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-5a76bcc6-4c23-458c-83bc-921b7b119705 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '880a3b8c0dfc427a9ce2e67a3d43356a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:38.524994 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-5a76bcc6-4c23-458c-83bc-921b7b119705 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '880a3b8c0dfc427a9ce2e67a3d43356a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:38.526928 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-5a76bcc6-4c23-458c-83bc-921b7b119705 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '880a3b8c0dfc427a9ce2e67a3d43356a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:38.552231 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-5a76bcc6-4c23-458c-83bc-921b7b119705 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '880a3b8c0dfc427a9ce2e67a3d43356a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:38.553295 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-5a76bcc6-4c23-458c-83bc-921b7b119705 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '880a3b8c0dfc427a9ce2e67a3d43356a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:38.568418 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1139/2266] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:57:38 2022] DELETE /identity/v3/users/880a3b8c0dfc427a9ce2e67a3d43356a => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:38.573905 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593875aa-5712-4795-b8b9-7c8fa8a36d18 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:38.574484 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593875aa-5712-4795-b8b9-7c8fa8a36d18 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:38.574484 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593875aa-5712-4795-b8b9-7c8fa8a36d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:38.595887 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-593875aa-5712-4795-b8b9-7c8fa8a36d18 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:38.597095 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-593875aa-5712-4795-b8b9-7c8fa8a36d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:38.670437 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1128/2267] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:57:38.680680 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a76bcc6-4c23-458c-83bc-921b7b119705 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:38.682144 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-5a76bcc6-4c23-458c-83bc-921b7b119705 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:38.764407 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a76bcc6-4c23-458c-83bc-921b7b119705 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:38.769410 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90625fc1-3c22-4703-8ede-f49bf771e4d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:38.770034 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90625fc1-3c22-4703-8ede-f49bf771e4d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:38.770445 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90625fc1-3c22-4703-8ede-f49bf771e4d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:38.770626 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90625fc1-3c22-4703-8ede-f49bf771e4d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:38.784118 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90625fc1-3c22-4703-8ede-f49bf771e4d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:38.785660 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90625fc1-3c22-4703-8ede-f49bf771e4d1 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:38.799683 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1140/2268] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:57:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:57:38.838459 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda21f7-0d24-4c30-a230-9e03cfdbd773 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:38.838895 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda21f7-0d24-4c30-a230-9e03cfdbd773 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:38.839237 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda21f7-0d24-4c30-a230-9e03cfdbd773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:38.860031 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-7fda21f7-0d24-4c30-a230-9e03cfdbd773 None None] MFA Rules not processed for user `700416baff4c40b2b65cafebf7cb1904`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:38.861342 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-7fda21f7-0d24-4c30-a230-9e03cfdbd773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:38.951797 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1129/2269] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:57:39.405029 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90625fc1-3c22-4703-8ede-f49bf771e4d1 service neutron] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:39.406546 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-90625fc1-3c22-4703-8ede-f49bf771e4d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:39.422927 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90625fc1-3c22-4703-8ede-f49bf771e4d1 service neutron] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:39.430770 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad13207-0aa2-4b0e-a335-8e5595db9ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:39.431421 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad13207-0aa2-4b0e-a335-8e5595db9ae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:39.431708 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad13207-0aa2-4b0e-a335-8e5595db9ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:39.431989 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad13207-0aa2-4b0e-a335-8e5595db9ae9 admin admin] PATH_INFO: `/v3/projects/fc0022986a8042338c955be3831b0cf7` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:39.434152 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad13207-0aa2-4b0e-a335-8e5595db9ae9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc0022986a8042338c955be3831b0cf7)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:39.436158 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad13207-0aa2-4b0e-a335-8e5595db9ae9 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:39.545737 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-6ad13207-0aa2-4b0e-a335-8e5595db9ae9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc0022986a8042338c955be3831b0cf7', 'request_id': 'req-6ad13207-0aa2-4b0e-a335-8e5595db9ae9'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:39.554838 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-6ad13207-0aa2-4b0e-a335-8e5595db9ae9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc0022986a8042338c955be3831b0cf7', 'request_id': 'req-6ad13207-0aa2-4b0e-a335-8e5595db9ae9'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:39.565752 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-6ad13207-0aa2-4b0e-a335-8e5595db9ae9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc0022986a8042338c955be3831b0cf7', 'request_id': 'req-6ad13207-0aa2-4b0e-a335-8e5595db9ae9'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:39.592813 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:39.615133 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-6ad13207-0aa2-4b0e-a335-8e5595db9ae9 admin admin] The token cache is being invalidate because project fc0022986a8042338c955be3831b0cf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:57:39.619086 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-6ad13207-0aa2-4b0e-a335-8e5595db9ae9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:39.619853 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-6ad13207-0aa2-4b0e-a335-8e5595db9ae9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:39.622105 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1141/2270] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:57:39 2022] DELETE /identity/v3/projects/fc0022986a8042338c955be3831b0cf7 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 15:57:39.625774 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fda21f7-0d24-4c30-a230-9e03cfdbd773 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:39.653243 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fda21f7-0d24-4c30-a230-9e03cfdbd773 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:39.668729 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:39.766602 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768ffe4-7593-475e-8ed0-63d7c6290a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:39.767445 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768ffe4-7593-475e-8ed0-63d7c6290a8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:39.767731 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768ffe4-7593-475e-8ed0-63d7c6290a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:39.768024 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768ffe4-7593-475e-8ed0-63d7c6290a8e admin admin] PATH_INFO: `/v3/users/ab70bafc60844498afc2f1343472d095` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:39.770981 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d768ffe4-7593-475e-8ed0-63d7c6290a8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab70bafc60844498afc2f1343472d095)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:39.773952 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d768ffe4-7593-475e-8ed0-63d7c6290a8e admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:39.828438 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-d768ffe4-7593-475e-8ed0-63d7c6290a8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab70bafc60844498afc2f1343472d095'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:39.836404 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-d768ffe4-7593-475e-8ed0-63d7c6290a8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab70bafc60844498afc2f1343472d095'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:39.837007 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-d768ffe4-7593-475e-8ed0-63d7c6290a8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab70bafc60844498afc2f1343472d095'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:39.844736 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-d768ffe4-7593-475e-8ed0-63d7c6290a8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab70bafc60844498afc2f1343472d095'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:39.845388 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-d768ffe4-7593-475e-8ed0-63d7c6290a8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab70bafc60844498afc2f1343472d095'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:39.864498 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1130/2271] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:57:39 2022] DELETE /identity/v3/users/ab70bafc60844498afc2f1343472d095 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:40.167916 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad13207-0aa2-4b0e-a335-8e5595db9ae9 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:40.169349 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-6ad13207-0aa2-4b0e-a335-8e5595db9ae9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:40.185267 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad13207-0aa2-4b0e-a335-8e5595db9ae9 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:40.250290 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e437383-7783-41cc-a027-19b47a8a090d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:40.251043 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e437383-7783-41cc-a027-19b47a8a090d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:40.251323 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e437383-7783-41cc-a027-19b47a8a090d admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:40.251776 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e437383-7783-41cc-a027-19b47a8a090d admin admin] PATH_INFO: `/v3/projects/649640d1629d4d74b059fa0e9c2be271` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:40.252901 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e437383-7783-41cc-a027-19b47a8a090d admin admin] RBAC: Authorizing `identity:delete_project(project_id=649640d1629d4d74b059fa0e9c2be271)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:40.254842 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e437383-7783-41cc-a027-19b47a8a090d admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:40.302934 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-1e437383-7783-41cc-a027-19b47a8a090d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '649640d1629d4d74b059fa0e9c2be271', 'request_id': 'req-1e437383-7783-41cc-a027-19b47a8a090d'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:40.309129 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-1e437383-7783-41cc-a027-19b47a8a090d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '649640d1629d4d74b059fa0e9c2be271', 'request_id': 'req-1e437383-7783-41cc-a027-19b47a8a090d'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:40.315374 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-1e437383-7783-41cc-a027-19b47a8a090d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '649640d1629d4d74b059fa0e9c2be271', 'request_id': 'req-1e437383-7783-41cc-a027-19b47a8a090d'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:40.328758 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-1e437383-7783-41cc-a027-19b47a8a090d admin admin] The token cache is being invalidate because project 649640d1629d4d74b059fa0e9c2be271 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:57:40.329050 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-1e437383-7783-41cc-a027-19b47a8a090d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:40.329680 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-1e437383-7783-41cc-a027-19b47a8a090d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:40.331313 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1142/2272] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:57:40 2022] DELETE /identity/v3/projects/649640d1629d4d74b059fa0e9c2be271 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:40.337298 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874e7a4-37f5-4c57-9a16-9e4f1bc1aa10 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:40.337601 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874e7a4-37f5-4c57-9a16-9e4f1bc1aa10 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:40.337901 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874e7a4-37f5-4c57-9a16-9e4f1bc1aa10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:40.359051 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-c874e7a4-37f5-4c57-9a16-9e4f1bc1aa10 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:40.360263 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-c874e7a4-37f5-4c57-9a16-9e4f1bc1aa10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:40.421452 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1131/2273] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 15:57:40.429465 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c4c48-4f98-4e71-b376-7207e6be044a None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:40.429946 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c4c48-4f98-4e71-b376-7207e6be044a None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:40.430056 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c4c48-4f98-4e71-b376-7207e6be044a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:40.450915 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-2a6c4c48-4f98-4e71-b376-7207e6be044a None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:40.452461 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-2a6c4c48-4f98-4e71-b376-7207e6be044a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:40.461992 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1143/2274] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:57:40.466410 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874e7a4-37f5-4c57-9a16-9e4f1bc1aa10 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:40.479132 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874e7a4-37f5-4c57-9a16-9e4f1bc1aa10 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:40.484216 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4023a0b-9776-4f3f-9884-bea177da7c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:40.484891 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4023a0b-9776-4f3f-9884-bea177da7c02 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:40.485171 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4023a0b-9776-4f3f-9884-bea177da7c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:40.485444 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4023a0b-9776-4f3f-9884-bea177da7c02 admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:40.486089 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4023a0b-9776-4f3f-9884-bea177da7c02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:40.486448 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4023a0b-9776-4f3f-9884-bea177da7c02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:40.488023 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4023a0b-9776-4f3f-9884-bea177da7c02 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:40.501866 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1132/2275] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 15:57:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:40.505866 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c4c48-4f98-4e71-b376-7207e6be044a None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:40.516757 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c4c48-4f98-4e71-b376-7207e6be044a None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:40.523369 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60602b46-652e-4ba4-9dbd-53eb72ad6975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:40.523982 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60602b46-652e-4ba4-9dbd-53eb72ad6975 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:40.524263 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60602b46-652e-4ba4-9dbd-53eb72ad6975 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:40.524536 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60602b46-652e-4ba4-9dbd-53eb72ad6975 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:40.525173 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60602b46-652e-4ba4-9dbd-53eb72ad6975 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:40.527462 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60602b46-652e-4ba4-9dbd-53eb72ad6975 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:40.559923 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1144/2276] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:57:40 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:57:40.560994 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4023a0b-9776-4f3f-9884-bea177da7c02 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:40.572347 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4023a0b-9776-4f3f-9884-bea177da7c02 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:40.586476 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:40.639748 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db801a-90c6-4c2e-bbca-b29f6e025c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:40.640772 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db801a-90c6-4c2e-bbca-b29f6e025c8d admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:40.640772 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db801a-90c6-4c2e-bbca-b29f6e025c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:40.641188 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db801a-90c6-4c2e-bbca-b29f6e025c8d admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:40.641975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db801a-90c6-4c2e-bbca-b29f6e025c8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:40.644014 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db801a-90c6-4c2e-bbca-b29f6e025c8d admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:40.672969 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1133/2277] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:57:40 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:57:40.677021 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60602b46-652e-4ba4-9dbd-53eb72ad6975 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:40.692160 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60602b46-652e-4ba4-9dbd-53eb72ad6975 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:40.701229 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08022f8-f6b2-486f-836b-67d58686ccba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:40.701889 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08022f8-f6b2-486f-836b-67d58686ccba admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:40.702224 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08022f8-f6b2-486f-836b-67d58686ccba admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:40.702554 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08022f8-f6b2-486f-836b-67d58686ccba admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:40.703196 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08022f8-f6b2-486f-836b-67d58686ccba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:40.705448 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08022f8-f6b2-486f-836b-67d58686ccba admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:40.722929 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1145/2278] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 15:57:40.728856 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db801a-90c6-4c2e-bbca-b29f6e025c8d admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:40.742463 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db801a-90c6-4c2e-bbca-b29f6e025c8d admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:40.749958 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc2611-7c7a-43e6-be07-96d8f91d7812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:40.751002 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc2611-7c7a-43e6-be07-96d8f91d7812 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:40.751675 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc2611-7c7a-43e6-be07-96d8f91d7812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:40.752233 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc2611-7c7a-43e6-be07-96d8f91d7812 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:40.753204 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc2611-7c7a-43e6-be07-96d8f91d7812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:40.755749 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc2611-7c7a-43e6-be07-96d8f91d7812 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:40.772512 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1134/2279] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:57:40.777101 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08022f8-f6b2-486f-836b-67d58686ccba admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:40.788213 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08022f8-f6b2-486f-836b-67d58686ccba admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:40.796784 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d17b9-a613-482e-933f-6addf426bf9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:40.821789 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d17b9-a613-482e-933f-6addf426bf9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:40.823895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d17b9-a613-482e-933f-6addf426bf9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:40.824328 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d17b9-a613-482e-933f-6addf426bf9b admin admin] PATH_INFO: `/v3/projects/487f80a09f6b4f79a346b86d3f4e487b/users/4542d73646514298930b53cd145e0a25/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:40.861382 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d17b9-a613-482e-933f-6addf426bf9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=487f80a09f6b4f79a346b86d3f4e487b, user_id=4542d73646514298930b53cd145e0a25, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:40.895391 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d17b9-a613-482e-933f-6addf426bf9b admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:40.926257 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1146/2280] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:57:40 2022] PUT /identity/v3/projects/487f80a09f6b4f79a346b86d3f4e487b/users/4542d73646514298930b53cd145e0a25/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:40.933367 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ce696-ccfb-4356-b616-4b377ffff46a None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:40.933742 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ce696-ccfb-4356-b616-4b377ffff46a None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:40.934092 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ce696-ccfb-4356-b616-4b377ffff46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:40.971407 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-801ce696-ccfb-4356-b616-4b377ffff46a None None] MFA Rules not processed for user `4542d73646514298930b53cd145e0a25`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:40.972629 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-801ce696-ccfb-4356-b616-4b377ffff46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:41.066010 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1135/2281] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:57:41.071576 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d17b9-a613-482e-933f-6addf426bf9b admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:41.118968 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:41.161437 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d17b9-a613-482e-933f-6addf426bf9b admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:41.166948 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a820b5-3c22-4ce5-b780-ee7847ff3551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:41.167594 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a820b5-3c22-4ce5-b780-ee7847ff3551 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:41.167876 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a820b5-3c22-4ce5-b780-ee7847ff3551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:41.168174 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a820b5-3c22-4ce5-b780-ee7847ff3551 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:41.168806 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a820b5-3c22-4ce5-b780-ee7847ff3551 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:41.170806 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a820b5-3c22-4ce5-b780-ee7847ff3551 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:41.197719 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1147/2282] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:57:41 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:57:41.201960 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ce696-ccfb-4356-b616-4b377ffff46a None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:41.212761 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ce696-ccfb-4356-b616-4b377ffff46a None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:41.269222 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbe5b78-620a-4dfd-9732-81a6a9a538d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:41.269741 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe5b78-620a-4dfd-9732-81a6a9a538d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:41.270017 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe5b78-620a-4dfd-9732-81a6a9a538d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:41.270321 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe5b78-620a-4dfd-9732-81a6a9a538d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:41.270945 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbe5b78-620a-4dfd-9732-81a6a9a538d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:41.273536 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbe5b78-620a-4dfd-9732-81a6a9a538d5 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:41.294105 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1136/2283] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:57:41 2022] POST /identity/v3/users => generated 298 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:57:41.298484 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a820b5-3c22-4ce5-b780-ee7847ff3551 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:41.312485 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a820b5-3c22-4ce5-b780-ee7847ff3551 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:41.317465 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d058022-6777-4c65-9ccd-bbe6528a337f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:41.318090 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d058022-6777-4c65-9ccd-bbe6528a337f admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:41.318416 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d058022-6777-4c65-9ccd-bbe6528a337f admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:41.318689 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d058022-6777-4c65-9ccd-bbe6528a337f admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:41.319874 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d058022-6777-4c65-9ccd-bbe6528a337f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:41.321578 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d058022-6777-4c65-9ccd-bbe6528a337f admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:41.332440 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1148/2284] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:57:41.336666 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbe5b78-620a-4dfd-9732-81a6a9a538d5 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:41.347309 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbe5b78-620a-4dfd-9732-81a6a9a538d5 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:41.352080 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d1993-8339-44c6-a9cb-1a6d04edf3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:41.352729 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d1993-8339-44c6-a9cb-1a6d04edf3fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:41.353007 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d1993-8339-44c6-a9cb-1a6d04edf3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:41.353280 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d1993-8339-44c6-a9cb-1a6d04edf3fc admin admin] PATH_INFO: `/v3/projects/887c3ff7c81b47a2bcd3d597abb95c20/users/9e3b643c1ef44f18b3785e9373adaa0c/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:41.369201 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:41.377185 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d1993-8339-44c6-a9cb-1a6d04edf3fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=887c3ff7c81b47a2bcd3d597abb95c20, user_id=9e3b643c1ef44f18b3785e9373adaa0c, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:41.379950 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d1993-8339-44c6-a9cb-1a6d04edf3fc admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:41.397647 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1137/2285] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:57:41 2022] PUT /identity/v3/projects/887c3ff7c81b47a2bcd3d597abb95c20/users/9e3b643c1ef44f18b3785e9373adaa0c/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:41.401887 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d058022-6777-4c65-9ccd-bbe6528a337f admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:41.412028 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d058022-6777-4c65-9ccd-bbe6528a337f admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:41.471312 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41105d57-045f-48f2-b6d0-f60900122ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:41.472015 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41105d57-045f-48f2-b6d0-f60900122ef2 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:41.472193 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41105d57-045f-48f2-b6d0-f60900122ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:41.472464 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41105d57-045f-48f2-b6d0-f60900122ef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:41.473104 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41105d57-045f-48f2-b6d0-f60900122ef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:41.474728 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41105d57-045f-48f2-b6d0-f60900122ef2 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:41.485688 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1149/2286] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 15:57:41.490274 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d1993-8339-44c6-a9cb-1a6d04edf3fc admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:41.501241 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d1993-8339-44c6-a9cb-1a6d04edf3fc admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:41.505906 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4ceda-20ef-42b8-b3d4-32c188b24658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:41.507258 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4ceda-20ef-42b8-b3d4-32c188b24658 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:41.507623 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4ceda-20ef-42b8-b3d4-32c188b24658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:41.507910 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4ceda-20ef-42b8-b3d4-32c188b24658 admin admin] PATH_INFO: `/v3/projects/887c3ff7c81b47a2bcd3d597abb95c20/users/9e3b643c1ef44f18b3785e9373adaa0c/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:41.509822 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f4ceda-20ef-42b8-b3d4-32c188b24658 admin admin] RBAC: Authorizing `identity:create_grant(project_id=887c3ff7c81b47a2bcd3d597abb95c20, user_id=9e3b643c1ef44f18b3785e9373adaa0c, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:41.512519 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f4ceda-20ef-42b8-b3d4-32c188b24658 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:41.523080 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1138/2287] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:57:41 2022] PUT /identity/v3/projects/887c3ff7c81b47a2bcd3d597abb95c20/users/9e3b643c1ef44f18b3785e9373adaa0c/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:41.533304 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869195ff-be1f-49df-aa05-44f95aecb718 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:41.533590 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869195ff-be1f-49df-aa05-44f95aecb718 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:41.533867 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869195ff-be1f-49df-aa05-44f95aecb718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:41.561855 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-869195ff-be1f-49df-aa05-44f95aecb718 None None] MFA Rules not processed for user `9e3b643c1ef44f18b3785e9373adaa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:41.563088 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-869195ff-be1f-49df-aa05-44f95aecb718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:41.635031 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1150/2288] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:41 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:57:41.646535 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4ceda-20ef-42b8-b3d4-32c188b24658 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:41.648638 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-97f4ceda-20ef-42b8-b3d4-32c188b24658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:41.705746 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4ceda-20ef-42b8-b3d4-32c188b24658 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:41.709389 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d2ef78-cd0e-457c-b310-d78f625adb68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:41.710113 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2ef78-cd0e-457c-b310-d78f625adb68 service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:41.710418 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2ef78-cd0e-457c-b310-d78f625adb68 service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:41.710689 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2ef78-cd0e-457c-b310-d78f625adb68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:41.719596 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d2ef78-cd0e-457c-b310-d78f625adb68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:41.721022 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d2ef78-cd0e-457c-b310-d78f625adb68 service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:41.730976 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1139/2289] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:57:41 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:57:41.753676 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869195ff-be1f-49df-aa05-44f95aecb718 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:41.755173 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-869195ff-be1f-49df-aa05-44f95aecb718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:41.782727 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:41.824587 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d2ef78-cd0e-457c-b310-d78f625adb68 service cinder] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:41.830338 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869195ff-be1f-49df-aa05-44f95aecb718 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:41.833218 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d2ef78-cd0e-457c-b310-d78f625adb68 service cinder] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:41.835695 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984eee3-cb79-4842-8065-149b9f3da47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:41.836324 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984eee3-cb79-4842-8065-149b9f3da47f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:41.836605 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984eee3-cb79-4842-8065-149b9f3da47f admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:41.836880 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984eee3-cb79-4842-8065-149b9f3da47f admin admin] PATH_INFO: `/v3/users/e3c9600c9e8b458abf91a9aebdbac736` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:41.837744 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fdd32f-c520-4c01-bb8d-9a1c17ea05e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:41.838015 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b984eee3-cb79-4842-8065-149b9f3da47f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3c9600c9e8b458abf91a9aebdbac736)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:41.838413 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fdd32f-c520-4c01-bb8d-9a1c17ea05e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:41.838698 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fdd32f-c520-4c01-bb8d-9a1c17ea05e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:41.838974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fdd32f-c520-4c01-bb8d-9a1c17ea05e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:41.839959 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b984eee3-cb79-4842-8065-149b9f3da47f admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:41.889664 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-b984eee3-cb79-4842-8065-149b9f3da47f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3c9600c9e8b458abf91a9aebdbac736'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:41.898527 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-b984eee3-cb79-4842-8065-149b9f3da47f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3c9600c9e8b458abf91a9aebdbac736'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:41.899168 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-b984eee3-cb79-4842-8065-149b9f3da47f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3c9600c9e8b458abf91a9aebdbac736'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:41.900106 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fdd32f-c520-4c01-bb8d-9a1c17ea05e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:41.901593 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fdd32f-c520-4c01-bb8d-9a1c17ea05e3 service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:41.912313 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1140/2290] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:57:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 15:57:41.912444 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-b984eee3-cb79-4842-8065-149b9f3da47f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3c9600c9e8b458abf91a9aebdbac736'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:41.913432 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-b984eee3-cb79-4842-8065-149b9f3da47f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3c9600c9e8b458abf91a9aebdbac736'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:41.926903 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1151/2291] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:57:41 2022] DELETE /identity/v3/users/e3c9600c9e8b458abf91a9aebdbac736 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:41.932457 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c318e-5bc6-4f20-bc8e-364a5096e4ed None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:41.932826 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c318e-5bc6-4f20-bc8e-364a5096e4ed None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:41.933967 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c318e-5bc6-4f20-bc8e-364a5096e4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:41.961702 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-5b4c318e-5bc6-4f20-bc8e-364a5096e4ed None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:41.963156 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-5b4c318e-5bc6-4f20-bc8e-364a5096e4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:42.073526 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1141/2292] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:57:42.088546 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984eee3-cb79-4842-8065-149b9f3da47f admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:42.088546 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-b984eee3-cb79-4842-8065-149b9f3da47f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:42.165697 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984eee3-cb79-4842-8065-149b9f3da47f admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:42.171331 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a3097-4f77-4f8c-9369-f6dbb28cdf34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:42.172008 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a3097-4f77-4f8c-9369-f6dbb28cdf34 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:42.172266 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a3097-4f77-4f8c-9369-f6dbb28cdf34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:42.172541 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a3097-4f77-4f8c-9369-f6dbb28cdf34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:42.191179 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a3097-4f77-4f8c-9369-f6dbb28cdf34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:42.193249 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a3097-4f77-4f8c-9369-f6dbb28cdf34 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:42.212039 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1152/2293] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:57:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:57:42.325625 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c318e-5bc6-4f20-bc8e-364a5096e4ed None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:42.327387 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-5b4c318e-5bc6-4f20-bc8e-364a5096e4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:42.343891 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c318e-5bc6-4f20-bc8e-364a5096e4ed None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:42.348971 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9504912d-522d-4703-9ba2-14667f1ac646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:42.349608 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504912d-522d-4703-9ba2-14667f1ac646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:42.349917 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504912d-522d-4703-9ba2-14667f1ac646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:42.350403 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504912d-522d-4703-9ba2-14667f1ac646 admin admin] PATH_INFO: `/v3/users/4542d73646514298930b53cd145e0a25` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:42.352336 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9504912d-522d-4703-9ba2-14667f1ac646 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4542d73646514298930b53cd145e0a25)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:42.354685 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9504912d-522d-4703-9ba2-14667f1ac646 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:42.370735 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:42.436984 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-9504912d-522d-4703-9ba2-14667f1ac646 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4542d73646514298930b53cd145e0a25'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:42.445706 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-9504912d-522d-4703-9ba2-14667f1ac646 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4542d73646514298930b53cd145e0a25'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:42.446482 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-9504912d-522d-4703-9ba2-14667f1ac646 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4542d73646514298930b53cd145e0a25'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:42.455385 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-9504912d-522d-4703-9ba2-14667f1ac646 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4542d73646514298930b53cd145e0a25'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:42.456149 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-9504912d-522d-4703-9ba2-14667f1ac646 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4542d73646514298930b53cd145e0a25'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:42.478794 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1142/2294] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:57:42 2022] DELETE /identity/v3/users/4542d73646514298930b53cd145e0a25 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:42.483584 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f06f6-866a-4ff5-a097-14bff24344ff None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:42.484116 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f06f6-866a-4ff5-a097-14bff24344ff None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:42.484116 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f06f6-866a-4ff5-a097-14bff24344ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:42.504884 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-787f06f6-866a-4ff5-a097-14bff24344ff None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:42.506269 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-787f06f6-866a-4ff5-a097-14bff24344ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:42.551097 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:42.574200 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1153/2295] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:57:42.584227 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9504912d-522d-4703-9ba2-14667f1ac646 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:42.585846 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-9504912d-522d-4703-9ba2-14667f1ac646 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:42.674123 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9504912d-522d-4703-9ba2-14667f1ac646 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:42.677991 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a523656-8c87-4e7d-bb09-1920f67c6adb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:42.679270 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a523656-8c87-4e7d-bb09-1920f67c6adb service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:42.679614 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a523656-8c87-4e7d-bb09-1920f67c6adb service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:42.679906 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a523656-8c87-4e7d-bb09-1920f67c6adb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:42.690876 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a523656-8c87-4e7d-bb09-1920f67c6adb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:42.692358 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a523656-8c87-4e7d-bb09-1920f67c6adb service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:42.702900 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1143/2296] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:57:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:57:42.759449 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f06f6-866a-4ff5-a097-14bff24344ff None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:42.761381 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-787f06f6-866a-4ff5-a097-14bff24344ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:42.778007 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f06f6-866a-4ff5-a097-14bff24344ff None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:42.784159 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d2761-5179-44d4-bb54-785166a1d96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:42.785404 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d2761-5179-44d4-bb54-785166a1d96e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:42.786391 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d2761-5179-44d4-bb54-785166a1d96e admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:42.786823 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d2761-5179-44d4-bb54-785166a1d96e admin admin] PATH_INFO: `/v3/projects/a010a02a23244f96813dd17ae14c06ea` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:42.789391 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d2761-5179-44d4-bb54-785166a1d96e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a010a02a23244f96813dd17ae14c06ea)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:42.792346 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d2761-5179-44d4-bb54-785166a1d96e admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:42.872646 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-969d2761-5179-44d4-bb54-785166a1d96e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a010a02a23244f96813dd17ae14c06ea', 'request_id': 'req-969d2761-5179-44d4-bb54-785166a1d96e'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:42.893936 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-969d2761-5179-44d4-bb54-785166a1d96e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a010a02a23244f96813dd17ae14c06ea', 'request_id': 'req-969d2761-5179-44d4-bb54-785166a1d96e'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:42.903818 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-969d2761-5179-44d4-bb54-785166a1d96e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a010a02a23244f96813dd17ae14c06ea', 'request_id': 'req-969d2761-5179-44d4-bb54-785166a1d96e'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:42.919521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-969d2761-5179-44d4-bb54-785166a1d96e admin admin] The token cache is being invalidate because project a010a02a23244f96813dd17ae14c06ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:57:42.920579 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-969d2761-5179-44d4-bb54-785166a1d96e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:42.921337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-969d2761-5179-44d4-bb54-785166a1d96e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:42.926219 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1154/2297] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:57:42 2022] DELETE /identity/v3/projects/a010a02a23244f96813dd17ae14c06ea => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:42.929168 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fcbf3c-a68b-4494-a908-93e8db96edfc None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:42.929460 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fcbf3c-a68b-4494-a908-93e8db96edfc None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:42.929732 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fcbf3c-a68b-4494-a908-93e8db96edfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:42.951201 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-99fcbf3c-a68b-4494-a908-93e8db96edfc None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:42.952598 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-99fcbf3c-a68b-4494-a908-93e8db96edfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:43.024920 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1144/2298] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:57:43.032764 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d0d2f-bb70-4242-972f-d358a2d9df4c None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:43.033478 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d0d2f-bb70-4242-972f-d358a2d9df4c None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:43.034035 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d0d2f-bb70-4242-972f-d358a2d9df4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:43.064468 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-668d0d2f-bb70-4242-972f-d358a2d9df4c None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:43.066352 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-668d0d2f-bb70-4242-972f-d358a2d9df4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:43.093482 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1155/2299] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:57:43.097650 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fcbf3c-a68b-4494-a908-93e8db96edfc None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:43.109775 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fcbf3c-a68b-4494-a908-93e8db96edfc None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:43.115651 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7c748-53b6-4921-8aba-08dfc288decc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:43.116531 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7c748-53b6-4921-8aba-08dfc288decc admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:43.117378 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7c748-53b6-4921-8aba-08dfc288decc admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:43.117812 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7c748-53b6-4921-8aba-08dfc288decc admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:43.118655 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7c748-53b6-4921-8aba-08dfc288decc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:43.119117 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7c748-53b6-4921-8aba-08dfc288decc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:43.121410 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7c748-53b6-4921-8aba-08dfc288decc admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:43.136830 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1145/2300] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 15:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:43.141194 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d0d2f-bb70-4242-972f-d358a2d9df4c None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:43.151777 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d0d2f-bb70-4242-972f-d358a2d9df4c None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:43.157293 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f0e43-be64-4dda-85d8-e9fabdb94199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:43.157856 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f0e43-be64-4dda-85d8-e9fabdb94199 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:43.158136 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f0e43-be64-4dda-85d8-e9fabdb94199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:43.158462 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f0e43-be64-4dda-85d8-e9fabdb94199 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:43.159269 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1f0e43-be64-4dda-85d8-e9fabdb94199 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:43.161032 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1f0e43-be64-4dda-85d8-e9fabdb94199 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:43.196318 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1156/2301] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:57:43 2022] POST /identity/v3/projects => generated 365 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:57:43.200442 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7c748-53b6-4921-8aba-08dfc288decc admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:43.225873 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7c748-53b6-4921-8aba-08dfc288decc admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:43.252272 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:43.270744 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f0e43-be64-4dda-85d8-e9fabdb94199 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:43.273087 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-1d1f0e43-be64-4dda-85d8-e9fabdb94199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:43.339101 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a65605-da57-488a-98d5-aaf2d1e0f150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:43.341558 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a65605-da57-488a-98d5-aaf2d1e0f150 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:43.342375 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a65605-da57-488a-98d5-aaf2d1e0f150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:43.342769 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a65605-da57-488a-98d5-aaf2d1e0f150 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:43.343743 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a65605-da57-488a-98d5-aaf2d1e0f150 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:43.347264 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a65605-da57-488a-98d5-aaf2d1e0f150 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:43.370076 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f0e43-be64-4dda-85d8-e9fabdb94199 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:43.377404 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf20e7-2ad1-4d61-9120-d9f10ad0500f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:43.378095 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf20e7-2ad1-4d61-9120-d9f10ad0500f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:43.378423 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf20e7-2ad1-4d61-9120-d9f10ad0500f admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:43.378722 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf20e7-2ad1-4d61-9120-d9f10ad0500f admin admin] PATH_INFO: `/v3/projects/487f80a09f6b4f79a346b86d3f4e487b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:43.381083 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf20e7-2ad1-4d61-9120-d9f10ad0500f admin admin] RBAC: Authorizing `identity:delete_project(project_id=487f80a09f6b4f79a346b86d3f4e487b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:43.384500 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf20e7-2ad1-4d61-9120-d9f10ad0500f admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:43.405248 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1146/2302] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:57:43 2022] POST /identity/v3/users => generated 283 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:57:43.407803 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a65605-da57-488a-98d5-aaf2d1e0f150 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:43.429383 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a65605-da57-488a-98d5-aaf2d1e0f150 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:43.439398 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41369267-2639-4590-9050-d3da18e0e9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:43.440026 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41369267-2639-4590-9050-d3da18e0e9fe admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:43.440308 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41369267-2639-4590-9050-d3da18e0e9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:43.440607 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41369267-2639-4590-9050-d3da18e0e9fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:43.441755 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41369267-2639-4590-9050-d3da18e0e9fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:43.443554 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41369267-2639-4590-9050-d3da18e0e9fe admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:43.462094 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1147/2303] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:57:43.465003 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41369267-2639-4590-9050-d3da18e0e9fe admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:43.472653 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:43.486321 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-0abf20e7-2ad1-4d61-9120-d9f10ad0500f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '487f80a09f6b4f79a346b86d3f4e487b', 'request_id': 'req-0abf20e7-2ad1-4d61-9120-d9f10ad0500f'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:43.494468 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41369267-2639-4590-9050-d3da18e0e9fe admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:43.502514 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-0abf20e7-2ad1-4d61-9120-d9f10ad0500f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '487f80a09f6b4f79a346b86d3f4e487b', 'request_id': 'req-0abf20e7-2ad1-4d61-9120-d9f10ad0500f'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:43.517495 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-0abf20e7-2ad1-4d61-9120-d9f10ad0500f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '487f80a09f6b4f79a346b86d3f4e487b', 'request_id': 'req-0abf20e7-2ad1-4d61-9120-d9f10ad0500f'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:43.533614 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-0abf20e7-2ad1-4d61-9120-d9f10ad0500f admin admin] The token cache is being invalidate because project 487f80a09f6b4f79a346b86d3f4e487b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:57:43.534154 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-0abf20e7-2ad1-4d61-9120-d9f10ad0500f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:43.535345 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-0abf20e7-2ad1-4d61-9120-d9f10ad0500f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:43.541138 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1157/2304] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:57:43 2022] DELETE /identity/v3/projects/487f80a09f6b4f79a346b86d3f4e487b => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:43.545134 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf20e7-2ad1-4d61-9120-d9f10ad0500f admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:43.547010 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-0abf20e7-2ad1-4d61-9120-d9f10ad0500f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:43.586916 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3981ee-eb05-4061-82d9-94a7b3c9b08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:43.587534 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3981ee-eb05-4061-82d9-94a7b3c9b08b admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:43.587899 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3981ee-eb05-4061-82d9-94a7b3c9b08b admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:43.588238 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3981ee-eb05-4061-82d9-94a7b3c9b08b admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:43.589522 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3981ee-eb05-4061-82d9-94a7b3c9b08b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:43.591250 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3981ee-eb05-4061-82d9-94a7b3c9b08b admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:43.609036 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1148/2305] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:57:43.613182 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3981ee-eb05-4061-82d9-94a7b3c9b08b admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:43.617773 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-9c3981ee-eb05-4061-82d9-94a7b3c9b08b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:43.648462 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3981ee-eb05-4061-82d9-94a7b3c9b08b admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:43.657270 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32630d-0f3d-4491-8c96-df81432846ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:43.659363 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32630d-0f3d-4491-8c96-df81432846ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:43.659884 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32630d-0f3d-4491-8c96-df81432846ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:43.660572 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32630d-0f3d-4491-8c96-df81432846ba admin admin] PATH_INFO: `/v3/projects/8b38e112c1784765bc38b2103c717cc0/users/d01a8b3b50ba4587a30d055eea326f11/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:43.671331 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf20e7-2ad1-4d61-9120-d9f10ad0500f admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:43.676807 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de679a8-9ec4-4fdf-9ea8-a48e9e4ddffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:43.679082 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de679a8-9ec4-4fdf-9ea8-a48e9e4ddffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:43.679641 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de679a8-9ec4-4fdf-9ea8-a48e9e4ddffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:43.680209 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de679a8-9ec4-4fdf-9ea8-a48e9e4ddffd admin admin] PATH_INFO: `/v3/users/9e3b643c1ef44f18b3785e9373adaa0c` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:43.681750 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de679a8-9ec4-4fdf-9ea8-a48e9e4ddffd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e3b643c1ef44f18b3785e9373adaa0c)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:43.683992 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de679a8-9ec4-4fdf-9ea8-a48e9e4ddffd admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:43.695195 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df32630d-0f3d-4491-8c96-df81432846ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b38e112c1784765bc38b2103c717cc0, user_id=d01a8b3b50ba4587a30d055eea326f11, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:43.699647 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df32630d-0f3d-4491-8c96-df81432846ba admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:43.719981 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1149/2306] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:57:43 2022] PUT /identity/v3/projects/8b38e112c1784765bc38b2103c717cc0/users/d01a8b3b50ba4587a30d055eea326f11/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 15:57:43.731250 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a37a8-ac5e-40bc-9541-8e009e768646 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:43.731590 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a37a8-ac5e-40bc-9541-8e009e768646 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:43.732004 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a37a8-ac5e-40bc-9541-8e009e768646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:43.808158 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-169a37a8-ac5e-40bc-9541-8e009e768646 None None] MFA Rules not processed for user `d01a8b3b50ba4587a30d055eea326f11`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:43.812948 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-9de679a8-9ec4-4fdf-9ea8-a48e9e4ddffd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e3b643c1ef44f18b3785e9373adaa0c'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:43.816116 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-169a37a8-ac5e-40bc-9541-8e009e768646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:43.848793 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-9de679a8-9ec4-4fdf-9ea8-a48e9e4ddffd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e3b643c1ef44f18b3785e9373adaa0c'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:43.851898 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-9de679a8-9ec4-4fdf-9ea8-a48e9e4ddffd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e3b643c1ef44f18b3785e9373adaa0c'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:43.889997 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-9de679a8-9ec4-4fdf-9ea8-a48e9e4ddffd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e3b643c1ef44f18b3785e9373adaa0c'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:43.891035 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-9de679a8-9ec4-4fdf-9ea8-a48e9e4ddffd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e3b643c1ef44f18b3785e9373adaa0c'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:43.937141 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1158/2307] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:57:43 2022] DELETE /identity/v3/users/9e3b643c1ef44f18b3785e9373adaa0c => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:44.001029 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:44.018216 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1150/2308] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:57:44.030518 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de679a8-9ec4-4fdf-9ea8-a48e9e4ddffd admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:44.032816 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-9de679a8-9ec4-4fdf-9ea8-a48e9e4ddffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:44.171791 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:44.187498 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de679a8-9ec4-4fdf-9ea8-a48e9e4ddffd admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:44.204361 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705201ba-6685-491b-b9b7-77de9b3fa746 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:44.205091 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705201ba-6685-491b-b9b7-77de9b3fa746 service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:44.214025 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705201ba-6685-491b-b9b7-77de9b3fa746 service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:44.215447 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705201ba-6685-491b-b9b7-77de9b3fa746 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:44.347053 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705201ba-6685-491b-b9b7-77de9b3fa746 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:44.353245 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705201ba-6685-491b-b9b7-77de9b3fa746 service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:44.371902 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1159/2309] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:57:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:57:44.748459 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a37a8-ac5e-40bc-9541-8e009e768646 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:44.750564 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-169a37a8-ac5e-40bc-9541-8e009e768646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:44.955286 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a37a8-ac5e-40bc-9541-8e009e768646 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:45.079798 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b8846-d21c-49c9-9191-78a6c956fcbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:45.079798 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b8846-d21c-49c9-9191-78a6c956fcbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:45.079798 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b8846-d21c-49c9-9191-78a6c956fcbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:45.080223 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b8846-d21c-49c9-9191-78a6c956fcbb admin admin] PATH_INFO: `/v3/projects/887c3ff7c81b47a2bcd3d597abb95c20` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:45.081256 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74b8846-d21c-49c9-9191-78a6c956fcbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=887c3ff7c81b47a2bcd3d597abb95c20)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:45.083259 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74b8846-d21c-49c9-9191-78a6c956fcbb admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:45.141905 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-f74b8846-d21c-49c9-9191-78a6c956fcbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '887c3ff7c81b47a2bcd3d597abb95c20', 'request_id': 'req-f74b8846-d21c-49c9-9191-78a6c956fcbb'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:45.148485 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-f74b8846-d21c-49c9-9191-78a6c956fcbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '887c3ff7c81b47a2bcd3d597abb95c20', 'request_id': 'req-f74b8846-d21c-49c9-9191-78a6c956fcbb'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:45.156921 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-f74b8846-d21c-49c9-9191-78a6c956fcbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '887c3ff7c81b47a2bcd3d597abb95c20', 'request_id': 'req-f74b8846-d21c-49c9-9191-78a6c956fcbb'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:45.175390 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-f74b8846-d21c-49c9-9191-78a6c956fcbb admin admin] The token cache is being invalidate because project 887c3ff7c81b47a2bcd3d597abb95c20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:57:45.175688 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-f74b8846-d21c-49c9-9191-78a6c956fcbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:45.176353 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-f74b8846-d21c-49c9-9191-78a6c956fcbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:57:45.182717 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1151/2310] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:57:44 2022] DELETE /identity/v3/projects/887c3ff7c81b47a2bcd3d597abb95c20 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:57:45.184862 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cda1ea-6457-43e0-8dd7-c2c127bb97ad None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:45.185654 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cda1ea-6457-43e0-8dd7-c2c127bb97ad None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:45.188530 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cda1ea-6457-43e0-8dd7-c2c127bb97ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:45.223573 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-29cda1ea-6457-43e0-8dd7-c2c127bb97ad None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:45.225322 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-29cda1ea-6457-43e0-8dd7-c2c127bb97ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:45.294341 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1160/2311] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:57:45.301400 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0840675-f024-4c62-b055-438f740aa07a None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:45.301697 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0840675-f024-4c62-b055-438f740aa07a None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:45.302053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0840675-f024-4c62-b055-438f740aa07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:45.324774 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-e0840675-f024-4c62-b055-438f740aa07a None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:45.326534 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-e0840675-f024-4c62-b055-438f740aa07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:45.337787 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1152/2312] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:57:45.342455 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cda1ea-6457-43e0-8dd7-c2c127bb97ad None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:45.356682 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cda1ea-6457-43e0-8dd7-c2c127bb97ad None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:45.361763 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b290a9-0b7b-4b36-9776-680683061225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:45.362543 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b290a9-0b7b-4b36-9776-680683061225 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:45.362829 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b290a9-0b7b-4b36-9776-680683061225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:45.363385 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b290a9-0b7b-4b36-9776-680683061225 admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:45.364094 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b290a9-0b7b-4b36-9776-680683061225 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:57:45.364399 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b290a9-0b7b-4b36-9776-680683061225 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:45.367159 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b290a9-0b7b-4b36-9776-680683061225 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:45.389745 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1161/2313] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 15:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:57:45.391748 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0840675-f024-4c62-b055-438f740aa07a None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:45.405078 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0840675-f024-4c62-b055-438f740aa07a None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:45.413845 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e78c5-e808-40f5-89b6-80a44b57388a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:45.414628 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e78c5-e808-40f5-89b6-80a44b57388a admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:45.414973 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e78c5-e808-40f5-89b6-80a44b57388a admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:45.415315 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e78c5-e808-40f5-89b6-80a44b57388a admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:45.416362 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e78c5-e808-40f5-89b6-80a44b57388a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:45.418396 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e78c5-e808-40f5-89b6-80a44b57388a admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:45.456464 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1153/2314] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:57:45 2022] POST /identity/v3/projects => generated 375 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:57:45.457681 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b290a9-0b7b-4b36-9776-680683061225 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:45.469626 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b290a9-0b7b-4b36-9776-680683061225 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:45.546068 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9840ca51-63f1-4c7c-b5e4-1adcff4e4e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:45.546902 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840ca51-63f1-4c7c-b5e4-1adcff4e4e84 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:45.547433 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840ca51-63f1-4c7c-b5e4-1adcff4e4e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:45.547637 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840ca51-63f1-4c7c-b5e4-1adcff4e4e84 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:45.548274 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9840ca51-63f1-4c7c-b5e4-1adcff4e4e84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:45.556549 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9840ca51-63f1-4c7c-b5e4-1adcff4e4e84 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:45.602235 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1162/2315] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:57:45 2022] POST /identity/v3/users => generated 288 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:57:45.604053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e78c5-e808-40f5-89b6-80a44b57388a admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:45.616483 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e78c5-e808-40f5-89b6-80a44b57388a admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:45.621179 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8328137-2826-48ea-bc4a-94d67c697c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:45.621935 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8328137-2826-48ea-bc4a-94d67c697c70 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:45.622371 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8328137-2826-48ea-bc4a-94d67c697c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:45.622749 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8328137-2826-48ea-bc4a-94d67c697c70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:45.624001 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8328137-2826-48ea-bc4a-94d67c697c70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:45.642110 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8328137-2826-48ea-bc4a-94d67c697c70 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:45.649021 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:45.672154 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1154/2316] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:57:45.672681 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9840ca51-63f1-4c7c-b5e4-1adcff4e4e84 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:45.689564 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9840ca51-63f1-4c7c-b5e4-1adcff4e4e84 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:45.696086 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c38e3-428c-43f9-8c6c-6f0dc94f4183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:45.696781 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c38e3-428c-43f9-8c6c-6f0dc94f4183 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:45.697139 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c38e3-428c-43f9-8c6c-6f0dc94f4183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:45.697489 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c38e3-428c-43f9-8c6c-6f0dc94f4183 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:45.698276 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193c38e3-428c-43f9-8c6c-6f0dc94f4183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:45.699956 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193c38e3-428c-43f9-8c6c-6f0dc94f4183 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:45.714261 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1163/2317] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:57:45.717722 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8328137-2826-48ea-bc4a-94d67c697c70 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:45.732678 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8328137-2826-48ea-bc4a-94d67c697c70 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:45.737809 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb567311-caea-418b-b9ac-d4023fc2bd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:45.738593 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb567311-caea-418b-b9ac-d4023fc2bd56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:45.738947 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb567311-caea-418b-b9ac-d4023fc2bd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:45.739291 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb567311-caea-418b-b9ac-d4023fc2bd56 admin admin] PATH_INFO: `/v3/projects/dee4f2f12c6b40c3ad4f13008c7ffce2/users/d84f2949525c447ea7ba862557cd6164/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:45.757989 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb567311-caea-418b-b9ac-d4023fc2bd56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dee4f2f12c6b40c3ad4f13008c7ffce2, user_id=d84f2949525c447ea7ba862557cd6164, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:45.761678 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb567311-caea-418b-b9ac-d4023fc2bd56 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:45.793162 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1155/2318] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:57:45 2022] PUT /identity/v3/projects/dee4f2f12c6b40c3ad4f13008c7ffce2/users/d84f2949525c447ea7ba862557cd6164/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 15:57:45.795039 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33267a19-01c6-4a0d-a2ff-44ab6bb04fb6 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:45.795553 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33267a19-01c6-4a0d-a2ff-44ab6bb04fb6 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:45.795904 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33267a19-01c6-4a0d-a2ff-44ab6bb04fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:45.811916 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:45.836461 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-33267a19-01c6-4a0d-a2ff-44ab6bb04fb6 None None] MFA Rules not processed for user `d84f2949525c447ea7ba862557cd6164`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:57:45.838424 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-33267a19-01c6-4a0d-a2ff-44ab6bb04fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:45.984872 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1164/2319] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:57:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:57:45.994476 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb567311-caea-418b-b9ac-d4023fc2bd56 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:57:45.997211 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-cb567311-caea-418b-b9ac-d4023fc2bd56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:57:46.114962 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb567311-caea-418b-b9ac-d4023fc2bd56 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:57:46.120870 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b741b16d-efaf-4610-9704-d84c12468802 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5753fea47f5944cd93dbea90fb9ad9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:57:46.121604 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741b16d-efaf-4610-9704-d84c12468802 service glance] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:57:46.122222 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741b16d-efaf-4610-9704-d84c12468802 service glance] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:57:46.122572 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741b16d-efaf-4610-9704-d84c12468802 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:57:46.139367 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b741b16d-efaf-4610-9704-d84c12468802 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:57:46.140834 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b741b16d-efaf-4610-9704-d84c12468802 service glance] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:57:46.153585 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1156/2320] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:57:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:57:55.960327 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=29 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:57:56.148770 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=37,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:01.988691 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76084bda-54d3-474a-9e87-a795a2977bd0 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:01.989164 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76084bda-54d3-474a-9e87-a795a2977bd0 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:01.989336 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76084bda-54d3-474a-9e87-a795a2977bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:02.008865 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-76084bda-54d3-474a-9e87-a795a2977bd0 None None] MFA Rules not processed for user `3e20e40a37df4898bfe692535e5e4f25`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:02.010043 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-76084bda-54d3-474a-9e87-a795a2977bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:02.067053 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1165/2321] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Sep 7 15:58:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 15:58:02.108726 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b741b16d-efaf-4610-9704-d84c12468802 service glance] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:02.110134 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b741b16d-efaf-4610-9704-d84c12468802 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:02.179999 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b741b16d-efaf-4610-9704-d84c12468802 service glance] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:02.185117 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437089f-77d4-4731-8f89-05326599155b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16c4b090a4aa4d56a90ccf090b9caba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:02.185743 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437089f-77d4-4731-8f89-05326599155b service swift] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:02.186097 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437089f-77d4-4731-8f89-05326599155b service swift] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:02.186412 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437089f-77d4-4731-8f89-05326599155b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:02.196233 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5437089f-77d4-4731-8f89-05326599155b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:02.197933 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5437089f-77d4-4731-8f89-05326599155b service swift] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:02.206804 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1157/2322] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Sep 7 15:58:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 15:58:02.869616 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e78ac0-4aef-4044-812e-fd0f1b7fad25 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:02.869904 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e78ac0-4aef-4044-812e-fd0f1b7fad25 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:02.870215 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e78ac0-4aef-4044-812e-fd0f1b7fad25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:02.891867 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-02e78ac0-4aef-4044-812e-fd0f1b7fad25 None None] MFA Rules not processed for user `3e20e40a37df4898bfe692535e5e4f25`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:02.893068 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-02e78ac0-4aef-4044-812e-fd0f1b7fad25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:02.917912 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1166/2323] 10.222.0.16 () {58 vars in 967 bytes} [Wed Sep 7 15:58:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:58:02.926421 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437089f-77d4-4731-8f89-05326599155b service swift] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:02.939467 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437089f-77d4-4731-8f89-05326599155b service swift] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:02.945426 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44bb31-e9d6-4a9d-8c41-944c82015fdc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16c4b090a4aa4d56a90ccf090b9caba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:02.946073 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44bb31-e9d6-4a9d-8c41-944c82015fdc service swift] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:02.946385 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44bb31-e9d6-4a9d-8c41-944c82015fdc service swift] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:02.946786 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44bb31-e9d6-4a9d-8c41-944c82015fdc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:02.955695 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f44bb31-e9d6-4a9d-8c41-944c82015fdc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:02.957269 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f44bb31-e9d6-4a9d-8c41-944c82015fdc service swift] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:02.966817 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1158/2324] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Sep 7 15:58:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 07 15:58:03.263287 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366cba62-6c68-4691-b5ae-54165eea5bce None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:03.263794 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366cba62-6c68-4691-b5ae-54165eea5bce None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:03.263877 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366cba62-6c68-4691-b5ae-54165eea5bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:03.283185 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-366cba62-6c68-4691-b5ae-54165eea5bce None None] MFA Rules not processed for user `3e20e40a37df4898bfe692535e5e4f25`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:03.284381 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-366cba62-6c68-4691-b5ae-54165eea5bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:03.291603 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1167/2325] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Sep 7 15:58:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:58:03.304237 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44bb31-e9d6-4a9d-8c41-944c82015fdc service swift] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:03.315147 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44bb31-e9d6-4a9d-8c41-944c82015fdc service swift] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:03.321049 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37d4f2-46d4-4c50-92a4-2dd204e63883 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16c4b090a4aa4d56a90ccf090b9caba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:03.321649 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37d4f2-46d4-4c50-92a4-2dd204e63883 service swift] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:03.321930 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37d4f2-46d4-4c50-92a4-2dd204e63883 service swift] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:03.322227 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37d4f2-46d4-4c50-92a4-2dd204e63883 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:03.332300 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f37d4f2-46d4-4c50-92a4-2dd204e63883 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:03.334279 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f37d4f2-46d4-4c50-92a4-2dd204e63883 service swift] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:03.343981 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1159/2326] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Sep 7 15:58:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 15:58:03.686693 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a81b2-0ece-49ff-9c8c-60862c846af5 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:03.686981 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a81b2-0ece-49ff-9c8c-60862c846af5 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:03.687249 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a81b2-0ece-49ff-9c8c-60862c846af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:03.710317 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-b90a81b2-0ece-49ff-9c8c-60862c846af5 None None] MFA Rules not processed for user `3e20e40a37df4898bfe692535e5e4f25`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:03.711625 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-b90a81b2-0ece-49ff-9c8c-60862c846af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:03.719025 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1168/2327] 10.222.0.16 () {58 vars in 967 bytes} [Wed Sep 7 15:58:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:58:03.731734 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37d4f2-46d4-4c50-92a4-2dd204e63883 service swift] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:03.744115 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37d4f2-46d4-4c50-92a4-2dd204e63883 service swift] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:03.749739 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a275de1-1721-47f4-a742-a2954a9bab1f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16c4b090a4aa4d56a90ccf090b9caba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:03.750405 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a275de1-1721-47f4-a742-a2954a9bab1f service swift] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:03.750685 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a275de1-1721-47f4-a742-a2954a9bab1f service swift] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:03.750957 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a275de1-1721-47f4-a742-a2954a9bab1f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:03.759514 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a275de1-1721-47f4-a742-a2954a9bab1f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:03.761084 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a275de1-1721-47f4-a742-a2954a9bab1f service swift] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:03.769084 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1160/2328] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Sep 7 15:58:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 15:58:05.933896 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a81b2-0ece-49ff-9c8c-60862c846af5 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:05.935754 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-b90a81b2-0ece-49ff-9c8c-60862c846af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:06.035166 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a81b2-0ece-49ff-9c8c-60862c846af5 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:06.042135 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c815364-03bb-468d-be29-006560499493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:06.045599 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c815364-03bb-468d-be29-006560499493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:06.046040 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c815364-03bb-468d-be29-006560499493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:06.046420 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c815364-03bb-468d-be29-006560499493 admin admin] PATH_INFO: `/v3/users/700416baff4c40b2b65cafebf7cb1904` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:06.049430 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c815364-03bb-468d-be29-006560499493 admin admin] RBAC: Authorizing `identity:delete_user(user_id=700416baff4c40b2b65cafebf7cb1904)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:06.050294 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c815364-03bb-468d-be29-006560499493 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:06.114679 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-6c815364-03bb-468d-be29-006560499493 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '700416baff4c40b2b65cafebf7cb1904'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:06.123389 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-6c815364-03bb-468d-be29-006560499493 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '700416baff4c40b2b65cafebf7cb1904'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:06.124208 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-6c815364-03bb-468d-be29-006560499493 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '700416baff4c40b2b65cafebf7cb1904'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:06.136819 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-6c815364-03bb-468d-be29-006560499493 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '700416baff4c40b2b65cafebf7cb1904'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:06.137861 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-6c815364-03bb-468d-be29-006560499493 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '700416baff4c40b2b65cafebf7cb1904'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:06.155835 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1169/2329] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:58:05 2022] DELETE /identity/v3/users/700416baff4c40b2b65cafebf7cb1904 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:58:06.160475 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde4d5f-caa5-4806-ba7e-a071a4074089 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:06.161041 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde4d5f-caa5-4806-ba7e-a071a4074089 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:06.161346 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde4d5f-caa5-4806-ba7e-a071a4074089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:06.322734 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-ccde4d5f-caa5-4806-ba7e-a071a4074089 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:06.324163 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-ccde4d5f-caa5-4806-ba7e-a071a4074089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:06.407915 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1161/2330] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:58:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:58:06.423079 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c815364-03bb-468d-be29-006560499493 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:06.424489 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-6c815364-03bb-468d-be29-006560499493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:06.431344 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:06.491154 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c815364-03bb-468d-be29-006560499493 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:06.495335 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297edb2-ab53-4737-a9aa-c635d12aec2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:06.495952 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297edb2-ab53-4737-a9aa-c635d12aec2e service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:06.496232 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297edb2-ab53-4737-a9aa-c635d12aec2e service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:06.496508 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297edb2-ab53-4737-a9aa-c635d12aec2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:06.506092 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9297edb2-ab53-4737-a9aa-c635d12aec2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:06.507640 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9297edb2-ab53-4737-a9aa-c635d12aec2e service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:06.517457 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1170/2331] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:58:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:58:06.684389 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde4d5f-caa5-4806-ba7e-a071a4074089 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:06.686363 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-ccde4d5f-caa5-4806-ba7e-a071a4074089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:06.707655 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde4d5f-caa5-4806-ba7e-a071a4074089 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:06.770402 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7057fd0-84e9-4a39-8eb7-f71acfb75f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:06.772994 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7057fd0-84e9-4a39-8eb7-f71acfb75f01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:06.773374 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7057fd0-84e9-4a39-8eb7-f71acfb75f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:06.775659 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7057fd0-84e9-4a39-8eb7-f71acfb75f01 admin admin] PATH_INFO: `/v3/projects/c1d4e6748d8d4e8b986e6a592589a250` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:06.777150 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7057fd0-84e9-4a39-8eb7-f71acfb75f01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1d4e6748d8d4e8b986e6a592589a250)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:06.782773 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7057fd0-84e9-4a39-8eb7-f71acfb75f01 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:06.868176 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:06.870285 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-f7057fd0-84e9-4a39-8eb7-f71acfb75f01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1d4e6748d8d4e8b986e6a592589a250', 'request_id': 'req-f7057fd0-84e9-4a39-8eb7-f71acfb75f01'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:06.882624 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-f7057fd0-84e9-4a39-8eb7-f71acfb75f01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1d4e6748d8d4e8b986e6a592589a250', 'request_id': 'req-f7057fd0-84e9-4a39-8eb7-f71acfb75f01'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:06.892538 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-f7057fd0-84e9-4a39-8eb7-f71acfb75f01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1d4e6748d8d4e8b986e6a592589a250', 'request_id': 'req-f7057fd0-84e9-4a39-8eb7-f71acfb75f01'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:06.914510 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-f7057fd0-84e9-4a39-8eb7-f71acfb75f01 admin admin] The token cache is being invalidate because project c1d4e6748d8d4e8b986e6a592589a250 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:58:06.915109 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-f7057fd0-84e9-4a39-8eb7-f71acfb75f01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:06.915771 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-f7057fd0-84e9-4a39-8eb7-f71acfb75f01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:06.918313 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1162/2332] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:58:06 2022] DELETE /identity/v3/projects/c1d4e6748d8d4e8b986e6a592589a250 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:58:11.314358 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63ad17-0b7a-4e23-99ca-99d6f622d5e2 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:11.314901 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63ad17-0b7a-4e23-99ca-99d6f622d5e2 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:11.315043 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63ad17-0b7a-4e23-99ca-99d6f622d5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:11.337077 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-5a63ad17-0b7a-4e23-99ca-99d6f622d5e2 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:11.338332 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-5a63ad17-0b7a-4e23-99ca-99d6f622d5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:11.422979 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1171/2333] 10.222.0.26 () {58 vars in 1016 bytes} [Wed Sep 7 15:58:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:58:11.437651 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7057fd0-84e9-4a39-8eb7-f71acfb75f01 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:11.439151 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-f7057fd0-84e9-4a39-8eb7-f71acfb75f01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:11.530452 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7057fd0-84e9-4a39-8eb7-f71acfb75f01 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:11.536516 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcedcfc8-68eb-4214-9431-25982bf1628d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:11.538718 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcedcfc8-68eb-4214-9431-25982bf1628d service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:11.538718 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcedcfc8-68eb-4214-9431-25982bf1628d service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:11.538718 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcedcfc8-68eb-4214-9431-25982bf1628d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:11.547347 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcedcfc8-68eb-4214-9431-25982bf1628d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:11.549238 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcedcfc8-68eb-4214-9431-25982bf1628d service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:11.566370 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1163/2334] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:58:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:58:11.757073 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a63ad17-0b7a-4e23-99ca-99d6f622d5e2 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:11.758874 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-5a63ad17-0b7a-4e23-99ca-99d6f622d5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:11.775013 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a63ad17-0b7a-4e23-99ca-99d6f622d5e2 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:11.783498 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4c613-dad7-4d8d-a937-42537be2197c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:11.784324 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4c613-dad7-4d8d-a937-42537be2197c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:11.784638 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4c613-dad7-4d8d-a937-42537be2197c admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:11.784925 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4c613-dad7-4d8d-a937-42537be2197c admin admin] PATH_INFO: `/v3/users/d84f2949525c447ea7ba862557cd6164` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:11.786110 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b4c613-dad7-4d8d-a937-42537be2197c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d84f2949525c447ea7ba862557cd6164)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:11.788895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b4c613-dad7-4d8d-a937-42537be2197c admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:11.876369 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-68b4c613-dad7-4d8d-a937-42537be2197c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd84f2949525c447ea7ba862557cd6164'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:11.888594 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-68b4c613-dad7-4d8d-a937-42537be2197c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd84f2949525c447ea7ba862557cd6164'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:11.889376 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-68b4c613-dad7-4d8d-a937-42537be2197c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd84f2949525c447ea7ba862557cd6164'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:11.909038 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-68b4c613-dad7-4d8d-a937-42537be2197c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd84f2949525c447ea7ba862557cd6164'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:11.909836 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-68b4c613-dad7-4d8d-a937-42537be2197c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd84f2949525c447ea7ba862557cd6164'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:11.929111 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1172/2335] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:58:11 2022] DELETE /identity/v3/users/d84f2949525c447ea7ba862557cd6164 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:58:11.933458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232568e7-058a-48c9-a9b6-078183f99fa9 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:11.933745 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232568e7-058a-48c9-a9b6-078183f99fa9 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:11.934020 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232568e7-058a-48c9-a9b6-078183f99fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:11.964977 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-232568e7-058a-48c9-a9b6-078183f99fa9 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:11.966203 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-232568e7-058a-48c9-a9b6-078183f99fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:12.038423 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1164/2336] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:58:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:58:12.049335 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4c613-dad7-4d8d-a937-42537be2197c admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:12.051047 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-68b4c613-dad7-4d8d-a937-42537be2197c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:12.075266 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:12.118036 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4c613-dad7-4d8d-a937-42537be2197c admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:12.122059 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc486082-24a0-4cae-b0ff-071092db6218 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:12.122710 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc486082-24a0-4cae-b0ff-071092db6218 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:12.122985 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc486082-24a0-4cae-b0ff-071092db6218 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:12.123253 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc486082-24a0-4cae-b0ff-071092db6218 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:12.133787 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc486082-24a0-4cae-b0ff-071092db6218 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:12.135178 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc486082-24a0-4cae-b0ff-071092db6218 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:12.145196 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1173/2337] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:58:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:58:12.305230 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5548a-ad62-453f-9cdc-27eaafd0d316 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:12.305523 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5548a-ad62-453f-9cdc-27eaafd0d316 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:12.305793 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5548a-ad62-453f-9cdc-27eaafd0d316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:12.328266 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-e4d5548a-ad62-453f-9cdc-27eaafd0d316 None None] MFA Rules not processed for user `d7738e76f24f48d4a66a9237ddbc939e`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:12.329488 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-e4d5548a-ad62-453f-9cdc-27eaafd0d316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:12.387207 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1165/2338] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:58:12 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 15:58:12.453875 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc486082-24a0-4cae-b0ff-071092db6218 service neutron] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:12.456366 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-fc486082-24a0-4cae-b0ff-071092db6218 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:12.475937 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc486082-24a0-4cae-b0ff-071092db6218 service neutron] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:12.491389 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a71fbb-7d80-4cc5-b174-ce40cff1dede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:12.492347 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a71fbb-7d80-4cc5-b174-ce40cff1dede admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:12.492637 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a71fbb-7d80-4cc5-b174-ce40cff1dede admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:12.492916 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a71fbb-7d80-4cc5-b174-ce40cff1dede admin admin] PATH_INFO: `/v3/projects/dee4f2f12c6b40c3ad4f13008c7ffce2` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:12.494271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a71fbb-7d80-4cc5-b174-ce40cff1dede admin admin] RBAC: Authorizing `identity:delete_project(project_id=dee4f2f12c6b40c3ad4f13008c7ffce2)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:12.500673 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a71fbb-7d80-4cc5-b174-ce40cff1dede admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:12.555330 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-c8a71fbb-7d80-4cc5-b174-ce40cff1dede admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dee4f2f12c6b40c3ad4f13008c7ffce2', 'request_id': 'req-c8a71fbb-7d80-4cc5-b174-ce40cff1dede'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:12.563159 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-c8a71fbb-7d80-4cc5-b174-ce40cff1dede admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dee4f2f12c6b40c3ad4f13008c7ffce2', 'request_id': 'req-c8a71fbb-7d80-4cc5-b174-ce40cff1dede'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:12.571843 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-c8a71fbb-7d80-4cc5-b174-ce40cff1dede admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dee4f2f12c6b40c3ad4f13008c7ffce2', 'request_id': 'req-c8a71fbb-7d80-4cc5-b174-ce40cff1dede'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:12.588020 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-c8a71fbb-7d80-4cc5-b174-ce40cff1dede admin admin] The token cache is being invalidate because project dee4f2f12c6b40c3ad4f13008c7ffce2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:58:12.588320 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-c8a71fbb-7d80-4cc5-b174-ce40cff1dede admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:12.588946 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-c8a71fbb-7d80-4cc5-b174-ce40cff1dede admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:12.591411 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1174/2339] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:58:12 2022] DELETE /identity/v3/projects/dee4f2f12c6b40c3ad4f13008c7ffce2 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:58:12.596290 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3b716-c7aa-4fa1-82ff-b50df7f00a00 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:12.597138 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3b716-c7aa-4fa1-82ff-b50df7f00a00 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:12.597580 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3b716-c7aa-4fa1-82ff-b50df7f00a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:12.608223 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:12.623331 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-d6e3b716-c7aa-4fa1-82ff-b50df7f00a00 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:12.624638 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-d6e3b716-c7aa-4fa1-82ff-b50df7f00a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:12.694918 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1166/2340] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:58:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:58:12.705475 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ef2e1-c6b7-4a5d-b091-e23260ae14e4 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:12.705760 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ef2e1-c6b7-4a5d-b091-e23260ae14e4 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:12.706034 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ef2e1-c6b7-4a5d-b091-e23260ae14e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:12.727173 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-d55ef2e1-c6b7-4a5d-b091-e23260ae14e4 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:12.728744 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-d55ef2e1-c6b7-4a5d-b091-e23260ae14e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:12.737153 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1175/2341] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:58:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:58:12.741446 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e3b716-c7aa-4fa1-82ff-b50df7f00a00 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:12.752489 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e3b716-c7aa-4fa1-82ff-b50df7f00a00 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:12.757545 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9793d7a6-6952-49d4-8c07-b56dc6202b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:12.758254 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793d7a6-6952-49d4-8c07-b56dc6202b22 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:12.758605 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793d7a6-6952-49d4-8c07-b56dc6202b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:12.758953 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793d7a6-6952-49d4-8c07-b56dc6202b22 admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:12.759683 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9793d7a6-6952-49d4-8c07-b56dc6202b22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:12.760055 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9793d7a6-6952-49d4-8c07-b56dc6202b22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:12.761764 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9793d7a6-6952-49d4-8c07-b56dc6202b22 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:12.774789 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1167/2342] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 15:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:12.779227 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ef2e1-c6b7-4a5d-b091-e23260ae14e4 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:12.789924 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ef2e1-c6b7-4a5d-b091-e23260ae14e4 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:12.794823 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1774ec-f09a-46c7-b5cc-a8720dc1e756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:12.795469 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1774ec-f09a-46c7-b5cc-a8720dc1e756 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:12.795743 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1774ec-f09a-46c7-b5cc-a8720dc1e756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:12.796012 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1774ec-f09a-46c7-b5cc-a8720dc1e756 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:12.796644 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1774ec-f09a-46c7-b5cc-a8720dc1e756 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:12.798572 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1774ec-f09a-46c7-b5cc-a8720dc1e756 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:12.827964 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1176/2343] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:58:12 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 15:58:12.831867 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9793d7a6-6952-49d4-8c07-b56dc6202b22 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:12.842621 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9793d7a6-6952-49d4-8c07-b56dc6202b22 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:12.919974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349f2d4-d790-48e6-8305-7acaf9d47f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:12.921031 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349f2d4-d790-48e6-8305-7acaf9d47f18 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:12.921031 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349f2d4-d790-48e6-8305-7acaf9d47f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:12.921282 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349f2d4-d790-48e6-8305-7acaf9d47f18 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:12.921863 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7349f2d4-d790-48e6-8305-7acaf9d47f18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:12.925885 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7349f2d4-d790-48e6-8305-7acaf9d47f18 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:12.959938 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1168/2344] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:58:12 2022] POST /identity/v3/users => generated 287 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 15:58:12.961220 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1774ec-f09a-46c7-b5cc-a8720dc1e756 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:12.975329 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1774ec-f09a-46c7-b5cc-a8720dc1e756 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:12.981349 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9cf04-06e7-4bc7-8686-619176916841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:12.982063 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9cf04-06e7-4bc7-8686-619176916841 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:12.982728 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9cf04-06e7-4bc7-8686-619176916841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:12.983108 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9cf04-06e7-4bc7-8686-619176916841 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:12.983871 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f9cf04-06e7-4bc7-8686-619176916841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:12.986308 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f9cf04-06e7-4bc7-8686-619176916841 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:13.001082 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1177/2345] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:58:13.002330 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349f2d4-d790-48e6-8305-7acaf9d47f18 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:13.025770 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349f2d4-d790-48e6-8305-7acaf9d47f18 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:13.040267 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8ce50-7980-4919-a7ae-641406524390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:13.041876 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8ce50-7980-4919-a7ae-641406524390 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:13.042202 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8ce50-7980-4919-a7ae-641406524390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:13.043431 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8ce50-7980-4919-a7ae-641406524390 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:13.043814 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8ce50-7980-4919-a7ae-641406524390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:13.049012 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8ce50-7980-4919-a7ae-641406524390 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:13.062098 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1169/2346] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:58:13.066170 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9cf04-06e7-4bc7-8686-619176916841 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:13.081666 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9cf04-06e7-4bc7-8686-619176916841 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:13.087091 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f07d7-d7dc-45d6-8f2b-2f1bff94d985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:13.088023 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f07d7-d7dc-45d6-8f2b-2f1bff94d985 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:13.088023 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f07d7-d7dc-45d6-8f2b-2f1bff94d985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:13.088334 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f07d7-d7dc-45d6-8f2b-2f1bff94d985 admin admin] PATH_INFO: `/v3/projects/22415449053842e7b970767d20b11fb5/users/f16f7d73136344be8e604c5734b57b07/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:13.111434 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f07d7-d7dc-45d6-8f2b-2f1bff94d985 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22415449053842e7b970767d20b11fb5, user_id=f16f7d73136344be8e604c5734b57b07, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:13.114143 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f07d7-d7dc-45d6-8f2b-2f1bff94d985 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:13.131118 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1178/2347] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:58:13 2022] PUT /identity/v3/projects/22415449053842e7b970767d20b11fb5/users/f16f7d73136344be8e604c5734b57b07/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 15:58:13.143093 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a0ab1-986c-4df6-baad-5a3aa28bddd7 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:13.143629 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a0ab1-986c-4df6-baad-5a3aa28bddd7 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:13.143912 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a0ab1-986c-4df6-baad-5a3aa28bddd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:13.174368 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-836a0ab1-986c-4df6-baad-5a3aa28bddd7 None None] MFA Rules not processed for user `f16f7d73136344be8e604c5734b57b07`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:13.175643 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-836a0ab1-986c-4df6-baad-5a3aa28bddd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:13.259001 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:13.262417 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1170/2348] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:58:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:58:13.265529 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f07d7-d7dc-45d6-8f2b-2f1bff94d985 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:13.324965 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:13.349960 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f07d7-d7dc-45d6-8f2b-2f1bff94d985 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:13.355333 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857315e-6c1b-48c2-b78e-3e55e88c5fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:13.356036 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857315e-6c1b-48c2-b78e-3e55e88c5fda admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:13.356403 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857315e-6c1b-48c2-b78e-3e55e88c5fda admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:13.356749 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857315e-6c1b-48c2-b78e-3e55e88c5fda admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:13.357979 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1857315e-6c1b-48c2-b78e-3e55e88c5fda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:13.360724 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1857315e-6c1b-48c2-b78e-3e55e88c5fda admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:13.394648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1179/2349] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:58:13 2022] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:58:13.398736 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a0ab1-986c-4df6-baad-5a3aa28bddd7 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:13.410698 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a0ab1-986c-4df6-baad-5a3aa28bddd7 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:13.483747 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389e9e6-74a2-432b-acd0-2890ff1013c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:13.484152 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389e9e6-74a2-432b-acd0-2890ff1013c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:13.484564 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389e9e6-74a2-432b-acd0-2890ff1013c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:13.484888 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389e9e6-74a2-432b-acd0-2890ff1013c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:13.486217 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a389e9e6-74a2-432b-acd0-2890ff1013c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:13.488078 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a389e9e6-74a2-432b-acd0-2890ff1013c4 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:13.520502 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1171/2350] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:58:13 2022] POST /identity/v3/users => generated 293 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 15:58:13.522656 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857315e-6c1b-48c2-b78e-3e55e88c5fda admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:13.538556 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857315e-6c1b-48c2-b78e-3e55e88c5fda admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:13.544878 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942edefa-b078-4d87-9252-2aef3eb09a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:13.545787 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942edefa-b078-4d87-9252-2aef3eb09a1c admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:13.546808 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942edefa-b078-4d87-9252-2aef3eb09a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:13.547304 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942edefa-b078-4d87-9252-2aef3eb09a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:13.548142 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942edefa-b078-4d87-9252-2aef3eb09a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:13.550706 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942edefa-b078-4d87-9252-2aef3eb09a1c admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:13.567479 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1180/2351] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:58:13.572265 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389e9e6-74a2-432b-acd0-2890ff1013c4 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:13.592570 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389e9e6-74a2-432b-acd0-2890ff1013c4 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:13.602949 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92c4a7-e6cb-4ea3-abc6-19e79fe67fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:13.603790 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92c4a7-e6cb-4ea3-abc6-19e79fe67fb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:13.604077 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92c4a7-e6cb-4ea3-abc6-19e79fe67fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:13.604535 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92c4a7-e6cb-4ea3-abc6-19e79fe67fb3 admin admin] PATH_INFO: `/v3/projects/377548cca74546639d31d538aeec6fa7/users/405c4770b61a48cca2d736bd50eac959/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:13.626354 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc92c4a7-e6cb-4ea3-abc6-19e79fe67fb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=377548cca74546639d31d538aeec6fa7, user_id=405c4770b61a48cca2d736bd50eac959, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:13.632621 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc92c4a7-e6cb-4ea3-abc6-19e79fe67fb3 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:13.650240 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1172/2352] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:58:13 2022] PUT /identity/v3/projects/377548cca74546639d31d538aeec6fa7/users/405c4770b61a48cca2d736bd50eac959/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:58:13.653962 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942edefa-b078-4d87-9252-2aef3eb09a1c admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:13.668481 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942edefa-b078-4d87-9252-2aef3eb09a1c admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:13.737945 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e983ee0-76d3-429c-b248-8081f3d1d480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:13.739209 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e983ee0-76d3-429c-b248-8081f3d1d480 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:13.739596 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e983ee0-76d3-429c-b248-8081f3d1d480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:13.739998 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e983ee0-76d3-429c-b248-8081f3d1d480 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:13.740752 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e983ee0-76d3-429c-b248-8081f3d1d480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:13.742513 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e983ee0-76d3-429c-b248-8081f3d1d480 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:13.758428 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1181/2353] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:58:13.759270 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92c4a7-e6cb-4ea3-abc6-19e79fe67fb3 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:13.773568 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92c4a7-e6cb-4ea3-abc6-19e79fe67fb3 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:13.779161 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4d278-9701-42d1-804e-ece696824870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:13.780020 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4d278-9701-42d1-804e-ece696824870 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:13.780489 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4d278-9701-42d1-804e-ece696824870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:13.780905 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4d278-9701-42d1-804e-ece696824870 admin admin] PATH_INFO: `/v3/projects/377548cca74546639d31d538aeec6fa7/users/405c4770b61a48cca2d736bd50eac959/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:13.783251 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be4d278-9701-42d1-804e-ece696824870 admin admin] RBAC: Authorizing `identity:create_grant(project_id=377548cca74546639d31d538aeec6fa7, user_id=405c4770b61a48cca2d736bd50eac959, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:13.786419 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be4d278-9701-42d1-804e-ece696824870 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:13.800686 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1173/2354] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:58:13 2022] PUT /identity/v3/projects/377548cca74546639d31d538aeec6fa7/users/405c4770b61a48cca2d736bd50eac959/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 15:58:13.812890 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd95545-2cde-47fa-9752-bbb340456899 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:13.812890 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd95545-2cde-47fa-9752-bbb340456899 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:13.813134 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd95545-2cde-47fa-9752-bbb340456899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:13.844551 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-7bd95545-2cde-47fa-9752-bbb340456899 None None] MFA Rules not processed for user `405c4770b61a48cca2d736bd50eac959`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:13.845933 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-7bd95545-2cde-47fa-9752-bbb340456899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:13.924691 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1182/2355] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:58:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:58:13.936373 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4d278-9701-42d1-804e-ece696824870 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:13.938100 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-5be4d278-9701-42d1-804e-ece696824870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:14.003274 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4d278-9701-42d1-804e-ece696824870 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:14.008531 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea0ef98-250b-42a9-b82b-96c5623a3b8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:14.009452 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0ef98-250b-42a9-b82b-96c5623a3b8f service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:14.009863 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0ef98-250b-42a9-b82b-96c5623a3b8f service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:14.010337 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0ef98-250b-42a9-b82b-96c5623a3b8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:14.093920 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea0ef98-250b-42a9-b82b-96c5623a3b8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:14.095421 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea0ef98-250b-42a9-b82b-96c5623a3b8f service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:14.104692 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1174/2356] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:58:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:58:14.429472 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7d054-6b6d-4d83-b8a3-24217b768350 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:14.429792 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7d054-6b6d-4d83-b8a3-24217b768350 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:14.430076 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7d054-6b6d-4d83-b8a3-24217b768350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:14.456246 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-46b7d054-6b6d-4d83-b8a3-24217b768350 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:14.458081 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-46b7d054-6b6d-4d83-b8a3-24217b768350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:14.502573 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:14.538916 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1183/2357] 10.222.0.26 () {58 vars in 1016 bytes} [Wed Sep 7 15:58:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:58:14.563737 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea0ef98-250b-42a9-b82b-96c5623a3b8f service cinder] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:14.565236 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-eea0ef98-250b-42a9-b82b-96c5623a3b8f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:14.576118 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:14.647080 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea0ef98-250b-42a9-b82b-96c5623a3b8f service cinder] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:14.654664 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a7c54-3f55-4748-89d8-4f4ace415b6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:14.655276 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a7c54-3f55-4748-89d8-4f4ace415b6c service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:14.655558 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a7c54-3f55-4748-89d8-4f4ace415b6c service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:14.655833 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a7c54-3f55-4748-89d8-4f4ace415b6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:14.665160 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117a7c54-3f55-4748-89d8-4f4ace415b6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:14.667190 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117a7c54-3f55-4748-89d8-4f4ace415b6c service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:14.678598 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1175/2358] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:58:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:58:16.814411 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7d054-6b6d-4d83-b8a3-24217b768350 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:16.821115 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7d054-6b6d-4d83-b8a3-24217b768350 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:16.826140 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b28a7b-2897-4da2-82a6-3bea05377907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:16.826922 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b28a7b-2897-4da2-82a6-3bea05377907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:16.827224 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b28a7b-2897-4da2-82a6-3bea05377907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:16.827625 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b28a7b-2897-4da2-82a6-3bea05377907 admin admin] PATH_INFO: `/v3/users/f16f7d73136344be8e604c5734b57b07` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:16.828833 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b28a7b-2897-4da2-82a6-3bea05377907 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f16f7d73136344be8e604c5734b57b07)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:16.830982 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b28a7b-2897-4da2-82a6-3bea05377907 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:16.894870 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-42b28a7b-2897-4da2-82a6-3bea05377907 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f16f7d73136344be8e604c5734b57b07'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:16.903498 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-42b28a7b-2897-4da2-82a6-3bea05377907 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f16f7d73136344be8e604c5734b57b07'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:16.904191 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-42b28a7b-2897-4da2-82a6-3bea05377907 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f16f7d73136344be8e604c5734b57b07'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:16.918091 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-42b28a7b-2897-4da2-82a6-3bea05377907 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f16f7d73136344be8e604c5734b57b07'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:16.918813 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-42b28a7b-2897-4da2-82a6-3bea05377907 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f16f7d73136344be8e604c5734b57b07'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:16.932115 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1184/2359] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:58:16 2022] DELETE /identity/v3/users/f16f7d73136344be8e604c5734b57b07 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:58:16.937046 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d97b8-8f2f-4ef7-ab37-86f4faf1a156 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:16.938061 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d97b8-8f2f-4ef7-ab37-86f4faf1a156 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:16.938569 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d97b8-8f2f-4ef7-ab37-86f4faf1a156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:16.958841 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-bf8d97b8-8f2f-4ef7-ab37-86f4faf1a156 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:16.960242 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-bf8d97b8-8f2f-4ef7-ab37-86f4faf1a156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:17.031235 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1176/2360] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:58:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:58:17.049384 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b28a7b-2897-4da2-82a6-3bea05377907 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:17.051384 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-42b28a7b-2897-4da2-82a6-3bea05377907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:17.129790 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b28a7b-2897-4da2-82a6-3bea05377907 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:17.134397 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a9a24c-df1e-4580-9708-d75c9aaa28ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:17.135024 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9a24c-df1e-4580-9708-d75c9aaa28ae service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:17.135374 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9a24c-df1e-4580-9708-d75c9aaa28ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:17.135655 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9a24c-df1e-4580-9708-d75c9aaa28ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:17.148062 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a9a24c-df1e-4580-9708-d75c9aaa28ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:17.150691 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a9a24c-df1e-4580-9708-d75c9aaa28ae service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:17.165742 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1185/2361] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:58:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:58:17.524071 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d97b8-8f2f-4ef7-ab37-86f4faf1a156 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:17.525600 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-bf8d97b8-8f2f-4ef7-ab37-86f4faf1a156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:17.542516 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d97b8-8f2f-4ef7-ab37-86f4faf1a156 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:17.550623 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d0a5d-890c-4ad8-8c21-a809ac1ec79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:17.551496 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d0a5d-890c-4ad8-8c21-a809ac1ec79d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:17.552506 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d0a5d-890c-4ad8-8c21-a809ac1ec79d admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:17.553972 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d0a5d-890c-4ad8-8c21-a809ac1ec79d admin admin] PATH_INFO: `/v3/projects/22415449053842e7b970767d20b11fb5` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:17.555893 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471d0a5d-890c-4ad8-8c21-a809ac1ec79d admin admin] RBAC: Authorizing `identity:delete_project(project_id=22415449053842e7b970767d20b11fb5)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:17.560135 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471d0a5d-890c-4ad8-8c21-a809ac1ec79d admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:17.645475 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-471d0a5d-890c-4ad8-8c21-a809ac1ec79d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22415449053842e7b970767d20b11fb5', 'request_id': 'req-471d0a5d-890c-4ad8-8c21-a809ac1ec79d'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:17.657417 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-471d0a5d-890c-4ad8-8c21-a809ac1ec79d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22415449053842e7b970767d20b11fb5', 'request_id': 'req-471d0a5d-890c-4ad8-8c21-a809ac1ec79d'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:17.666790 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-471d0a5d-890c-4ad8-8c21-a809ac1ec79d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22415449053842e7b970767d20b11fb5', 'request_id': 'req-471d0a5d-890c-4ad8-8c21-a809ac1ec79d'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:17.683480 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-471d0a5d-890c-4ad8-8c21-a809ac1ec79d admin admin] The token cache is being invalidate because project 22415449053842e7b970767d20b11fb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:58:17.683775 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-471d0a5d-890c-4ad8-8c21-a809ac1ec79d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:17.687065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-471d0a5d-890c-4ad8-8c21-a809ac1ec79d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:17.690222 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1177/2362] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:58:17 2022] DELETE /identity/v3/projects/22415449053842e7b970767d20b11fb5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:58:17.696129 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a9a24c-df1e-4580-9708-d75c9aaa28ae service neutron] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:17.708264 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a9a24c-df1e-4580-9708-d75c9aaa28ae service neutron] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:17.773816 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:17.781862 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ba00d-c061-46e9-8eef-f7b2f5e8fc91 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:17.782274 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ba00d-c061-46e9-8eef-f7b2f5e8fc91 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:17.783073 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ba00d-c061-46e9-8eef-f7b2f5e8fc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:17.792050 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea198f2-bb47-47e7-8b5e-bac2f074452c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:17.792736 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea198f2-bb47-47e7-8b5e-bac2f074452c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:17.793009 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea198f2-bb47-47e7-8b5e-bac2f074452c admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:17.793270 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea198f2-bb47-47e7-8b5e-bac2f074452c admin admin] PATH_INFO: `/v3/users/405c4770b61a48cca2d736bd50eac959` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:17.794495 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea198f2-bb47-47e7-8b5e-bac2f074452c admin admin] RBAC: Authorizing `identity:delete_user(user_id=405c4770b61a48cca2d736bd50eac959)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:17.796889 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea198f2-bb47-47e7-8b5e-bac2f074452c admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:17.817561 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-d50ba00d-c061-46e9-8eef-f7b2f5e8fc91 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:17.820181 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-d50ba00d-c061-46e9-8eef-f7b2f5e8fc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:17.831413 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1178/2363] 10.222.0.26 () {58 vars in 1016 bytes} [Wed Sep 7 15:58:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:58:17.859456 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ba00d-c061-46e9-8eef-f7b2f5e8fc91 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:17.863171 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-d50ba00d-c061-46e9-8eef-f7b2f5e8fc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:17.881358 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:17.904184 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-9ea198f2-bb47-47e7-8b5e-bac2f074452c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '405c4770b61a48cca2d736bd50eac959'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:17.926549 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-9ea198f2-bb47-47e7-8b5e-bac2f074452c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '405c4770b61a48cca2d736bd50eac959'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:17.927434 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-9ea198f2-bb47-47e7-8b5e-bac2f074452c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '405c4770b61a48cca2d736bd50eac959'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:17.947500 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-9ea198f2-bb47-47e7-8b5e-bac2f074452c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '405c4770b61a48cca2d736bd50eac959'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:17.948456 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-9ea198f2-bb47-47e7-8b5e-bac2f074452c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '405c4770b61a48cca2d736bd50eac959'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:17.980209 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1186/2364] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:58:17 2022] DELETE /identity/v3/users/405c4770b61a48cca2d736bd50eac959 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:58:17.990665 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ba00d-c061-46e9-8eef-f7b2f5e8fc91 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:18.092012 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b2979b-408c-4504-8fc9-03bdfb853552 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:18.092637 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b2979b-408c-4504-8fc9-03bdfb853552 service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:18.092917 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b2979b-408c-4504-8fc9-03bdfb853552 service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:18.093191 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b2979b-408c-4504-8fc9-03bdfb853552 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:18.095046 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b2b2979b-408c-4504-8fc9-03bdfb853552 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:18.169771 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b2979b-408c-4504-8fc9-03bdfb853552 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:18.171297 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b2979b-408c-4504-8fc9-03bdfb853552 service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:18.183534 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1179/2365] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:58:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 15:58:18.481509 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea198f2-bb47-47e7-8b5e-bac2f074452c admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:18.483820 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-9ea198f2-bb47-47e7-8b5e-bac2f074452c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:18.501122 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea198f2-bb47-47e7-8b5e-bac2f074452c admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:18.506911 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf0378-a6f5-4947-90b0-2d999c66b9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:18.507544 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf0378-a6f5-4947-90b0-2d999c66b9ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:18.507895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf0378-a6f5-4947-90b0-2d999c66b9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:18.508273 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf0378-a6f5-4947-90b0-2d999c66b9ac admin admin] PATH_INFO: `/v3/projects/377548cca74546639d31d538aeec6fa7` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:18.509609 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cf0378-a6f5-4947-90b0-2d999c66b9ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=377548cca74546639d31d538aeec6fa7)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:18.511755 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cf0378-a6f5-4947-90b0-2d999c66b9ac admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:18.566053 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-14cf0378-a6f5-4947-90b0-2d999c66b9ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '377548cca74546639d31d538aeec6fa7', 'request_id': 'req-14cf0378-a6f5-4947-90b0-2d999c66b9ac'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:18.572328 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-14cf0378-a6f5-4947-90b0-2d999c66b9ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '377548cca74546639d31d538aeec6fa7', 'request_id': 'req-14cf0378-a6f5-4947-90b0-2d999c66b9ac'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:18.579441 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-14cf0378-a6f5-4947-90b0-2d999c66b9ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '377548cca74546639d31d538aeec6fa7', 'request_id': 'req-14cf0378-a6f5-4947-90b0-2d999c66b9ac'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:18.592850 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-14cf0378-a6f5-4947-90b0-2d999c66b9ac admin admin] The token cache is being invalidate because project 377548cca74546639d31d538aeec6fa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:58:18.593146 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-14cf0378-a6f5-4947-90b0-2d999c66b9ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:18.593798 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-14cf0378-a6f5-4947-90b0-2d999c66b9ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:18.595357 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1187/2366] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:58:18 2022] DELETE /identity/v3/projects/377548cca74546639d31d538aeec6fa7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:58:18.601111 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875dbcb-d152-40cc-a9ec-0e7ea9c7cb29 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:18.601273 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875dbcb-d152-40cc-a9ec-0e7ea9c7cb29 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:18.601452 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875dbcb-d152-40cc-a9ec-0e7ea9c7cb29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:18.622698 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-f875dbcb-d152-40cc-a9ec-0e7ea9c7cb29 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:18.623923 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-f875dbcb-d152-40cc-a9ec-0e7ea9c7cb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:18.670489 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:18.692222 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1180/2367] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:58:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:58:18.700297 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ab9c3-9e46-4172-92d6-362fdabd6723 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:18.700582 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ab9c3-9e46-4172-92d6-362fdabd6723 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:18.700855 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ab9c3-9e46-4172-92d6-362fdabd6723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:18.722296 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-d28ab9c3-9e46-4172-92d6-362fdabd6723 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:18.723494 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-d28ab9c3-9e46-4172-92d6-362fdabd6723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:18.732978 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1188/2368] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:58:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:58:18.737247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875dbcb-d152-40cc-a9ec-0e7ea9c7cb29 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:18.748075 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875dbcb-d152-40cc-a9ec-0e7ea9c7cb29 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:18.753460 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869fecc6-ce14-47d8-957a-443a90404f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:18.755523 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869fecc6-ce14-47d8-957a-443a90404f06 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:18.756030 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869fecc6-ce14-47d8-957a-443a90404f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:18.756446 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869fecc6-ce14-47d8-957a-443a90404f06 admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:18.757292 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869fecc6-ce14-47d8-957a-443a90404f06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:18.757752 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869fecc6-ce14-47d8-957a-443a90404f06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:18.760162 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869fecc6-ce14-47d8-957a-443a90404f06 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:18.772912 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1181/2369] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 15:58:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:18.777223 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ab9c3-9e46-4172-92d6-362fdabd6723 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:18.787494 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ab9c3-9e46-4172-92d6-362fdabd6723 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:18.792201 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122b8db-88e8-4efd-8719-315a0bbe733a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:18.792852 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122b8db-88e8-4efd-8719-315a0bbe733a admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:18.793132 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122b8db-88e8-4efd-8719-315a0bbe733a admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:18.793406 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122b8db-88e8-4efd-8719-315a0bbe733a admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:18.794046 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2122b8db-88e8-4efd-8719-315a0bbe733a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:18.796026 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2122b8db-88e8-4efd-8719-315a0bbe733a admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:18.823418 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1189/2370] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:58:18 2022] POST /identity/v3/projects => generated 391 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:58:18.827662 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869fecc6-ce14-47d8-957a-443a90404f06 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:18.838315 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869fecc6-ce14-47d8-957a-443a90404f06 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:18.893815 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989bdce3-1bed-4cd1-9e4f-10fddd258b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:18.894438 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bdce3-1bed-4cd1-9e4f-10fddd258b4d admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:18.894722 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bdce3-1bed-4cd1-9e4f-10fddd258b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:18.894994 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bdce3-1bed-4cd1-9e4f-10fddd258b4d admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:18.895619 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989bdce3-1bed-4cd1-9e4f-10fddd258b4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:18.898345 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989bdce3-1bed-4cd1-9e4f-10fddd258b4d admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:18.919957 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1182/2371] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:58:18 2022] POST /identity/v3/users => generated 296 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:58:18.924050 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122b8db-88e8-4efd-8719-315a0bbe733a admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:18.934632 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122b8db-88e8-4efd-8719-315a0bbe733a admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:18.939331 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ac17c-2309-4a3f-9f87-7753ca6d49d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:18.939933 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ac17c-2309-4a3f-9f87-7753ca6d49d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:18.940215 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ac17c-2309-4a3f-9f87-7753ca6d49d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:18.940492 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ac17c-2309-4a3f-9f87-7753ca6d49d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:18.941129 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ac17c-2309-4a3f-9f87-7753ca6d49d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:18.942880 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ac17c-2309-4a3f-9f87-7753ca6d49d2 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:18.953140 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1190/2372] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:58:18.957123 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989bdce3-1bed-4cd1-9e4f-10fddd258b4d admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:18.968037 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989bdce3-1bed-4cd1-9e4f-10fddd258b4d admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:18.972780 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73632173-1f99-4694-81ab-2e3431f0d9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:18.973374 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73632173-1f99-4694-81ab-2e3431f0d9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:18.973657 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73632173-1f99-4694-81ab-2e3431f0d9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:18.974509 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73632173-1f99-4694-81ab-2e3431f0d9d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:18.975155 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73632173-1f99-4694-81ab-2e3431f0d9d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:18.976722 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73632173-1f99-4694-81ab-2e3431f0d9d4 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:18.987978 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1183/2373] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:58:18.993180 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ac17c-2309-4a3f-9f87-7753ca6d49d2 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:19.003465 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ac17c-2309-4a3f-9f87-7753ca6d49d2 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:19.008367 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ff6bc-4104-478e-9e5b-95e963e5eea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:19.009005 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ff6bc-4104-478e-9e5b-95e963e5eea6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:19.009281 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ff6bc-4104-478e-9e5b-95e963e5eea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:19.009549 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ff6bc-4104-478e-9e5b-95e963e5eea6 admin admin] PATH_INFO: `/v3/projects/c00a64806fe041c3a2878ab9813b0072/users/0fc25ffa456f4f5f83b6946616893815/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:19.022001 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:19.025330 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26ff6bc-4104-478e-9e5b-95e963e5eea6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c00a64806fe041c3a2878ab9813b0072, user_id=0fc25ffa456f4f5f83b6946616893815, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:19.028665 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26ff6bc-4104-478e-9e5b-95e963e5eea6 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:19.043160 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1191/2374] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:58:18 2022] PUT /identity/v3/projects/c00a64806fe041c3a2878ab9813b0072/users/0fc25ffa456f4f5f83b6946616893815/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:58:19.113019 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea901d91-f336-4117-a5f3-ee6f9bc0244d None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:19.113580 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea901d91-f336-4117-a5f3-ee6f9bc0244d None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:19.113690 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea901d91-f336-4117-a5f3-ee6f9bc0244d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:19.145316 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-ea901d91-f336-4117-a5f3-ee6f9bc0244d None None] MFA Rules not processed for user `0fc25ffa456f4f5f83b6946616893815`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:19.147069 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-ea901d91-f336-4117-a5f3-ee6f9bc0244d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:19.219417 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1184/2375] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:58:19 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:58:19.230533 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ff6bc-4104-478e-9e5b-95e963e5eea6 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:19.232626 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-a26ff6bc-4104-478e-9e5b-95e963e5eea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:19.294433 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ff6bc-4104-478e-9e5b-95e963e5eea6 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:19.298928 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d591096-c13c-47db-88c8-b9868b70b90b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:19.299571 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d591096-c13c-47db-88c8-b9868b70b90b service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:19.299880 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d591096-c13c-47db-88c8-b9868b70b90b service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:19.300209 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d591096-c13c-47db-88c8-b9868b70b90b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:19.309112 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d591096-c13c-47db-88c8-b9868b70b90b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:19.310728 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d591096-c13c-47db-88c8-b9868b70b90b service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:19.321266 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1192/2376] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:58:19 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:58:21.868424 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867eb51-dbe5-4306-b65e-7a0d6b03cceb None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:21.868882 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867eb51-dbe5-4306-b65e-7a0d6b03cceb None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:21.869192 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867eb51-dbe5-4306-b65e-7a0d6b03cceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:21.889030 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-7867eb51-dbe5-4306-b65e-7a0d6b03cceb None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:21.890328 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-7867eb51-dbe5-4306-b65e-7a0d6b03cceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:21.923569 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:21.955413 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1185/2377] 10.222.0.26 () {58 vars in 1016 bytes} [Wed Sep 7 15:58:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:58:21.981656 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d591096-c13c-47db-88c8-b9868b70b90b service cinder] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:21.983567 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-0d591096-c13c-47db-88c8-b9868b70b90b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:22.096219 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d591096-c13c-47db-88c8-b9868b70b90b service cinder] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:22.103159 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6039aca-9cb1-4754-be90-cde30201faaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:22.103775 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6039aca-9cb1-4754-be90-cde30201faaf service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:22.104059 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6039aca-9cb1-4754-be90-cde30201faaf service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:22.104758 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6039aca-9cb1-4754-be90-cde30201faaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:22.114085 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6039aca-9cb1-4754-be90-cde30201faaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:22.115744 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6039aca-9cb1-4754-be90-cde30201faaf service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:22.126975 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1193/2378] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:58:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:58:25.084766 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041bed4-9d89-4069-bf1e-41b42a78375e None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:25.085291 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041bed4-9d89-4069-bf1e-41b42a78375e None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:25.085373 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041bed4-9d89-4069-bf1e-41b42a78375e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:25.112818 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-6041bed4-9d89-4069-bf1e-41b42a78375e None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:25.114936 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-6041bed4-9d89-4069-bf1e-41b42a78375e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:25.124398 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1186/2379] 10.222.0.26 () {58 vars in 1016 bytes} [Wed Sep 7 15:58:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:58:25.145821 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6039aca-9cb1-4754-be90-cde30201faaf service nova] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:25.157931 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6039aca-9cb1-4754-be90-cde30201faaf service nova] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:25.164692 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3816caaf-b7a5-467a-b095-74b1e224edd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:25.165300 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816caaf-b7a5-467a-b095-74b1e224edd8 service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:25.165579 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816caaf-b7a5-467a-b095-74b1e224edd8 service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:25.165854 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816caaf-b7a5-467a-b095-74b1e224edd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:25.178586 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3816caaf-b7a5-467a-b095-74b1e224edd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:25.180182 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3816caaf-b7a5-467a-b095-74b1e224edd8 service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:25.200107 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1194/2380] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:58:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:58:27.270995 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041bed4-9d89-4069-bf1e-41b42a78375e None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:27.272633 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-6041bed4-9d89-4069-bf1e-41b42a78375e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:27.285026 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041bed4-9d89-4069-bf1e-41b42a78375e None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:27.293784 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b5696-9088-4161-82ad-46e6cf4db315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:27.294462 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b5696-9088-4161-82ad-46e6cf4db315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:27.294745 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b5696-9088-4161-82ad-46e6cf4db315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:27.295019 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b5696-9088-4161-82ad-46e6cf4db315 admin admin] PATH_INFO: `/v3/users/d01a8b3b50ba4587a30d055eea326f11` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:27.296354 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85b5696-9088-4161-82ad-46e6cf4db315 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d01a8b3b50ba4587a30d055eea326f11)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:27.298400 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85b5696-9088-4161-82ad-46e6cf4db315 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:27.348588 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b85b5696-9088-4161-82ad-46e6cf4db315 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd01a8b3b50ba4587a30d055eea326f11'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:27.357824 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b85b5696-9088-4161-82ad-46e6cf4db315 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd01a8b3b50ba4587a30d055eea326f11'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:27.358667 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b85b5696-9088-4161-82ad-46e6cf4db315 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd01a8b3b50ba4587a30d055eea326f11'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:27.367056 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b85b5696-9088-4161-82ad-46e6cf4db315 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd01a8b3b50ba4587a30d055eea326f11'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:27.367815 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b85b5696-9088-4161-82ad-46e6cf4db315 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd01a8b3b50ba4587a30d055eea326f11'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:27.387683 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1187/2381] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:58:27 2022] DELETE /identity/v3/users/d01a8b3b50ba4587a30d055eea326f11 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:58:27.392206 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284d795-387a-4883-ac15-d7f150d68e08 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:27.392626 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284d795-387a-4883-ac15-d7f150d68e08 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:27.392904 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284d795-387a-4883-ac15-d7f150d68e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:27.413612 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-0284d795-387a-4883-ac15-d7f150d68e08 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:27.415618 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-0284d795-387a-4883-ac15-d7f150d68e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:27.492403 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1195/2382] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:58:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:58:27.503742 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b5696-9088-4161-82ad-46e6cf4db315 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:27.506081 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b85b5696-9088-4161-82ad-46e6cf4db315 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:27.576721 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b5696-9088-4161-82ad-46e6cf4db315 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:27.580387 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf8e2e-4f19-4719-b47f-c3fd8829c8d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:27.581004 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf8e2e-4f19-4719-b47f-c3fd8829c8d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:27.581299 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf8e2e-4f19-4719-b47f-c3fd8829c8d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:27.581555 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf8e2e-4f19-4719-b47f-c3fd8829c8d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:27.590580 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcf8e2e-4f19-4719-b47f-c3fd8829c8d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:27.592018 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcf8e2e-4f19-4719-b47f-c3fd8829c8d4 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:27.602891 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1188/2383] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:58:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:58:27.878658 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0284d795-387a-4883-ac15-d7f150d68e08 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:27.880299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-0284d795-387a-4883-ac15-d7f150d68e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:27.898717 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0284d795-387a-4883-ac15-d7f150d68e08 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:27.903764 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f2dab-4859-4b56-a3d9-a9dabcf1dd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:27.904319 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f2dab-4859-4b56-a3d9-a9dabcf1dd97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:27.904600 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f2dab-4859-4b56-a3d9-a9dabcf1dd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:27.904875 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f2dab-4859-4b56-a3d9-a9dabcf1dd97 admin admin] PATH_INFO: `/v3/projects/8b38e112c1784765bc38b2103c717cc0` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:27.906006 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413f2dab-4859-4b56-a3d9-a9dabcf1dd97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b38e112c1784765bc38b2103c717cc0)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:27.907979 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413f2dab-4859-4b56-a3d9-a9dabcf1dd97 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:27.909556 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:27.954895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-413f2dab-4859-4b56-a3d9-a9dabcf1dd97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b38e112c1784765bc38b2103c717cc0', 'request_id': 'req-413f2dab-4859-4b56-a3d9-a9dabcf1dd97'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:27.961016 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-413f2dab-4859-4b56-a3d9-a9dabcf1dd97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b38e112c1784765bc38b2103c717cc0', 'request_id': 'req-413f2dab-4859-4b56-a3d9-a9dabcf1dd97'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:27.967332 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-413f2dab-4859-4b56-a3d9-a9dabcf1dd97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b38e112c1784765bc38b2103c717cc0', 'request_id': 'req-413f2dab-4859-4b56-a3d9-a9dabcf1dd97'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:27.979901 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-413f2dab-4859-4b56-a3d9-a9dabcf1dd97 admin admin] The token cache is being invalidate because project 8b38e112c1784765bc38b2103c717cc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:58:27.980174 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-413f2dab-4859-4b56-a3d9-a9dabcf1dd97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:27.980828 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-413f2dab-4859-4b56-a3d9-a9dabcf1dd97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:27.982931 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1196/2384] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:58:27 2022] DELETE /identity/v3/projects/8b38e112c1784765bc38b2103c717cc0 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:58:27.987773 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b4a09-8a48-49dd-9c7e-fc84f3cc4fae None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:27.988081 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b4a09-8a48-49dd-9c7e-fc84f3cc4fae None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:27.988376 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b4a09-8a48-49dd-9c7e-fc84f3cc4fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:28.007724 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-8a7b4a09-8a48-49dd-9c7e-fc84f3cc4fae None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:28.008885 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-8a7b4a09-8a48-49dd-9c7e-fc84f3cc4fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:28.050732 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:28.069942 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1189/2385] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:58:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:58:28.078757 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8281e68-a219-4f21-85ef-7a8dcaddf2b9 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:28.079048 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8281e68-a219-4f21-85ef-7a8dcaddf2b9 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:28.079322 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8281e68-a219-4f21-85ef-7a8dcaddf2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:28.099898 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-d8281e68-a219-4f21-85ef-7a8dcaddf2b9 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:28.101094 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-d8281e68-a219-4f21-85ef-7a8dcaddf2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:28.110250 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1197/2386] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:58:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:58:28.114520 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b4a09-8a48-49dd-9c7e-fc84f3cc4fae None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:28.124248 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b4a09-8a48-49dd-9c7e-fc84f3cc4fae None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:28.129044 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53323bfa-416b-4887-a106-c3d612499be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:28.129637 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53323bfa-416b-4887-a106-c3d612499be9 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:28.130590 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53323bfa-416b-4887-a106-c3d612499be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:28.130971 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53323bfa-416b-4887-a106-c3d612499be9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:28.131701 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53323bfa-416b-4887-a106-c3d612499be9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:58:28.132006 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53323bfa-416b-4887-a106-c3d612499be9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:28.133610 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53323bfa-416b-4887-a106-c3d612499be9 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:28.144987 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1190/2387] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 15:58:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:58:28.150100 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8281e68-a219-4f21-85ef-7a8dcaddf2b9 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:28.159457 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8281e68-a219-4f21-85ef-7a8dcaddf2b9 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:28.164103 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed79185c-a7fa-4ee8-8821-0948a9f9b984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:28.164696 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79185c-a7fa-4ee8-8821-0948a9f9b984 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:28.164974 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79185c-a7fa-4ee8-8821-0948a9f9b984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:28.165244 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79185c-a7fa-4ee8-8821-0948a9f9b984 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:28.165873 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed79185c-a7fa-4ee8-8821-0948a9f9b984 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:28.167818 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed79185c-a7fa-4ee8-8821-0948a9f9b984 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:28.194575 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1198/2388] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:58:28 2022] POST /identity/v3/projects => generated 395 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 15:58:28.199934 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53323bfa-416b-4887-a106-c3d612499be9 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:28.210205 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53323bfa-416b-4887-a106-c3d612499be9 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:28.267485 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6c2a3-8439-4e03-bb4b-d0756cb81f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:28.268111 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6c2a3-8439-4e03-bb4b-d0756cb81f63 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:28.268534 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6c2a3-8439-4e03-bb4b-d0756cb81f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:28.268817 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6c2a3-8439-4e03-bb4b-d0756cb81f63 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:28.269472 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a6c2a3-8439-4e03-bb4b-d0756cb81f63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:28.271633 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a6c2a3-8439-4e03-bb4b-d0756cb81f63 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:28.298086 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1191/2389] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:58:28 2022] POST /identity/v3/users => generated 298 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:58:28.299340 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed79185c-a7fa-4ee8-8821-0948a9f9b984 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:28.310776 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed79185c-a7fa-4ee8-8821-0948a9f9b984 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:28.315742 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d3faea-5758-43c2-b75c-7b5620beaedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:28.316025 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e7700-4523-420f-abdf-94beb7980f12 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:28.316317 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e7700-4523-420f-abdf-94beb7980f12 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:28.316414 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3faea-5758-43c2-b75c-7b5620beaedc admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:28.316610 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e7700-4523-420f-abdf-94beb7980f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:28.316725 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3faea-5758-43c2-b75c-7b5620beaedc admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:28.316871 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3faea-5758-43c2-b75c-7b5620beaedc admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:28.317786 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d3faea-5758-43c2-b75c-7b5620beaedc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:28.319644 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d3faea-5758-43c2-b75c-7b5620beaedc admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:28.330032 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1199/2390] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:58:28.335088 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d3faea-5758-43c2-b75c-7b5620beaedc admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:28.336869 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-f01e7700-4523-420f-abdf-94beb7980f12 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:28.338102 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-f01e7700-4523-420f-abdf-94beb7980f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:28.344917 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d3faea-5758-43c2-b75c-7b5620beaedc admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:28.346420 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1192/2391] 10.222.0.26 () {58 vars in 1016 bytes} [Wed Sep 7 15:58:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 15:58:28.350720 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187cdb86-9af5-4660-9c5f-2b94ed68a7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:28.351336 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187cdb86-9af5-4660-9c5f-2b94ed68a7c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:28.351618 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187cdb86-9af5-4660-9c5f-2b94ed68a7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:28.351894 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187cdb86-9af5-4660-9c5f-2b94ed68a7c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:28.352519 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187cdb86-9af5-4660-9c5f-2b94ed68a7c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:28.354169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187cdb86-9af5-4660-9c5f-2b94ed68a7c2 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:28.362576 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e7700-4523-420f-abdf-94beb7980f12 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:28.363886 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-f01e7700-4523-420f-abdf-94beb7980f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:28.365518 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1200/2392] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:58:28.369905 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187cdb86-9af5-4660-9c5f-2b94ed68a7c2 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:28.379617 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187cdb86-9af5-4660-9c5f-2b94ed68a7c2 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:28.384989 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c5b7b-e840-44ad-9f48-5391846612da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:28.385690 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c5b7b-e840-44ad-9f48-5391846612da admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:28.385974 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c5b7b-e840-44ad-9f48-5391846612da admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:28.386407 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c5b7b-e840-44ad-9f48-5391846612da admin admin] PATH_INFO: `/v3/projects/1136f438343740aca84a41607236f6a8/users/a39b3fc56d4b4034949bb6d7d6938a51/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:28.404158 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6c5b7b-e840-44ad-9f48-5391846612da admin admin] RBAC: Authorizing `identity:create_grant(project_id=1136f438343740aca84a41607236f6a8, user_id=a39b3fc56d4b4034949bb6d7d6938a51, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:28.405879 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6c5b7b-e840-44ad-9f48-5391846612da admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:28.424624 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1201/2393] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:58:28 2022] PUT /identity/v3/projects/1136f438343740aca84a41607236f6a8/users/a39b3fc56d4b4034949bb6d7d6938a51/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 15:58:28.436171 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d913d8-d93c-48d1-90c2-50bdc7589d71 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:28.436312 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d913d8-d93c-48d1-90c2-50bdc7589d71 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:28.436778 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d913d8-d93c-48d1-90c2-50bdc7589d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:28.450329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e7700-4523-420f-abdf-94beb7980f12 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:28.470972 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-a3d913d8-d93c-48d1-90c2-50bdc7589d71 None None] MFA Rules not processed for user `a39b3fc56d4b4034949bb6d7d6938a51`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:28.470972 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-a3d913d8-d93c-48d1-90c2-50bdc7589d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:28.511461 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:28.532730 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d59e3-e5b6-40a8-ba2a-2095c0bec49c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:28.533348 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d59e3-e5b6-40a8-ba2a-2095c0bec49c service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:28.533682 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d59e3-e5b6-40a8-ba2a-2095c0bec49c service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:28.533891 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d59e3-e5b6-40a8-ba2a-2095c0bec49c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:28.553366 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1202/2394] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:58:28 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 15:58:28.564976 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d913d8-d93c-48d1-90c2-50bdc7589d71 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:28.566476 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-a3d913d8-d93c-48d1-90c2-50bdc7589d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:28.573969 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:28.607248 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d59e3-e5b6-40a8-ba2a-2095c0bec49c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:28.609108 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d59e3-e5b6-40a8-ba2a-2095c0bec49c service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:28.620236 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1193/2395] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:58:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:58:28.636279 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d913d8-d93c-48d1-90c2-50bdc7589d71 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:28.640424 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db20e3d-0777-46bb-b38e-65efc50da7a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:28.641222 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db20e3d-0777-46bb-b38e-65efc50da7a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:28.641512 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db20e3d-0777-46bb-b38e-65efc50da7a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:28.641780 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db20e3d-0777-46bb-b38e-65efc50da7a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:28.651717 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db20e3d-0777-46bb-b38e-65efc50da7a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:28.653611 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db20e3d-0777-46bb-b38e-65efc50da7a2 service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:28.666439 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1203/2396] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:58:28 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:58:29.560892 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d59e3-e5b6-40a8-ba2a-2095c0bec49c service nova] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:29.562331 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-6a3d59e3-e5b6-40a8-ba2a-2095c0bec49c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:29.575534 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d59e3-e5b6-40a8-ba2a-2095c0bec49c service nova] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:29.580089 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e2645-3bb2-46bd-a064-69c14cc47eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:29.580699 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e2645-3bb2-46bd-a064-69c14cc47eb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:29.580976 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e2645-3bb2-46bd-a064-69c14cc47eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:29.581267 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e2645-3bb2-46bd-a064-69c14cc47eb2 admin admin] PATH_INFO: `/v3/users/0fc25ffa456f4f5f83b6946616893815` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:29.582408 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e2645-3bb2-46bd-a064-69c14cc47eb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fc25ffa456f4f5f83b6946616893815)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:29.584345 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e2645-3bb2-46bd-a064-69c14cc47eb2 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:29.629675 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-4f4e2645-3bb2-46bd-a064-69c14cc47eb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fc25ffa456f4f5f83b6946616893815'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:29.637052 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-4f4e2645-3bb2-46bd-a064-69c14cc47eb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fc25ffa456f4f5f83b6946616893815'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:29.637603 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-4f4e2645-3bb2-46bd-a064-69c14cc47eb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fc25ffa456f4f5f83b6946616893815'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:29.644453 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-4f4e2645-3bb2-46bd-a064-69c14cc47eb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fc25ffa456f4f5f83b6946616893815'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:29.645079 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-4f4e2645-3bb2-46bd-a064-69c14cc47eb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fc25ffa456f4f5f83b6946616893815'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:29.662747 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1194/2397] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:58:29 2022] DELETE /identity/v3/users/0fc25ffa456f4f5f83b6946616893815 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:58:29.667186 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3190d-b715-4252-9326-c12413d311d5 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:29.667625 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3190d-b715-4252-9326-c12413d311d5 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:29.667766 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3190d-b715-4252-9326-c12413d311d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:29.687495 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-dfd3190d-b715-4252-9326-c12413d311d5 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:29.688751 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-dfd3190d-b715-4252-9326-c12413d311d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:29.746992 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1204/2398] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:58:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 15:58:29.756965 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e2645-3bb2-46bd-a064-69c14cc47eb2 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:29.758394 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-4f4e2645-3bb2-46bd-a064-69c14cc47eb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:29.817823 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e2645-3bb2-46bd-a064-69c14cc47eb2 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:29.822079 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505310c5-9a66-4721-899c-4ff44383b220 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:29.825167 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505310c5-9a66-4721-899c-4ff44383b220 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:29.825521 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505310c5-9a66-4721-899c-4ff44383b220 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:29.825805 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505310c5-9a66-4721-899c-4ff44383b220 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:29.836322 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505310c5-9a66-4721-899c-4ff44383b220 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:29.837756 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505310c5-9a66-4721-899c-4ff44383b220 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:29.842765 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:29.848056 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1195/2399] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:58:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:58:30.198454 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3190d-b715-4252-9326-c12413d311d5 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:30.200007 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-dfd3190d-b715-4252-9326-c12413d311d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:30.214688 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3190d-b715-4252-9326-c12413d311d5 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:30.226164 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b25b09c-129f-4e7a-be83-3bec518c7831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:30.226851 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25b09c-129f-4e7a-be83-3bec518c7831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:30.227605 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25b09c-129f-4e7a-be83-3bec518c7831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:30.227913 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25b09c-129f-4e7a-be83-3bec518c7831 admin admin] PATH_INFO: `/v3/projects/c00a64806fe041c3a2878ab9813b0072` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:30.229158 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b25b09c-129f-4e7a-be83-3bec518c7831 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c00a64806fe041c3a2878ab9813b0072)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:30.238660 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b25b09c-129f-4e7a-be83-3bec518c7831 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:30.299024 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-4b25b09c-129f-4e7a-be83-3bec518c7831 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c00a64806fe041c3a2878ab9813b0072', 'request_id': 'req-4b25b09c-129f-4e7a-be83-3bec518c7831'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:30.306702 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-4b25b09c-129f-4e7a-be83-3bec518c7831 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c00a64806fe041c3a2878ab9813b0072', 'request_id': 'req-4b25b09c-129f-4e7a-be83-3bec518c7831'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:30.313509 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-4b25b09c-129f-4e7a-be83-3bec518c7831 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c00a64806fe041c3a2878ab9813b0072', 'request_id': 'req-4b25b09c-129f-4e7a-be83-3bec518c7831'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:30.327792 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-4b25b09c-129f-4e7a-be83-3bec518c7831 admin admin] The token cache is being invalidate because project c00a64806fe041c3a2878ab9813b0072 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:58:30.328113 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-4b25b09c-129f-4e7a-be83-3bec518c7831 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:30.328866 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-4b25b09c-129f-4e7a-be83-3bec518c7831 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:30.332714 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1205/2400] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:58:30 2022] DELETE /identity/v3/projects/c00a64806fe041c3a2878ab9813b0072 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:58:33.761546 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505310c5-9a66-4721-899c-4ff44383b220 service neutron] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:33.763001 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-505310c5-9a66-4721-899c-4ff44383b220 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:33.775519 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505310c5-9a66-4721-899c-4ff44383b220 service neutron] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:33.831446 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d389b2-6f9b-4270-a405-e5415a366fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:33.832074 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d389b2-6f9b-4270-a405-e5415a366fdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:33.832352 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d389b2-6f9b-4270-a405-e5415a366fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:33.832626 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d389b2-6f9b-4270-a405-e5415a366fdf admin admin] PATH_INFO: `/v3/users/a39b3fc56d4b4034949bb6d7d6938a51` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:33.833816 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d389b2-6f9b-4270-a405-e5415a366fdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a39b3fc56d4b4034949bb6d7d6938a51)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:33.835765 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d389b2-6f9b-4270-a405-e5415a366fdf admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:33.885028 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b0d389b2-6f9b-4270-a405-e5415a366fdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a39b3fc56d4b4034949bb6d7d6938a51'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:33.892446 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b0d389b2-6f9b-4270-a405-e5415a366fdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a39b3fc56d4b4034949bb6d7d6938a51'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:33.893077 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b0d389b2-6f9b-4270-a405-e5415a366fdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a39b3fc56d4b4034949bb6d7d6938a51'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:33.900364 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b0d389b2-6f9b-4270-a405-e5415a366fdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a39b3fc56d4b4034949bb6d7d6938a51'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:33.901022 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b0d389b2-6f9b-4270-a405-e5415a366fdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a39b3fc56d4b4034949bb6d7d6938a51'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:33.918726 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1196/2401] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:58:33 2022] DELETE /identity/v3/users/a39b3fc56d4b4034949bb6d7d6938a51 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:58:33.923388 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033d630-2a5c-4b08-ad8f-f42e73c5888d None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:33.923870 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033d630-2a5c-4b08-ad8f-f42e73c5888d None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:33.924099 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033d630-2a5c-4b08-ad8f-f42e73c5888d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:33.944816 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-b033d630-2a5c-4b08-ad8f-f42e73c5888d None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:33.946136 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-b033d630-2a5c-4b08-ad8f-f42e73c5888d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:33.976691 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:34.016885 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1206/2402] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:58:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 15:58:34.026925 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d389b2-6f9b-4270-a405-e5415a366fdf admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:34.028355 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b0d389b2-6f9b-4270-a405-e5415a366fdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:34.094257 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d389b2-6f9b-4270-a405-e5415a366fdf admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:34.097867 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697338a0-c10f-4cb2-b9db-1159e69a6d36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:34.099021 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697338a0-c10f-4cb2-b9db-1159e69a6d36 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:34.099302 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697338a0-c10f-4cb2-b9db-1159e69a6d36 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:34.099572 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697338a0-c10f-4cb2-b9db-1159e69a6d36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:34.109002 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697338a0-c10f-4cb2-b9db-1159e69a6d36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:34.110457 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697338a0-c10f-4cb2-b9db-1159e69a6d36 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:34.120463 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1197/2403] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:58:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:58:34.395206 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b033d630-2a5c-4b08-ad8f-f42e73c5888d None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:34.397312 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-b033d630-2a5c-4b08-ad8f-f42e73c5888d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:34.409221 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b033d630-2a5c-4b08-ad8f-f42e73c5888d None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:34.414556 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721677d7-1fba-48ff-b696-6911f6d3f9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:34.415210 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721677d7-1fba-48ff-b696-6911f6d3f9a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:34.415492 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721677d7-1fba-48ff-b696-6911f6d3f9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:34.415767 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721677d7-1fba-48ff-b696-6911f6d3f9a9 admin admin] PATH_INFO: `/v3/projects/1136f438343740aca84a41607236f6a8` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:34.416924 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721677d7-1fba-48ff-b696-6911f6d3f9a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1136f438343740aca84a41607236f6a8)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:34.418901 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721677d7-1fba-48ff-b696-6911f6d3f9a9 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:34.469389 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-721677d7-1fba-48ff-b696-6911f6d3f9a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1136f438343740aca84a41607236f6a8', 'request_id': 'req-721677d7-1fba-48ff-b696-6911f6d3f9a9'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:34.475795 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-721677d7-1fba-48ff-b696-6911f6d3f9a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1136f438343740aca84a41607236f6a8', 'request_id': 'req-721677d7-1fba-48ff-b696-6911f6d3f9a9'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:34.483330 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-721677d7-1fba-48ff-b696-6911f6d3f9a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1136f438343740aca84a41607236f6a8', 'request_id': 'req-721677d7-1fba-48ff-b696-6911f6d3f9a9'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:34.496376 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-721677d7-1fba-48ff-b696-6911f6d3f9a9 admin admin] The token cache is being invalidate because project 1136f438343740aca84a41607236f6a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:58:34.496664 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-721677d7-1fba-48ff-b696-6911f6d3f9a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:34.497300 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-721677d7-1fba-48ff-b696-6911f6d3f9a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:58:34.499063 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1207/2404] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:58:34 2022] DELETE /identity/v3/projects/1136f438343740aca84a41607236f6a8 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:58:44.116003 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:44.493197 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=40,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:44.808981 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1d2f3-7cfb-4c64-bb8e-a1fadef80fcb None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:44.809265 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1d2f3-7cfb-4c64-bb8e-a1fadef80fcb None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:44.809541 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1d2f3-7cfb-4c64-bb8e-a1fadef80fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:44.828433 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-f9c1d2f3-7cfb-4c64-bb8e-a1fadef80fcb None None] MFA Rules not processed for user `170cf8b1448e4a9ba9ef3350cd24f8a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:44.829626 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-f9c1d2f3-7cfb-4c64-bb8e-a1fadef80fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:44.883595 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1198/2405] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:58:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:58:54.876923 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=25 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:58:58.810815 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8c445-11fd-486b-b940-71d4bc90332e None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:58.811427 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8c445-11fd-486b-b940-71d4bc90332e None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:58.811427 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8c445-11fd-486b-b940-71d4bc90332e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:58.831653 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-a7f8c445-11fd-486b-b940-71d4bc90332e None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:58:58.832920 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-a7f8c445-11fd-486b-b940-71d4bc90332e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:58.894511 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1208/2406] 10.222.0.26 () {58 vars in 1016 bytes} [Wed Sep 7 15:58:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:58:58.910534 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c1d2f3-7cfb-4c64-bb8e-a1fadef80fcb None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:58:58.912026 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-f9c1d2f3-7cfb-4c64-bb8e-a1fadef80fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:58:58.991707 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c1d2f3-7cfb-4c64-bb8e-a1fadef80fcb None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:58:58.997436 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a5eb3-2a57-4302-85f4-6fad3e8a7e96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:58:58.998049 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a5eb3-2a57-4302-85f4-6fad3e8a7e96 service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:58:58.998391 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a5eb3-2a57-4302-85f4-6fad3e8a7e96 service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:58:58.998665 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a5eb3-2a57-4302-85f4-6fad3e8a7e96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:58:59.007957 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a5eb3-2a57-4302-85f4-6fad3e8a7e96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:58:59.009636 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a5eb3-2a57-4302-85f4-6fad3e8a7e96 service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:58:59.019781 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1199/2407] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:58:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:59:01.347655 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87be74-23d3-489f-8373-b83335298aa1 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:01.348155 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87be74-23d3-489f-8373-b83335298aa1 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:01.348428 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87be74-23d3-489f-8373-b83335298aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:01.368100 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-2f87be74-23d3-489f-8373-b83335298aa1 None None] MFA Rules not processed for user `3e20e40a37df4898bfe692535e5e4f25`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:59:01.369305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-2f87be74-23d3-489f-8373-b83335298aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:59:01.424036 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1209/2408] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Sep 7 15:59:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:59:01.437108 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a5eb3-2a57-4302-85f4-6fad3e8a7e96 service nova] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:59:01.438650 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-ea3a5eb3-2a57-4302-85f4-6fad3e8a7e96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:59:01.513143 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a5eb3-2a57-4302-85f4-6fad3e8a7e96 service nova] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:59:01.517991 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c307ac-c0b2-4da2-9137-5318c51318c7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16c4b090a4aa4d56a90ccf090b9caba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:59:01.518681 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c307ac-c0b2-4da2-9137-5318c51318c7 service swift] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:01.518964 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c307ac-c0b2-4da2-9137-5318c51318c7 service swift] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:01.519238 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c307ac-c0b2-4da2-9137-5318c51318c7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:01.528059 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c307ac-c0b2-4da2-9137-5318c51318c7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:59:01.529633 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c307ac-c0b2-4da2-9137-5318c51318c7 service swift] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:59:01.537875 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1200/2409] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Sep 7 15:59:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 15:59:02.189584 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495290cf-9e12-4994-990e-b0814d01235f None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:02.189858 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495290cf-9e12-4994-990e-b0814d01235f None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:02.190170 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495290cf-9e12-4994-990e-b0814d01235f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:02.214848 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-495290cf-9e12-4994-990e-b0814d01235f None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:59:02.216688 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-495290cf-9e12-4994-990e-b0814d01235f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:59:02.227284 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1210/2410] 10.222.0.26 () {58 vars in 1016 bytes} [Wed Sep 7 15:59:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:59:02.242033 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c307ac-c0b2-4da2-9137-5318c51318c7 service swift] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:59:02.243556 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-e6c307ac-c0b2-4da2-9137-5318c51318c7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:59:02.263599 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c307ac-c0b2-4da2-9137-5318c51318c7 service swift] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:59:02.272262 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e52b1b2-adea-4bc6-a3da-5d98bdd12366 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:59:02.273135 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52b1b2-adea-4bc6-a3da-5d98bdd12366 service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:02.275983 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52b1b2-adea-4bc6-a3da-5d98bdd12366 service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:02.276143 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52b1b2-adea-4bc6-a3da-5d98bdd12366 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:02.289782 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e52b1b2-adea-4bc6-a3da-5d98bdd12366 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:59:02.291544 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e52b1b2-adea-4bc6-a3da-5d98bdd12366 service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:59:02.320997 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1201/2411] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:59:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:59:05.458330 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99026e-e4e8-46ed-aa04-6003f6a0afc8 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:05.458330 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99026e-e4e8-46ed-aa04-6003f6a0afc8 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:05.458330 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99026e-e4e8-46ed-aa04-6003f6a0afc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:05.481256 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-af99026e-e4e8-46ed-aa04-6003f6a0afc8 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:59:05.483015 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-af99026e-e4e8-46ed-aa04-6003f6a0afc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:59:05.494999 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1211/2412] 10.222.0.26 () {58 vars in 1016 bytes} [Wed Sep 7 15:59:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:59:05.520160 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e52b1b2-adea-4bc6-a3da-5d98bdd12366 service nova] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:59:05.534090 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e52b1b2-adea-4bc6-a3da-5d98bdd12366 service nova] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:59:05.541963 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d0d908-7245-4601-a621-d697a363eee4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:59:05.543295 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0d908-7245-4601-a621-d697a363eee4 service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:05.543295 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0d908-7245-4601-a621-d697a363eee4 service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:05.543524 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0d908-7245-4601-a621-d697a363eee4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:05.555882 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d0d908-7245-4601-a621-d697a363eee4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:59:05.557799 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d0d908-7245-4601-a621-d697a363eee4 service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:59:05.583573 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1202/2413] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:59:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:59:08.675420 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a796635-409c-4520-a73b-4b0a58ee1df4 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:08.675977 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a796635-409c-4520-a73b-4b0a58ee1df4 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:08.676322 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a796635-409c-4520-a73b-4b0a58ee1df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:08.700452 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-1a796635-409c-4520-a73b-4b0a58ee1df4 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:59:08.701763 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-1a796635-409c-4520-a73b-4b0a58ee1df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:59:08.712892 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1212/2414] 10.222.0.26 () {58 vars in 1016 bytes} [Wed Sep 7 15:59:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:59:08.730671 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d0d908-7245-4601-a621-d697a363eee4 service nova] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:59:08.744169 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d0d908-7245-4601-a621-d697a363eee4 service nova] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:59:08.749723 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ad583-add5-49bd-8cf4-f299997da54a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:59:08.750359 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ad583-add5-49bd-8cf4-f299997da54a service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:08.750638 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ad583-add5-49bd-8cf4-f299997da54a service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:08.750907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ad583-add5-49bd-8cf4-f299997da54a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:08.763158 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8ad583-add5-49bd-8cf4-f299997da54a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:59:08.764787 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8ad583-add5-49bd-8cf4-f299997da54a service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:59:08.777022 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1203/2415] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:59:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:59:10.870884 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a796635-409c-4520-a73b-4b0a58ee1df4 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:59:10.872380 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-1a796635-409c-4520-a73b-4b0a58ee1df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:59:10.959312 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a796635-409c-4520-a73b-4b0a58ee1df4 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:59:10.964738 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35661ece-232d-4a9b-a9ec-39274fc42fd2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c270b488024605af84e52d874474e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:59:10.965349 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35661ece-232d-4a9b-a9ec-39274fc42fd2 service placement] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:10.965624 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35661ece-232d-4a9b-a9ec-39274fc42fd2 service placement] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:10.966111 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35661ece-232d-4a9b-a9ec-39274fc42fd2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:10.968633 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-35661ece-232d-4a9b-a9ec-39274fc42fd2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:59:10.985387 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35661ece-232d-4a9b-a9ec-39274fc42fd2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:59:10.987084 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35661ece-232d-4a9b-a9ec-39274fc42fd2 service placement] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:59:11.005062 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1213/2416] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:59:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:59:11.846125 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2afb02-4e78-454f-8f97-539880731a85 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:11.846687 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2afb02-4e78-454f-8f97-539880731a85 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:11.846797 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2afb02-4e78-454f-8f97-539880731a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:11.867275 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-4c2afb02-4e78-454f-8f97-539880731a85 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:59:11.868465 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-4c2afb02-4e78-454f-8f97-539880731a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:59:11.881944 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1204/2417] 10.222.0.26 () {58 vars in 1016 bytes} [Wed Sep 7 15:59:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:59:11.897449 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35661ece-232d-4a9b-a9ec-39274fc42fd2 service placement] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:59:11.910333 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35661ece-232d-4a9b-a9ec-39274fc42fd2 service placement] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:59:11.915797 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3dfde7-e6c5-4597-9ce0-1e7c8f9add86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:59:11.916388 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3dfde7-e6c5-4597-9ce0-1e7c8f9add86 service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:11.916666 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3dfde7-e6c5-4597-9ce0-1e7c8f9add86 service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:11.916936 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3dfde7-e6c5-4597-9ce0-1e7c8f9add86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:11.924913 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3dfde7-e6c5-4597-9ce0-1e7c8f9add86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:59:11.927143 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3dfde7-e6c5-4597-9ce0-1e7c8f9add86 service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:59:11.936361 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1214/2418] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:59:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:59:16.525656 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae03281-9d9c-4b6c-9649-2f910170fe3f None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:16.526158 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae03281-9d9c-4b6c-9649-2f910170fe3f None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:16.526506 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae03281-9d9c-4b6c-9649-2f910170fe3f None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:16.528032 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1205/2419] 10.222.0.16 () {54 vars in 921 bytes} [Wed Sep 7 15:59:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 15:59:16.536021 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3a026-1d71-4a35-89a9-5f6202b3e355 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:16.536495 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3a026-1d71-4a35-89a9-5f6202b3e355 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:16.536596 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3a026-1d71-4a35-89a9-5f6202b3e355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:16.545144 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:59:16.558346 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-4af3a026-1d71-4a35-89a9-5f6202b3e355 None None] MFA Rules not processed for user `f9b13331a5fd48f5a2521ed1600f9f35`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:59:16.559862 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-4af3a026-1d71-4a35-89a9-5f6202b3e355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:59:16.569944 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1215/2420] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Sep 7 15:59:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:59:16.583365 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae03281-9d9c-4b6c-9649-2f910170fe3f None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:59:16.585100 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-aae03281-9d9c-4b6c-9649-2f910170fe3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:59:16.622741 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:59:16.654431 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae03281-9d9c-4b6c-9649-2f910170fe3f None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:59:16.659029 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc19a80-12cb-4895-8293-382c41a343f4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5753fea47f5944cd93dbea90fb9ad9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:59:16.659849 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc19a80-12cb-4895-8293-382c41a343f4 service glance] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:16.660188 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc19a80-12cb-4895-8293-382c41a343f4 service glance] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:16.660539 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc19a80-12cb-4895-8293-382c41a343f4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:16.673056 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc19a80-12cb-4895-8293-382c41a343f4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:59:16.674543 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc19a80-12cb-4895-8293-382c41a343f4 service glance] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:59:16.693185 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1206/2421] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:59:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:59:16.764411 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a764022-8340-48db-9e25-4924a14040fd None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:16.764731 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a764022-8340-48db-9e25-4924a14040fd None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:16.765020 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a764022-8340-48db-9e25-4924a14040fd None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:16.766385 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1216/2422] 10.222.0.16 () {54 vars in 921 bytes} [Wed Sep 7 15:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:59:16.771809 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e0309-6339-4384-af64-10ed0ae93015 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:16.772173 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e0309-6339-4384-af64-10ed0ae93015 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:16.772527 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e0309-6339-4384-af64-10ed0ae93015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:16.792985 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-d91e0309-6339-4384-af64-10ed0ae93015 None None] MFA Rules not processed for user `3195fa62961c4d64972b88449d013380`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:59:16.794222 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-d91e0309-6339-4384-af64-10ed0ae93015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:59:16.855004 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1207/2423] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Sep 7 15:59:16 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:59:16.867712 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a764022-8340-48db-9e25-4924a14040fd None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:59:16.869415 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-5a764022-8340-48db-9e25-4924a14040fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:59:16.883269 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a764022-8340-48db-9e25-4924a14040fd None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:59:16.886750 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5174e222-6536-43dd-b479-702833110a3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:59:16.887340 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174e222-6536-43dd-b479-702833110a3f service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:16.887620 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174e222-6536-43dd-b479-702833110a3f service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:16.887892 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174e222-6536-43dd-b479-702833110a3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:16.897877 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5174e222-6536-43dd-b479-702833110a3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:59:16.899368 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5174e222-6536-43dd-b479-702833110a3f service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:59:16.908173 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1217/2424] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:59:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:59:16.991339 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f55880-5a6a-4cab-b6e9-e17a1ab48ab9 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:16.991632 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f55880-5a6a-4cab-b6e9-e17a1ab48ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:16.991946 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f55880-5a6a-4cab-b6e9-e17a1ab48ab9 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:16.995375 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1208/2425] 10.222.0.16 () {54 vars in 921 bytes} [Wed Sep 7 15:59:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 15:59:17.001102 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17480f88-bd29-4e8b-9736-2ae6f6e6859b None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:17.001446 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17480f88-bd29-4e8b-9736-2ae6f6e6859b None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:17.001727 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17480f88-bd29-4e8b-9736-2ae6f6e6859b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:17.027558 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-17480f88-bd29-4e8b-9736-2ae6f6e6859b None None] MFA Rules not processed for user `f9b13331a5fd48f5a2521ed1600f9f35`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:59:17.029451 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-17480f88-bd29-4e8b-9736-2ae6f6e6859b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:59:17.042676 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1218/2426] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Sep 7 15:59:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:59:17.054701 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f55880-5a6a-4cab-b6e9-e17a1ab48ab9 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:59:17.065810 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f55880-5a6a-4cab-b6e9-e17a1ab48ab9 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:59:17.069394 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611796f-9199-49c7-aaca-e2d8ff6a6a40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:59:17.070013 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611796f-9199-49c7-aaca-e2d8ff6a6a40 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:17.070320 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611796f-9199-49c7-aaca-e2d8ff6a6a40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:17.070591 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611796f-9199-49c7-aaca-e2d8ff6a6a40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:17.080907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0611796f-9199-49c7-aaca-e2d8ff6a6a40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:59:17.082464 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0611796f-9199-49c7-aaca-e2d8ff6a6a40 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:59:17.093327 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1209/2427] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:59:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:59:25.079568 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f0f55-aab7-4e12-af36-0dce47cd0fc9 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:25.080045 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f0f55-aab7-4e12-af36-0dce47cd0fc9 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:25.080129 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f0f55-aab7-4e12-af36-0dce47cd0fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:25.103489 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-be1f0f55-aab7-4e12-af36-0dce47cd0fc9 None None] MFA Rules not processed for user `3e20e40a37df4898bfe692535e5e4f25`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:59:25.105421 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-be1f0f55-aab7-4e12-af36-0dce47cd0fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:59:25.113626 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1219/2428] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Sep 7 15:59:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:59:25.126091 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611796f-9199-49c7-aaca-e2d8ff6a6a40 service neutron] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:59:25.138745 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611796f-9199-49c7-aaca-e2d8ff6a6a40 service neutron] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:59:25.146097 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b44f050-2287-4561-8b1f-00ac0f9302fd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16c4b090a4aa4d56a90ccf090b9caba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:59:25.146774 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44f050-2287-4561-8b1f-00ac0f9302fd service swift] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:25.147030 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44f050-2287-4561-8b1f-00ac0f9302fd service swift] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:25.147307 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44f050-2287-4561-8b1f-00ac0f9302fd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:25.156894 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b44f050-2287-4561-8b1f-00ac0f9302fd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:59:25.159759 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b44f050-2287-4561-8b1f-00ac0f9302fd service swift] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:59:25.170047 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1210/2429] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Sep 7 15:59:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 15:59:35.094664 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=14 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:59:35.166067 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=48 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:59:37.992925 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edc1d0-414c-4acc-ba14-76e34530f583 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:37.993444 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edc1d0-414c-4acc-ba14-76e34530f583 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:37.993552 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edc1d0-414c-4acc-ba14-76e34530f583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:38.012212 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-89edc1d0-414c-4acc-ba14-76e34530f583 None None] MFA Rules not processed for user `d7738e76f24f48d4a66a9237ddbc939e`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:59:38.013409 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-89edc1d0-414c-4acc-ba14-76e34530f583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:59:38.088362 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1220/2430] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:59:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:59:39.962269 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982c79e-179a-4ec6-a937-686c6561f19d None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:39.962762 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982c79e-179a-4ec6-a937-686c6561f19d None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:39.962918 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982c79e-179a-4ec6-a937-686c6561f19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:39.983388 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-2982c79e-179a-4ec6-a937-686c6561f19d None None] MFA Rules not processed for user `3e20e40a37df4898bfe692535e5e4f25`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:59:39.984628 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-2982c79e-179a-4ec6-a937-686c6561f19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:59:39.992021 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1211/2431] 10.222.0.16 () {58 vars in 967 bytes} [Wed Sep 7 15:59:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 15:59:40.004693 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89edc1d0-414c-4acc-ba14-76e34530f583 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:59:40.017392 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89edc1d0-414c-4acc-ba14-76e34530f583 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:59:40.022996 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a26202-74ab-44b3-8eab-15aabd06953a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16c4b090a4aa4d56a90ccf090b9caba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:59:40.023659 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a26202-74ab-44b3-8eab-15aabd06953a service swift] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:40.023940 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a26202-74ab-44b3-8eab-15aabd06953a service swift] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:40.024210 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a26202-74ab-44b3-8eab-15aabd06953a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:40.032117 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a26202-74ab-44b3-8eab-15aabd06953a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:59:40.033731 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a26202-74ab-44b3-8eab-15aabd06953a service swift] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:59:40.043352 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1221/2432] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Sep 7 15:59:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 07 15:59:43.298245 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982c79e-179a-4ec6-a937-686c6561f19d None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:59:43.300983 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-2982c79e-179a-4ec6-a937-686c6561f19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:59:43.320753 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982c79e-179a-4ec6-a937-686c6561f19d None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:59:43.325509 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ef3ff-5ca7-4194-9f79-1ecabb385a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:59:43.326273 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ef3ff-5ca7-4194-9f79-1ecabb385a94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:43.326619 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ef3ff-5ca7-4194-9f79-1ecabb385a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:43.326964 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ef3ff-5ca7-4194-9f79-1ecabb385a94 admin admin] PATH_INFO: `/v3/users/170cf8b1448e4a9ba9ef3350cd24f8a9` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:43.328402 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680ef3ff-5ca7-4194-9f79-1ecabb385a94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=170cf8b1448e4a9ba9ef3350cd24f8a9)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:59:43.331000 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680ef3ff-5ca7-4194-9f79-1ecabb385a94 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:59:43.388163 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-680ef3ff-5ca7-4194-9f79-1ecabb385a94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '170cf8b1448e4a9ba9ef3350cd24f8a9'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:59:43.402675 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-680ef3ff-5ca7-4194-9f79-1ecabb385a94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '170cf8b1448e4a9ba9ef3350cd24f8a9'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:59:43.403321 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-680ef3ff-5ca7-4194-9f79-1ecabb385a94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '170cf8b1448e4a9ba9ef3350cd24f8a9'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:59:43.411720 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-680ef3ff-5ca7-4194-9f79-1ecabb385a94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '170cf8b1448e4a9ba9ef3350cd24f8a9'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:59:43.412456 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-680ef3ff-5ca7-4194-9f79-1ecabb385a94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '170cf8b1448e4a9ba9ef3350cd24f8a9'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:59:43.433151 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1212/2433] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 15:59:43 2022] DELETE /identity/v3/users/170cf8b1448e4a9ba9ef3350cd24f8a9 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:59:43.640175 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a26202-74ab-44b3-8eab-15aabd06953a service swift] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:59:43.661844 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a26202-74ab-44b3-8eab-15aabd06953a service swift] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:59:43.730636 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042c723-8472-49f6-8694-2228c7cacb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:59:43.731399 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042c723-8472-49f6-8694-2228c7cacb1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:43.731740 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042c723-8472-49f6-8694-2228c7cacb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:43.732343 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042c723-8472-49f6-8694-2228c7cacb1d admin admin] PATH_INFO: `/v3/projects/dce6a67acb6e40f6a453e433494445a7` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:43.733527 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042c723-8472-49f6-8694-2228c7cacb1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dce6a67acb6e40f6a453e433494445a7)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:59:43.735545 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042c723-8472-49f6-8694-2228c7cacb1d admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:59:43.797391 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-a042c723-8472-49f6-8694-2228c7cacb1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dce6a67acb6e40f6a453e433494445a7', 'request_id': 'req-a042c723-8472-49f6-8694-2228c7cacb1d'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:59:43.803965 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-a042c723-8472-49f6-8694-2228c7cacb1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dce6a67acb6e40f6a453e433494445a7', 'request_id': 'req-a042c723-8472-49f6-8694-2228c7cacb1d'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:59:43.810378 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-a042c723-8472-49f6-8694-2228c7cacb1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dce6a67acb6e40f6a453e433494445a7', 'request_id': 'req-a042c723-8472-49f6-8694-2228c7cacb1d'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:59:43.824601 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-a042c723-8472-49f6-8694-2228c7cacb1d admin admin] The token cache is being invalidate because project dce6a67acb6e40f6a453e433494445a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 15:59:43.825037 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-a042c723-8472-49f6-8694-2228c7cacb1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:59:43.825788 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-a042c723-8472-49f6-8694-2228c7cacb1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 15:59:43.827951 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1222/2434] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 15:59:43 2022] DELETE /identity/v3/projects/dce6a67acb6e40f6a453e433494445a7 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:59:43.832750 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eeaa28-a19f-43b0-a04f-22b9c17aced8 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:43.833102 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eeaa28-a19f-43b0-a04f-22b9c17aced8 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:43.833443 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eeaa28-a19f-43b0-a04f-22b9c17aced8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:43.858229 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-29eeaa28-a19f-43b0-a04f-22b9c17aced8 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:59:43.859617 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-29eeaa28-a19f-43b0-a04f-22b9c17aced8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:59:43.924525 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1213/2435] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:59:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:59:43.933177 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dda40f-f5d1-4375-b0bb-801acbe42b88 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:43.933464 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dda40f-f5d1-4375-b0bb-801acbe42b88 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:43.933747 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dda40f-f5d1-4375-b0bb-801acbe42b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:43.954899 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-76dda40f-f5d1-4375-b0bb-801acbe42b88 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:59:43.956110 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-76dda40f-f5d1-4375-b0bb-801acbe42b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:59:43.965463 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1223/2436] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:59:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:59:43.969870 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eeaa28-a19f-43b0-a04f-22b9c17aced8 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:59:43.980477 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eeaa28-a19f-43b0-a04f-22b9c17aced8 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:59:43.985315 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6990268e-2c81-4475-8aa0-6765703db8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:59:43.985909 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6990268e-2c81-4475-8aa0-6765703db8ae admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:43.986199 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6990268e-2c81-4475-8aa0-6765703db8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:43.986498 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6990268e-2c81-4475-8aa0-6765703db8ae admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:43.987203 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6990268e-2c81-4475-8aa0-6765703db8ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 15:59:43.987509 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6990268e-2c81-4475-8aa0-6765703db8ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:59:43.989102 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6990268e-2c81-4475-8aa0-6765703db8ae admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:59:44.001001 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1214/2437] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 15:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 15:59:44.005372 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dda40f-f5d1-4375-b0bb-801acbe42b88 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:59:44.014905 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dda40f-f5d1-4375-b0bb-801acbe42b88 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:59:44.019538 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ffee7-0ee7-4fdb-8709-d53c8744577b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:59:44.020129 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ffee7-0ee7-4fdb-8709-d53c8744577b admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:44.020409 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ffee7-0ee7-4fdb-8709-d53c8744577b admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:44.020681 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ffee7-0ee7-4fdb-8709-d53c8744577b admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:44.021313 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83ffee7-0ee7-4fdb-8709-d53c8744577b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:59:44.023820 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83ffee7-0ee7-4fdb-8709-d53c8744577b admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:59:44.039981 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:59:44.052588 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1224/2438] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:59:44 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 15:59:44.056827 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6990268e-2c81-4475-8aa0-6765703db8ae admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:59:44.066643 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6990268e-2c81-4475-8aa0-6765703db8ae admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:59:44.113969 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:59:44.123928 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed40e2d-acc7-41c3-85de-e79d36a9332c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:59:44.124525 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed40e2d-acc7-41c3-85de-e79d36a9332c admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:44.124807 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed40e2d-acc7-41c3-85de-e79d36a9332c admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:44.125082 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed40e2d-acc7-41c3-85de-e79d36a9332c admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:44.125714 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed40e2d-acc7-41c3-85de-e79d36a9332c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:59:44.127652 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed40e2d-acc7-41c3-85de-e79d36a9332c admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:59:44.147844 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1215/2439] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:59:44 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:59:44.151973 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ffee7-0ee7-4fdb-8709-d53c8744577b admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:59:44.162141 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ffee7-0ee7-4fdb-8709-d53c8744577b admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:59:44.167383 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e2ccc-e18f-48b7-8363-893a9dc329c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:59:44.167993 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e2ccc-e18f-48b7-8363-893a9dc329c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:44.168274 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e2ccc-e18f-48b7-8363-893a9dc329c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:44.168547 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e2ccc-e18f-48b7-8363-893a9dc329c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:44.169183 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e2ccc-e18f-48b7-8363-893a9dc329c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:59:44.170827 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e2ccc-e18f-48b7-8363-893a9dc329c6 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:59:44.180601 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1225/2440] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:59:44.184501 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed40e2d-acc7-41c3-85de-e79d36a9332c admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:59:44.194286 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed40e2d-acc7-41c3-85de-e79d36a9332c admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:59:44.199163 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7c365-d0f8-4163-a3c7-94a7c9f43700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:59:44.199744 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7c365-d0f8-4163-a3c7-94a7c9f43700 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:44.200022 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7c365-d0f8-4163-a3c7-94a7c9f43700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:44.200293 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7c365-d0f8-4163-a3c7-94a7c9f43700 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:44.200916 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c7c365-d0f8-4163-a3c7-94a7c9f43700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:59:44.202545 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c7c365-d0f8-4163-a3c7-94a7c9f43700 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:59:44.213440 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1216/2441] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:59:44.217423 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e2ccc-e18f-48b7-8363-893a9dc329c6 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:59:44.228459 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e2ccc-e18f-48b7-8363-893a9dc329c6 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:59:44.233395 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25656214-f208-44d2-8bb7-0053e585712c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:59:44.234093 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25656214-f208-44d2-8bb7-0053e585712c admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:44.234477 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25656214-f208-44d2-8bb7-0053e585712c admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:44.234754 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25656214-f208-44d2-8bb7-0053e585712c admin admin] PATH_INFO: `/v3/projects/0ba27ab8e53846eab2a8e698c9001cd2/users/ffef8094ff9147b6abc9e61fd2d42231/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:44.251146 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25656214-f208-44d2-8bb7-0053e585712c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ba27ab8e53846eab2a8e698c9001cd2, user_id=ffef8094ff9147b6abc9e61fd2d42231, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:59:44.253778 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25656214-f208-44d2-8bb7-0053e585712c admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:59:44.267050 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1226/2442] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:59:44 2022] PUT /identity/v3/projects/0ba27ab8e53846eab2a8e698c9001cd2/users/ffef8094ff9147b6abc9e61fd2d42231/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:59:44.272076 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd5420-bb86-40a3-9390-0ac18b157054 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:44.272929 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd5420-bb86-40a3-9390-0ac18b157054 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:44.273232 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd5420-bb86-40a3-9390-0ac18b157054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:44.292155 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-60fd5420-bb86-40a3-9390-0ac18b157054 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:59:44.293363 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-60fd5420-bb86-40a3-9390-0ac18b157054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:59:44.351118 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1217/2443] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:59:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:59:44.362135 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25656214-f208-44d2-8bb7-0053e585712c admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:59:44.364015 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-25656214-f208-44d2-8bb7-0053e585712c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:59:44.421481 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25656214-f208-44d2-8bb7-0053e585712c admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:59:44.425085 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853668c4-17b8-47cd-a671-51c2b6ddb4db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:59:44.425720 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853668c4-17b8-47cd-a671-51c2b6ddb4db service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:44.425999 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853668c4-17b8-47cd-a671-51c2b6ddb4db service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:44.426309 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853668c4-17b8-47cd-a671-51c2b6ddb4db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:44.435259 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853668c4-17b8-47cd-a671-51c2b6ddb4db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:59:44.436679 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853668c4-17b8-47cd-a671-51c2b6ddb4db service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:59:44.446806 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1227/2444] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:59:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:59:48.751412 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad7b6e-eb85-471e-a4b6-f4191a5e7286 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:48.751890 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad7b6e-eb85-471e-a4b6-f4191a5e7286 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:48.751986 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad7b6e-eb85-471e-a4b6-f4191a5e7286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:48.786768 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-e2ad7b6e-eb85-471e-a4b6-f4191a5e7286 None None] MFA Rules not processed for user `ffef8094ff9147b6abc9e61fd2d42231`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:59:48.788797 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-e2ad7b6e-eb85-471e-a4b6-f4191a5e7286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:59:48.860586 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1218/2445] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:59:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:59:48.864830 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853668c4-17b8-47cd-a671-51c2b6ddb4db service neutron] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:59:48.875044 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853668c4-17b8-47cd-a671-51c2b6ddb4db service neutron] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:59:48.880046 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213e3b6-4374-40a3-92c1-1ab71e86a2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:59:48.880661 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213e3b6-4374-40a3-92c1-1ab71e86a2e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:48.881006 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213e3b6-4374-40a3-92c1-1ab71e86a2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:48.881900 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213e3b6-4374-40a3-92c1-1ab71e86a2e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:48.882687 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d213e3b6-4374-40a3-92c1-1ab71e86a2e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:59:48.884644 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d213e3b6-4374-40a3-92c1-1ab71e86a2e2 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:59:48.913051 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1228/2446] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 15:59:48 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 15:59:48.917112 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad7b6e-eb85-471e-a4b6-f4191a5e7286 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:59:48.928350 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad7b6e-eb85-471e-a4b6-f4191a5e7286 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:59:48.987920 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95142f2-5272-49b7-8163-ff82897c7031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:59:48.988537 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95142f2-5272-49b7-8163-ff82897c7031 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:48.988821 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95142f2-5272-49b7-8163-ff82897c7031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:48.989099 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95142f2-5272-49b7-8163-ff82897c7031 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:48.989757 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95142f2-5272-49b7-8163-ff82897c7031 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:59:48.992299 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95142f2-5272-49b7-8163-ff82897c7031 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:59:49.002755 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:59:49.015899 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1219/2447] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 15:59:48 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 15:59:49.019929 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213e3b6-4374-40a3-92c1-1ab71e86a2e2 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:59:49.031560 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213e3b6-4374-40a3-92c1-1ab71e86a2e2 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:59:49.036175 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432cb5c3-dff6-4640-82f6-6c5fa4178ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:59:49.036782 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432cb5c3-dff6-4640-82f6-6c5fa4178ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:49.037070 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432cb5c3-dff6-4640-82f6-6c5fa4178ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:49.037332 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432cb5c3-dff6-4640-82f6-6c5fa4178ec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:49.038001 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432cb5c3-dff6-4640-82f6-6c5fa4178ec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:59:49.039645 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432cb5c3-dff6-4640-82f6-6c5fa4178ec5 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:59:49.051163 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1229/2448] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:59:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:59:49.055503 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95142f2-5272-49b7-8163-ff82897c7031 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:59:49.065504 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95142f2-5272-49b7-8163-ff82897c7031 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:59:49.070809 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b8fc3-a8ad-4c18-aa1a-200c4a4b7aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:59:49.071460 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b8fc3-a8ad-4c18-aa1a-200c4a4b7aea admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:49.071744 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b8fc3-a8ad-4c18-aa1a-200c4a4b7aea admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:49.072018 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b8fc3-a8ad-4c18-aa1a-200c4a4b7aea admin admin] PATH_INFO: `/v3/projects/05578ca31d5649ff8d9b21a971b6751a/users/d324900938284ed3baa1ab6d491bbc8d/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:49.088737 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b8fc3-a8ad-4c18-aa1a-200c4a4b7aea admin admin] RBAC: Authorizing `identity:create_grant(project_id=05578ca31d5649ff8d9b21a971b6751a, user_id=d324900938284ed3baa1ab6d491bbc8d, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:59:49.091544 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b8fc3-a8ad-4c18-aa1a-200c4a4b7aea admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:59:49.106931 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1220/2449] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:59:49 2022] PUT /identity/v3/projects/05578ca31d5649ff8d9b21a971b6751a/users/d324900938284ed3baa1ab6d491bbc8d/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:59:49.111134 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432cb5c3-dff6-4640-82f6-6c5fa4178ec5 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:59:49.121928 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432cb5c3-dff6-4640-82f6-6c5fa4178ec5 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:59:49.179604 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349cbbd-5bb5-4af7-a467-5d89ec11bcce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:59:49.180215 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349cbbd-5bb5-4af7-a467-5d89ec11bcce admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:49.180523 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349cbbd-5bb5-4af7-a467-5d89ec11bcce admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:49.180798 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349cbbd-5bb5-4af7-a467-5d89ec11bcce admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:49.181431 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1349cbbd-5bb5-4af7-a467-5d89ec11bcce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:59:49.183051 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1349cbbd-5bb5-4af7-a467-5d89ec11bcce admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:59:49.192733 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1230/2450] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 15:59:49 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 15:59:49.197884 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b8fc3-a8ad-4c18-aa1a-200c4a4b7aea admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:59:49.208224 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b8fc3-a8ad-4c18-aa1a-200c4a4b7aea admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:59:49.213111 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef7a452-0be7-4e86-8622-c6270eae3df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:59:49.213755 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7a452-0be7-4e86-8622-c6270eae3df1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:49.214039 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7a452-0be7-4e86-8622-c6270eae3df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:49.214345 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7a452-0be7-4e86-8622-c6270eae3df1 admin admin] PATH_INFO: `/v3/projects/05578ca31d5649ff8d9b21a971b6751a/users/d324900938284ed3baa1ab6d491bbc8d/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:49.216258 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef7a452-0be7-4e86-8622-c6270eae3df1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05578ca31d5649ff8d9b21a971b6751a, user_id=d324900938284ed3baa1ab6d491bbc8d, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:59:49.218916 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef7a452-0be7-4e86-8622-c6270eae3df1 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:59:49.229123 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1221/2451] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 15:59:49 2022] PUT /identity/v3/projects/05578ca31d5649ff8d9b21a971b6751a/users/d324900938284ed3baa1ab6d491bbc8d/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 15:59:53.939522 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39eb2be-66f2-4518-b13d-3d46e4c8f20e None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:53.940006 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39eb2be-66f2-4518-b13d-3d46e4c8f20e None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:53.940103 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39eb2be-66f2-4518-b13d-3d46e4c8f20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:53.970986 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-c39eb2be-66f2-4518-b13d-3d46e4c8f20e None None] MFA Rules not processed for user `d324900938284ed3baa1ab6d491bbc8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:59:53.972209 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-c39eb2be-66f2-4518-b13d-3d46e4c8f20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:59:53.989236 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:59:54.071421 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1231/2452] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 15:59:53 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:59:54.083417 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef7a452-0be7-4e86-8622-c6270eae3df1 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:59:54.085414 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-0ef7a452-0be7-4e86-8622-c6270eae3df1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:59:54.158390 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef7a452-0be7-4e86-8622-c6270eae3df1 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:59:54.164377 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331d9b4-b8df-43c2-9968-8802e46aff36 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5753fea47f5944cd93dbea90fb9ad9b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:59:54.165361 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331d9b4-b8df-43c2-9968-8802e46aff36 service glance] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:54.165735 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331d9b4-b8df-43c2-9968-8802e46aff36 service glance] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:54.166628 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331d9b4-b8df-43c2-9968-8802e46aff36 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:54.233975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4331d9b4-b8df-43c2-9968-8802e46aff36 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:59:54.235508 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4331d9b4-b8df-43c2-9968-8802e46aff36 service glance] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:59:54.246761 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1222/2453] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 15:59:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 15:59:54.394150 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf96823-8aca-4700-945a-f6bf20ebaf45 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:54.396407 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf96823-8aca-4700-945a-f6bf20ebaf45 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:54.396695 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf96823-8aca-4700-945a-f6bf20ebaf45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:54.420262 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-daf96823-8aca-4700-945a-f6bf20ebaf45 None None] MFA Rules not processed for user `3e20e40a37df4898bfe692535e5e4f25`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 15:59:54.422211 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-daf96823-8aca-4700-945a-f6bf20ebaf45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:59:54.483341 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1232/2454] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Sep 7 15:59:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 15:59:54.496538 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331d9b4-b8df-43c2-9968-8802e46aff36 service glance] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 15:59:54.497947 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-4331d9b4-b8df-43c2-9968-8802e46aff36 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 15:59:54.575019 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331d9b4-b8df-43c2-9968-8802e46aff36 service glance] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 15:59:54.580144 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1e17c-7950-4812-8b8d-d7657075ab6f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16c4b090a4aa4d56a90ccf090b9caba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 15:59:54.580742 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1e17c-7950-4812-8b8d-d7657075ab6f service swift] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 15:59:54.581216 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1e17c-7950-4812-8b8d-d7657075ab6f service swift] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 15:59:54.581492 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1e17c-7950-4812-8b8d-d7657075ab6f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 15:59:54.589591 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c1e17c-7950-4812-8b8d-d7657075ab6f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 15:59:54.591201 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c1e17c-7950-4812-8b8d-d7657075ab6f service swift] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 15:59:54.594634 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 15:59:54.601500 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1223/2455] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Sep 7 15:59:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 16:00:03.546959 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa5260-a469-41c8-b76a-0a379b2ba9be None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:03.548109 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa5260-a469-41c8-b76a-0a379b2ba9be None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:03.548397 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa5260-a469-41c8-b76a-0a379b2ba9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:03.572991 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-10fa5260-a469-41c8-b76a-0a379b2ba9be None None] MFA Rules not processed for user `ffef8094ff9147b6abc9e61fd2d42231`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:00:03.574878 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-10fa5260-a469-41c8-b76a-0a379b2ba9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:00:03.584936 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1233/2456] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:00:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:00:04.602595 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:06.022977 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6448d20-3393-4366-8b68-65299205a4be None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:06.024061 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6448d20-3393-4366-8b68-65299205a4be None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:06.024579 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6448d20-3393-4366-8b68-65299205a4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:06.059001 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-f6448d20-3393-4366-8b68-65299205a4be None None] MFA Rules not processed for user `3e20e40a37df4898bfe692535e5e4f25`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:00:06.060487 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-f6448d20-3393-4366-8b68-65299205a4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:00:06.069773 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1224/2457] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Sep 7 16:00:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:00:06.093314 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa5260-a469-41c8-b76a-0a379b2ba9be None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:06.110521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa5260-a469-41c8-b76a-0a379b2ba9be None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:06.117216 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028c1b5-528b-4aab-bd22-d286567dc8bb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16c4b090a4aa4d56a90ccf090b9caba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:06.118082 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028c1b5-528b-4aab-bd22-d286567dc8bb service swift] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:06.118594 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028c1b5-528b-4aab-bd22-d286567dc8bb service swift] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:06.119021 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028c1b5-528b-4aab-bd22-d286567dc8bb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:06.131471 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4028c1b5-528b-4aab-bd22-d286567dc8bb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:06.133640 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4028c1b5-528b-4aab-bd22-d286567dc8bb service swift] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:06.143125 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1234/2458] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Sep 7 16:00:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 16:00:07.188702 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8b2e7-5333-428e-84a8-a12a90b0719e None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:07.190161 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8b2e7-5333-428e-84a8-a12a90b0719e None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:07.190493 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8b2e7-5333-428e-84a8-a12a90b0719e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:07.214675 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-73d8b2e7-5333-428e-84a8-a12a90b0719e None None] MFA Rules not processed for user `1eec1d820efc467a8e5856e6302a1885`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:00:07.215961 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-73d8b2e7-5333-428e-84a8-a12a90b0719e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:00:07.316764 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1225/2459] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:00:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:00:16.139447 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=57 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:17.304284 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=28 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:27.201513 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a11a5-e94f-420c-b32d-e1967d485d88 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:27.202025 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a11a5-e94f-420c-b32d-e1967d485d88 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:27.202122 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a11a5-e94f-420c-b32d-e1967d485d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:27.221312 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-ab9a11a5-e94f-420c-b32d-e1967d485d88 None None] MFA Rules not processed for user `a9236158d121445a9a53bce23616cc80`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:00:27.222537 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-ab9a11a5-e94f-420c-b32d-e1967d485d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:00:27.282980 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1235/2460] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:00:27 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:00:31.849624 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d8b2e7-5333-428e-84a8-a12a90b0719e None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:31.912058 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d8b2e7-5333-428e-84a8-a12a90b0719e None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:31.915656 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980f318-2bf1-4432-8c3b-822a545e6aa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:31.916264 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980f318-2bf1-4432-8c3b-822a545e6aa4 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:31.916543 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980f318-2bf1-4432-8c3b-822a545e6aa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:31.916816 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980f318-2bf1-4432-8c3b-822a545e6aa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:31.926451 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a980f318-2bf1-4432-8c3b-822a545e6aa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:31.928003 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a980f318-2bf1-4432-8c3b-822a545e6aa4 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:31.939254 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1226/2461] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:00:31 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:00:37.275688 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=25 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:41.934146 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=26 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:48.619926 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a11a5-e94f-420c-b32d-e1967d485d88 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:48.621391 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-ab9a11a5-e94f-420c-b32d-e1967d485d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:00:48.688096 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a11a5-e94f-420c-b32d-e1967d485d88 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:48.693310 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62599a-7077-406e-af46-f9d07b969c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:48.694123 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62599a-7077-406e-af46-f9d07b969c58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:48.694454 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62599a-7077-406e-af46-f9d07b969c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:48.694734 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62599a-7077-406e-af46-f9d07b969c58 admin admin] PATH_INFO: `/v3/users/d7738e76f24f48d4a66a9237ddbc939e` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:48.695865 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad62599a-7077-406e-af46-f9d07b969c58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7738e76f24f48d4a66a9237ddbc939e)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:48.697838 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad62599a-7077-406e-af46-f9d07b969c58 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:48.745672 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-ad62599a-7077-406e-af46-f9d07b969c58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7738e76f24f48d4a66a9237ddbc939e'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:00:48.752541 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-ad62599a-7077-406e-af46-f9d07b969c58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7738e76f24f48d4a66a9237ddbc939e'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:00:48.753148 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-ad62599a-7077-406e-af46-f9d07b969c58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7738e76f24f48d4a66a9237ddbc939e'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:00:48.765725 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-ad62599a-7077-406e-af46-f9d07b969c58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7738e76f24f48d4a66a9237ddbc939e'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:00:48.766409 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-ad62599a-7077-406e-af46-f9d07b969c58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7738e76f24f48d4a66a9237ddbc939e'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:00:48.779574 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1236/2462] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 16:00:48 2022] DELETE /identity/v3/users/d7738e76f24f48d4a66a9237ddbc939e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:00:48.957953 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980f318-2bf1-4432-8c3b-822a545e6aa4 service neutron] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:48.970256 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980f318-2bf1-4432-8c3b-822a545e6aa4 service neutron] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:49.030378 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee5922-b871-4e82-baa0-761752d5949c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:49.031007 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee5922-b871-4e82-baa0-761752d5949c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:49.031424 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee5922-b871-4e82-baa0-761752d5949c admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:49.031723 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee5922-b871-4e82-baa0-761752d5949c admin admin] PATH_INFO: `/v3/projects/4efa5d7e44bb48fcafe283dc6c39dfa6` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:49.032843 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ee5922-b871-4e82-baa0-761752d5949c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4efa5d7e44bb48fcafe283dc6c39dfa6)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:49.034814 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ee5922-b871-4e82-baa0-761752d5949c admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:49.081387 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-a6ee5922-b871-4e82-baa0-761752d5949c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4efa5d7e44bb48fcafe283dc6c39dfa6', 'request_id': 'req-a6ee5922-b871-4e82-baa0-761752d5949c'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:00:49.087658 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-a6ee5922-b871-4e82-baa0-761752d5949c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4efa5d7e44bb48fcafe283dc6c39dfa6', 'request_id': 'req-a6ee5922-b871-4e82-baa0-761752d5949c'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:00:49.095520 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-a6ee5922-b871-4e82-baa0-761752d5949c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4efa5d7e44bb48fcafe283dc6c39dfa6', 'request_id': 'req-a6ee5922-b871-4e82-baa0-761752d5949c'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:00:49.109359 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-a6ee5922-b871-4e82-baa0-761752d5949c admin admin] The token cache is being invalidate because project 4efa5d7e44bb48fcafe283dc6c39dfa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:00:49.109648 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-a6ee5922-b871-4e82-baa0-761752d5949c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:00:49.110308 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-a6ee5922-b871-4e82-baa0-761752d5949c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:00:49.111798 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1227/2463] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 16:00:48 2022] DELETE /identity/v3/projects/4efa5d7e44bb48fcafe283dc6c39dfa6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:00:49.117417 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5badb-1075-488c-85f6-81c82d09ec19 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:49.117708 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5badb-1075-488c-85f6-81c82d09ec19 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:49.117985 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5badb-1075-488c-85f6-81c82d09ec19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:49.137977 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-14a5badb-1075-488c-85f6-81c82d09ec19 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:00:49.139213 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-14a5badb-1075-488c-85f6-81c82d09ec19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:00:49.199592 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1237/2464] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:00:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:00:49.207505 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803aa2eb-4743-4292-88e5-163e4e1a8125 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:49.207820 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803aa2eb-4743-4292-88e5-163e4e1a8125 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:49.208095 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803aa2eb-4743-4292-88e5-163e4e1a8125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:49.227503 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-803aa2eb-4743-4292-88e5-163e4e1a8125 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:00:49.228705 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-803aa2eb-4743-4292-88e5-163e4e1a8125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:00:49.236857 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1228/2465] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:00:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:00:49.241690 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5badb-1075-488c-85f6-81c82d09ec19 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:49.251264 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5badb-1075-488c-85f6-81c82d09ec19 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:49.256381 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b01dae-93c9-4cc2-91f3-2eba3b113ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:49.256971 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b01dae-93c9-4cc2-91f3-2eba3b113ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:49.257246 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b01dae-93c9-4cc2-91f3-2eba3b113ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:49.257512 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b01dae-93c9-4cc2-91f3-2eba3b113ba1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:49.258151 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b01dae-93c9-4cc2-91f3-2eba3b113ba1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:00:49.258480 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b01dae-93c9-4cc2-91f3-2eba3b113ba1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:49.260056 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b01dae-93c9-4cc2-91f3-2eba3b113ba1 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:49.271209 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1238/2466] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 16:00:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:00:49.275432 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803aa2eb-4743-4292-88e5-163e4e1a8125 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:49.284750 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803aa2eb-4743-4292-88e5-163e4e1a8125 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:49.289458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3884c4-b40f-448d-9c95-1be2d1f76e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:49.290046 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3884c4-b40f-448d-9c95-1be2d1f76e24 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:49.290352 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3884c4-b40f-448d-9c95-1be2d1f76e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:49.290623 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3884c4-b40f-448d-9c95-1be2d1f76e24 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:49.291240 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3884c4-b40f-448d-9c95-1be2d1f76e24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:49.293115 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3884c4-b40f-448d-9c95-1be2d1f76e24 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:49.325611 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1229/2467] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 16:00:49 2022] POST /identity/v3/projects => generated 357 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:00:49.329955 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b01dae-93c9-4cc2-91f3-2eba3b113ba1 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:49.339905 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b01dae-93c9-4cc2-91f3-2eba3b113ba1 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:49.343410 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:49.399386 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ada4d-a097-4abb-b3bc-90ea1f25ad49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:49.399988 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ada4d-a097-4abb-b3bc-90ea1f25ad49 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:49.400269 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ada4d-a097-4abb-b3bc-90ea1f25ad49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:49.400546 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ada4d-a097-4abb-b3bc-90ea1f25ad49 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:49.401165 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ada4d-a097-4abb-b3bc-90ea1f25ad49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:49.403141 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ada4d-a097-4abb-b3bc-90ea1f25ad49 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:49.423675 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1239/2468] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 16:00:49 2022] POST /identity/v3/users => generated 279 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:00:49.428457 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3884c4-b40f-448d-9c95-1be2d1f76e24 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:49.438694 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3884c4-b40f-448d-9c95-1be2d1f76e24 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:49.443982 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e40bda8-412d-4706-ba81-851f31c71b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:49.444572 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40bda8-412d-4706-ba81-851f31c71b7d admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:49.444852 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40bda8-412d-4706-ba81-851f31c71b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:49.445125 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40bda8-412d-4706-ba81-851f31c71b7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:49.445756 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e40bda8-412d-4706-ba81-851f31c71b7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:49.447375 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e40bda8-412d-4706-ba81-851f31c71b7d admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:49.457137 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1230/2469] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:00:49.461192 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ada4d-a097-4abb-b3bc-90ea1f25ad49 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:49.470905 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ada4d-a097-4abb-b3bc-90ea1f25ad49 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:49.476166 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea0189-9918-4eaa-a8e3-e4b765e5e9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:49.476756 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea0189-9918-4eaa-a8e3-e4b765e5e9e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:49.477035 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea0189-9918-4eaa-a8e3-e4b765e5e9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:49.477306 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea0189-9918-4eaa-a8e3-e4b765e5e9e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:49.477962 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea0189-9918-4eaa-a8e3-e4b765e5e9e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:49.479573 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea0189-9918-4eaa-a8e3-e4b765e5e9e4 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:49.491031 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1240/2470] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:00:49.495676 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e40bda8-412d-4706-ba81-851f31c71b7d admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:49.505834 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e40bda8-412d-4706-ba81-851f31c71b7d admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:49.510415 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23478d75-d084-47bf-a10b-1a794cc060f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:49.511053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23478d75-d084-47bf-a10b-1a794cc060f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:49.511329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23478d75-d084-47bf-a10b-1a794cc060f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:49.511597 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23478d75-d084-47bf-a10b-1a794cc060f3 admin admin] PATH_INFO: `/v3/projects/a280c8690feb49eaaed25578d03cbac6/users/4cbe54f923a94728b87169ffa02de4c8/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:49.526640 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23478d75-d084-47bf-a10b-1a794cc060f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a280c8690feb49eaaed25578d03cbac6, user_id=4cbe54f923a94728b87169ffa02de4c8, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:49.529243 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23478d75-d084-47bf-a10b-1a794cc060f3 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:49.541994 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1231/2471] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 16:00:49 2022] PUT /identity/v3/projects/a280c8690feb49eaaed25578d03cbac6/users/4cbe54f923a94728b87169ffa02de4c8/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:00:49.551843 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb2a20f-d3cd-4f72-bc48-49678dba0eae None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:49.552138 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb2a20f-d3cd-4f72-bc48-49678dba0eae None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:49.553029 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb2a20f-d3cd-4f72-bc48-49678dba0eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:49.579990 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-0fb2a20f-d3cd-4f72-bc48-49678dba0eae None None] MFA Rules not processed for user `4cbe54f923a94728b87169ffa02de4c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:00:49.581187 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-0fb2a20f-d3cd-4f72-bc48-49678dba0eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:00:49.643863 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1241/2472] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:00:49 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:00:49.648303 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23478d75-d084-47bf-a10b-1a794cc060f3 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:49.678405 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:49.712658 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23478d75-d084-47bf-a10b-1a794cc060f3 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:49.717226 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2079d2-08e2-47b7-a185-6f6979eb4fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:49.717819 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2079d2-08e2-47b7-a185-6f6979eb4fea admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:49.718101 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2079d2-08e2-47b7-a185-6f6979eb4fea admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:49.718401 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2079d2-08e2-47b7-a185-6f6979eb4fea admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:49.719015 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2079d2-08e2-47b7-a185-6f6979eb4fea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:49.720944 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2079d2-08e2-47b7-a185-6f6979eb4fea admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:49.748527 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1232/2473] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 16:00:49 2022] POST /identity/v3/projects => generated 357 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:00:49.752195 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb2a20f-d3cd-4f72-bc48-49678dba0eae None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:49.763797 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb2a20f-d3cd-4f72-bc48-49678dba0eae None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:49.824643 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cfce92-317a-4647-b5c8-a263d1d489bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:49.825264 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cfce92-317a-4647-b5c8-a263d1d489bd admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:49.825542 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cfce92-317a-4647-b5c8-a263d1d489bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:49.827317 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cfce92-317a-4647-b5c8-a263d1d489bd admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:49.828110 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cfce92-317a-4647-b5c8-a263d1d489bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:49.829996 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cfce92-317a-4647-b5c8-a263d1d489bd admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:49.856223 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1242/2474] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 16:00:49 2022] POST /identity/v3/users => generated 285 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:00:49.857941 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2079d2-08e2-47b7-a185-6f6979eb4fea admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:49.868400 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2079d2-08e2-47b7-a185-6f6979eb4fea admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:49.873032 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db12942-1245-4620-8736-0c909f4355e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:49.873623 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db12942-1245-4620-8736-0c909f4355e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:49.873901 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db12942-1245-4620-8736-0c909f4355e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:49.874309 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db12942-1245-4620-8736-0c909f4355e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:49.874842 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db12942-1245-4620-8736-0c909f4355e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:49.876449 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db12942-1245-4620-8736-0c909f4355e4 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:49.886832 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1233/2475] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:00:49.890938 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cfce92-317a-4647-b5c8-a263d1d489bd admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:49.897904 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:49.902140 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cfce92-317a-4647-b5c8-a263d1d489bd admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:49.907679 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037d8b3-eec8-402f-b73a-6c8174248ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:49.908330 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037d8b3-eec8-402f-b73a-6c8174248ae8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:49.908611 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037d8b3-eec8-402f-b73a-6c8174248ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:49.908886 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037d8b3-eec8-402f-b73a-6c8174248ae8 admin admin] PATH_INFO: `/v3/projects/700b32eff02b40b0bb16c3d2c347542e/users/6e3271f4e29a45a29d77475e751cf300/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:49.924299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c037d8b3-eec8-402f-b73a-6c8174248ae8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=700b32eff02b40b0bb16c3d2c347542e, user_id=6e3271f4e29a45a29d77475e751cf300, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:49.926999 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c037d8b3-eec8-402f-b73a-6c8174248ae8 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:49.939472 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1243/2476] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 16:00:49 2022] PUT /identity/v3/projects/700b32eff02b40b0bb16c3d2c347542e/users/6e3271f4e29a45a29d77475e751cf300/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:00:49.943422 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db12942-1245-4620-8736-0c909f4355e4 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:49.953211 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db12942-1245-4620-8736-0c909f4355e4 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:50.009756 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce08a135-5ad4-4a6f-a2ed-ef848a0a8e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:50.010417 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08a135-5ad4-4a6f-a2ed-ef848a0a8e8d admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:50.010653 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08a135-5ad4-4a6f-a2ed-ef848a0a8e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:50.010923 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08a135-5ad4-4a6f-a2ed-ef848a0a8e8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:50.011544 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce08a135-5ad4-4a6f-a2ed-ef848a0a8e8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:50.013117 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce08a135-5ad4-4a6f-a2ed-ef848a0a8e8d admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:50.023165 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1234/2477] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:00:50.027272 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037d8b3-eec8-402f-b73a-6c8174248ae8 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:50.038633 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037d8b3-eec8-402f-b73a-6c8174248ae8 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:50.043361 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f5211-8f05-4934-bd79-bacab37a1c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:50.044021 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f5211-8f05-4934-bd79-bacab37a1c44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:50.044311 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f5211-8f05-4934-bd79-bacab37a1c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:50.044588 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f5211-8f05-4934-bd79-bacab37a1c44 admin admin] PATH_INFO: `/v3/projects/700b32eff02b40b0bb16c3d2c347542e/users/6e3271f4e29a45a29d77475e751cf300/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:50.046564 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f5211-8f05-4934-bd79-bacab37a1c44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=700b32eff02b40b0bb16c3d2c347542e, user_id=6e3271f4e29a45a29d77475e751cf300, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:50.049230 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f5211-8f05-4934-bd79-bacab37a1c44 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:50.059905 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1244/2478] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 16:00:50 2022] PUT /identity/v3/projects/700b32eff02b40b0bb16c3d2c347542e/users/6e3271f4e29a45a29d77475e751cf300/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:00:50.071438 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec70d0-3282-4d1c-9867-c7018f0fc7dc None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:50.071730 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec70d0-3282-4d1c-9867-c7018f0fc7dc None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:50.072007 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec70d0-3282-4d1c-9867-c7018f0fc7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:50.100462 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-65ec70d0-3282-4d1c-9867-c7018f0fc7dc None None] MFA Rules not processed for user `6e3271f4e29a45a29d77475e751cf300`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:00:50.101714 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-65ec70d0-3282-4d1c-9867-c7018f0fc7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:00:50.172757 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1235/2479] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:00:50 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:00:50.184063 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f5211-8f05-4934-bd79-bacab37a1c44 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:50.185781 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-742f5211-8f05-4934-bd79-bacab37a1c44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:00:50.243829 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f5211-8f05-4934-bd79-bacab37a1c44 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:50.247423 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ddcf2b-f863-4d54-822e-52ce034785a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:50.248014 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ddcf2b-f863-4d54-822e-52ce034785a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:50.248294 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ddcf2b-f863-4d54-822e-52ce034785a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:50.248567 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ddcf2b-f863-4d54-822e-52ce034785a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:50.258214 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ddcf2b-f863-4d54-822e-52ce034785a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:50.259632 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ddcf2b-f863-4d54-822e-52ce034785a2 service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:50.269064 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1245/2480] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:00:50 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:00:50.343758 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec70d0-3282-4d1c-9867-c7018f0fc7dc None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:00:50.353734 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec70d0-3282-4d1c-9867-c7018f0fc7dc None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:00:50.357663 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1221603-4ccd-4c4e-a27f-b1acb994773e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:00:50.358290 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1221603-4ccd-4c4e-a27f-b1acb994773e service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:00:50.358574 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1221603-4ccd-4c4e-a27f-b1acb994773e service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:00:50.358846 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1221603-4ccd-4c4e-a27f-b1acb994773e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:00:50.377921 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:00:50.416825 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1221603-4ccd-4c4e-a27f-b1acb994773e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:00:50.418435 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1221603-4ccd-4c4e-a27f-b1acb994773e service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:00:50.427804 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1236/2481] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:00:50 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:01:00.264824 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=39,keystone:INSERT=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:00.423315 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=18 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:05.013691 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ddcf2b-f863-4d54-822e-52ce034785a2 service cinder] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:05.015109 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-c2ddcf2b-f863-4d54-822e-52ce034785a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:05.073723 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ddcf2b-f863-4d54-822e-52ce034785a2 service cinder] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:05.077366 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b214d4af-f7b7-4eac-a55e-044e1622c7b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:05.077967 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214d4af-f7b7-4eac-a55e-044e1622c7b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:05.078278 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214d4af-f7b7-4eac-a55e-044e1622c7b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:05.078553 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214d4af-f7b7-4eac-a55e-044e1622c7b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:05.080246 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-b214d4af-f7b7-4eac-a55e-044e1622c7b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:05.154057 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b214d4af-f7b7-4eac-a55e-044e1622c7b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:05.155541 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b214d4af-f7b7-4eac-a55e-044e1622c7b1 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:05.167212 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1246/2482] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:01:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:01:05.391362 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1221603-4ccd-4c4e-a27f-b1acb994773e service cinder] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:05.452524 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1221603-4ccd-4c4e-a27f-b1acb994773e service cinder] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:05.457002 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4961849-2984-4ef7-8f54-fdfc51076794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:05.457614 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4961849-2984-4ef7-8f54-fdfc51076794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:05.457891 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4961849-2984-4ef7-8f54-fdfc51076794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:05.458159 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4961849-2984-4ef7-8f54-fdfc51076794 admin admin] PATH_INFO: `/v3/users/4cbe54f923a94728b87169ffa02de4c8` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:05.459300 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4961849-2984-4ef7-8f54-fdfc51076794 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cbe54f923a94728b87169ffa02de4c8)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:05.461778 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4961849-2984-4ef7-8f54-fdfc51076794 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:05.505888 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-f4961849-2984-4ef7-8f54-fdfc51076794 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cbe54f923a94728b87169ffa02de4c8'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:05.513321 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-f4961849-2984-4ef7-8f54-fdfc51076794 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cbe54f923a94728b87169ffa02de4c8'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:05.513948 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-f4961849-2984-4ef7-8f54-fdfc51076794 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cbe54f923a94728b87169ffa02de4c8'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:05.520751 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-f4961849-2984-4ef7-8f54-fdfc51076794 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cbe54f923a94728b87169ffa02de4c8'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:05.521394 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-f4961849-2984-4ef7-8f54-fdfc51076794 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cbe54f923a94728b87169ffa02de4c8'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:05.538238 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1237/2483] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 16:01:05 2022] DELETE /identity/v3/users/4cbe54f923a94728b87169ffa02de4c8 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:01:05.542681 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8dea5-c34e-4a65-ab88-4c78e8ff247c None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:05.542975 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8dea5-c34e-4a65-ab88-4c78e8ff247c None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:05.543256 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8dea5-c34e-4a65-ab88-4c78e8ff247c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:05.562631 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-f2e8dea5-c34e-4a65-ab88-4c78e8ff247c None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:01:05.563838 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-f2e8dea5-c34e-4a65-ab88-4c78e8ff247c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:05.622980 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1247/2484] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:01:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:01:05.633552 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4961849-2984-4ef7-8f54-fdfc51076794 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:05.635248 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-f4961849-2984-4ef7-8f54-fdfc51076794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:05.692966 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4961849-2984-4ef7-8f54-fdfc51076794 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:05.697224 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb3e5b-e9dd-4012-b88c-2f4c524f0e63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:05.697817 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb3e5b-e9dd-4012-b88c-2f4c524f0e63 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:05.698097 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb3e5b-e9dd-4012-b88c-2f4c524f0e63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:05.698400 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb3e5b-e9dd-4012-b88c-2f4c524f0e63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:05.707322 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fb3e5b-e9dd-4012-b88c-2f4c524f0e63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:05.708749 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fb3e5b-e9dd-4012-b88c-2f4c524f0e63 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:05.718399 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1238/2485] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:01:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:01:05.980287 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8dea5-c34e-4a65-ab88-4c78e8ff247c None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:05.982072 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-f2e8dea5-c34e-4a65-ab88-4c78e8ff247c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:05.999107 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8dea5-c34e-4a65-ab88-4c78e8ff247c None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:06.003911 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e253ad9e-2bdb-4d40-a51d-5063865fcc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:06.004561 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253ad9e-2bdb-4d40-a51d-5063865fcc98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:06.004921 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253ad9e-2bdb-4d40-a51d-5063865fcc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:06.005154 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253ad9e-2bdb-4d40-a51d-5063865fcc98 admin admin] PATH_INFO: `/v3/projects/a280c8690feb49eaaed25578d03cbac6` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:06.006351 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e253ad9e-2bdb-4d40-a51d-5063865fcc98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a280c8690feb49eaaed25578d03cbac6)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:06.008257 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e253ad9e-2bdb-4d40-a51d-5063865fcc98 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:06.048054 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:06.057943 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-e253ad9e-2bdb-4d40-a51d-5063865fcc98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a280c8690feb49eaaed25578d03cbac6', 'request_id': 'req-e253ad9e-2bdb-4d40-a51d-5063865fcc98'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:06.063496 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-e253ad9e-2bdb-4d40-a51d-5063865fcc98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a280c8690feb49eaaed25578d03cbac6', 'request_id': 'req-e253ad9e-2bdb-4d40-a51d-5063865fcc98'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:06.069587 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-e253ad9e-2bdb-4d40-a51d-5063865fcc98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a280c8690feb49eaaed25578d03cbac6', 'request_id': 'req-e253ad9e-2bdb-4d40-a51d-5063865fcc98'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:06.081099 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-e253ad9e-2bdb-4d40-a51d-5063865fcc98 admin admin] The token cache is being invalidate because project a280c8690feb49eaaed25578d03cbac6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:01:06.081389 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-e253ad9e-2bdb-4d40-a51d-5063865fcc98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:06.082005 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-e253ad9e-2bdb-4d40-a51d-5063865fcc98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:06.083578 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1248/2486] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 16:01:05 2022] DELETE /identity/v3/projects/a280c8690feb49eaaed25578d03cbac6 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:01:06.087856 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb3e5b-e9dd-4012-b88c-2f4c524f0e63 service neutron] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:06.097309 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb3e5b-e9dd-4012-b88c-2f4c524f0e63 service neutron] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:06.115909 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:06.155840 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc14360-aed1-49ab-9490-e2f61617e7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:06.156462 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc14360-aed1-49ab-9490-e2f61617e7df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:06.156739 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc14360-aed1-49ab-9490-e2f61617e7df admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:06.157010 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc14360-aed1-49ab-9490-e2f61617e7df admin admin] PATH_INFO: `/v3/users/6e3271f4e29a45a29d77475e751cf300` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:06.158107 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc14360-aed1-49ab-9490-e2f61617e7df admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e3271f4e29a45a29d77475e751cf300)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:06.160034 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc14360-aed1-49ab-9490-e2f61617e7df admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:06.205582 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-cfc14360-aed1-49ab-9490-e2f61617e7df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e3271f4e29a45a29d77475e751cf300'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:06.212746 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-cfc14360-aed1-49ab-9490-e2f61617e7df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e3271f4e29a45a29d77475e751cf300'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:06.213402 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-cfc14360-aed1-49ab-9490-e2f61617e7df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e3271f4e29a45a29d77475e751cf300'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:06.220346 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-cfc14360-aed1-49ab-9490-e2f61617e7df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e3271f4e29a45a29d77475e751cf300'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:06.220974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-cfc14360-aed1-49ab-9490-e2f61617e7df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e3271f4e29a45a29d77475e751cf300'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:06.238500 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1239/2487] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 16:01:06 2022] DELETE /identity/v3/users/6e3271f4e29a45a29d77475e751cf300 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:01:06.379157 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e253ad9e-2bdb-4d40-a51d-5063865fcc98 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:06.380792 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-e253ad9e-2bdb-4d40-a51d-5063865fcc98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:06.442931 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e253ad9e-2bdb-4d40-a51d-5063865fcc98 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:06.495434 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6b872-c055-44bf-bdda-838bd08bbe56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:06.496049 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6b872-c055-44bf-bdda-838bd08bbe56 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:06.496333 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6b872-c055-44bf-bdda-838bd08bbe56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:06.496743 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6b872-c055-44bf-bdda-838bd08bbe56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:06.498533 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-7fd6b872-c055-44bf-bdda-838bd08bbe56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:06.518974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc14360-aed1-49ab-9490-e2f61617e7df admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:06.520451 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-cfc14360-aed1-49ab-9490-e2f61617e7df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:06.578480 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd6b872-c055-44bf-bdda-838bd08bbe56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:06.579920 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd6b872-c055-44bf-bdda-838bd08bbe56 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:06.594312 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc14360-aed1-49ab-9490-e2f61617e7df admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:06.599129 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc880d92-2295-42fe-a209-d1e0ed1e37cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:06.599925 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc880d92-2295-42fe-a209-d1e0ed1e37cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:06.600209 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc880d92-2295-42fe-a209-d1e0ed1e37cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:06.600532 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc880d92-2295-42fe-a209-d1e0ed1e37cc admin admin] PATH_INFO: `/v3/projects/700b32eff02b40b0bb16c3d2c347542e` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:06.601669 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc880d92-2295-42fe-a209-d1e0ed1e37cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=700b32eff02b40b0bb16c3d2c347542e)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:06.603568 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1249/2488] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:01:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:01:06.604662 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc880d92-2295-42fe-a209-d1e0ed1e37cc admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:06.651187 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:06.654908 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-bc880d92-2295-42fe-a209-d1e0ed1e37cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '700b32eff02b40b0bb16c3d2c347542e', 'request_id': 'req-bc880d92-2295-42fe-a209-d1e0ed1e37cc'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:06.662160 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-bc880d92-2295-42fe-a209-d1e0ed1e37cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '700b32eff02b40b0bb16c3d2c347542e', 'request_id': 'req-bc880d92-2295-42fe-a209-d1e0ed1e37cc'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:06.669298 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-bc880d92-2295-42fe-a209-d1e0ed1e37cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '700b32eff02b40b0bb16c3d2c347542e', 'request_id': 'req-bc880d92-2295-42fe-a209-d1e0ed1e37cc'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:06.682761 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-bc880d92-2295-42fe-a209-d1e0ed1e37cc admin admin] The token cache is being invalidate because project 700b32eff02b40b0bb16c3d2c347542e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:01:06.683049 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-bc880d92-2295-42fe-a209-d1e0ed1e37cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:06.683696 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-bc880d92-2295-42fe-a209-d1e0ed1e37cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:06.685295 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1240/2489] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 16:01:06 2022] DELETE /identity/v3/projects/700b32eff02b40b0bb16c3d2c347542e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:01:06.690357 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74bf31-f663-4a08-8631-7e1e7f0aa03e None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:06.690652 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74bf31-f663-4a08-8631-7e1e7f0aa03e None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:06.690933 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74bf31-f663-4a08-8631-7e1e7f0aa03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:06.713268 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-2d74bf31-f663-4a08-8631-7e1e7f0aa03e None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:01:06.714537 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-2d74bf31-f663-4a08-8631-7e1e7f0aa03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:06.732278 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:06.783548 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1250/2490] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:01:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:01:06.791568 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6391d88-3e2f-4ee8-966f-6ce4274dfa07 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:06.791883 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6391d88-3e2f-4ee8-966f-6ce4274dfa07 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:06.792187 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6391d88-3e2f-4ee8-966f-6ce4274dfa07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:06.811659 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-e6391d88-3e2f-4ee8-966f-6ce4274dfa07 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:01:06.812867 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-e6391d88-3e2f-4ee8-966f-6ce4274dfa07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:06.821319 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1241/2491] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:01:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:01:06.825323 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74bf31-f663-4a08-8631-7e1e7f0aa03e None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:06.834912 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74bf31-f663-4a08-8631-7e1e7f0aa03e None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:06.840076 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de587eb2-9abf-4f86-9b0c-faca852a27a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:06.840667 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de587eb2-9abf-4f86-9b0c-faca852a27a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:06.840945 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de587eb2-9abf-4f86-9b0c-faca852a27a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:06.841213 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de587eb2-9abf-4f86-9b0c-faca852a27a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:06.841849 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de587eb2-9abf-4f86-9b0c-faca852a27a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:01:06.842151 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de587eb2-9abf-4f86-9b0c-faca852a27a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:06.843753 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de587eb2-9abf-4f86-9b0c-faca852a27a5 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:06.855202 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1251/2492] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 16:01:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:01:06.859614 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6391d88-3e2f-4ee8-966f-6ce4274dfa07 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:06.868673 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6391d88-3e2f-4ee8-966f-6ce4274dfa07 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:06.873306 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3eae74-3133-4541-8455-ff4087cd9b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:06.873885 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3eae74-3133-4541-8455-ff4087cd9b69 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:06.874166 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3eae74-3133-4541-8455-ff4087cd9b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:06.874469 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3eae74-3133-4541-8455-ff4087cd9b69 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:06.875100 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3eae74-3133-4541-8455-ff4087cd9b69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:06.877102 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3eae74-3133-4541-8455-ff4087cd9b69 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:06.904770 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1242/2493] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 16:01:06 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:01:06.909325 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de587eb2-9abf-4f86-9b0c-faca852a27a5 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:06.919854 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de587eb2-9abf-4f86-9b0c-faca852a27a5 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:06.976082 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43baa6-4e96-48d9-aa99-c3460dcddad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:06.976677 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43baa6-4e96-48d9-aa99-c3460dcddad6 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:06.977006 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43baa6-4e96-48d9-aa99-c3460dcddad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:06.977285 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43baa6-4e96-48d9-aa99-c3460dcddad6 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:06.978027 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f43baa6-4e96-48d9-aa99-c3460dcddad6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:06.979991 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f43baa6-4e96-48d9-aa99-c3460dcddad6 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:07.000893 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1252/2494] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 16:01:06 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:01:07.005176 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3eae74-3133-4541-8455-ff4087cd9b69 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:07.016095 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3eae74-3133-4541-8455-ff4087cd9b69 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:07.020675 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ade60-0c75-4542-8388-3338442447fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:07.021266 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ade60-0c75-4542-8388-3338442447fa admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:07.021546 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ade60-0c75-4542-8388-3338442447fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:07.021821 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ade60-0c75-4542-8388-3338442447fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:07.022678 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9ade60-0c75-4542-8388-3338442447fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:07.024432 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9ade60-0c75-4542-8388-3338442447fa admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:07.034305 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1243/2495] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:01:07.038302 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43baa6-4e96-48d9-aa99-c3460dcddad6 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:07.048609 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43baa6-4e96-48d9-aa99-c3460dcddad6 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:07.053287 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd1a94-db4a-4575-b983-2254fa23e909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:07.053883 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd1a94-db4a-4575-b983-2254fa23e909 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:07.054162 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd1a94-db4a-4575-b983-2254fa23e909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:07.054464 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd1a94-db4a-4575-b983-2254fa23e909 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:07.055615 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd1a94-db4a-4575-b983-2254fa23e909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:07.057497 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd1a94-db4a-4575-b983-2254fa23e909 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:07.068433 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1253/2496] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:01:07.073645 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ade60-0c75-4542-8388-3338442447fa admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:07.083624 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ade60-0c75-4542-8388-3338442447fa admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:07.088396 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2082ec3e-b12f-4256-b666-847c9ec1f1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:07.089038 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082ec3e-b12f-4256-b666-847c9ec1f1b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:07.089318 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082ec3e-b12f-4256-b666-847c9ec1f1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:07.089591 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082ec3e-b12f-4256-b666-847c9ec1f1b6 admin admin] PATH_INFO: `/v3/projects/7a8064fdf75c4655b848134ef3bff9ca/users/86cfa37129504f1f906e9bce37601b6d/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:07.103986 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2082ec3e-b12f-4256-b666-847c9ec1f1b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a8064fdf75c4655b848134ef3bff9ca, user_id=86cfa37129504f1f906e9bce37601b6d, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:07.106543 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2082ec3e-b12f-4256-b666-847c9ec1f1b6 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:07.119383 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1244/2497] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 16:01:07 2022] PUT /identity/v3/projects/7a8064fdf75c4655b848134ef3bff9ca/users/86cfa37129504f1f906e9bce37601b6d/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:01:07.130721 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb44cdf-6d3d-4b76-89b4-4e4ed6357283 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:07.131010 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb44cdf-6d3d-4b76-89b4-4e4ed6357283 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:07.131284 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb44cdf-6d3d-4b76-89b4-4e4ed6357283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:07.159314 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-fcb44cdf-6d3d-4b76-89b4-4e4ed6357283 None None] MFA Rules not processed for user `86cfa37129504f1f906e9bce37601b6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:01:07.160508 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-fcb44cdf-6d3d-4b76-89b4-4e4ed6357283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:07.227141 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1254/2498] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:01:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:01:07.232328 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2082ec3e-b12f-4256-b666-847c9ec1f1b6 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:07.294970 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2082ec3e-b12f-4256-b666-847c9ec1f1b6 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:07.299813 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc705cb-65f1-4cb6-b9b4-e2ea1083b64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:07.300442 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc705cb-65f1-4cb6-b9b4-e2ea1083b64d admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:07.300750 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc705cb-65f1-4cb6-b9b4-e2ea1083b64d admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:07.301027 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc705cb-65f1-4cb6-b9b4-e2ea1083b64d admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:07.301648 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc705cb-65f1-4cb6-b9b4-e2ea1083b64d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:07.303603 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc705cb-65f1-4cb6-b9b4-e2ea1083b64d admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:07.331538 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1245/2499] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 16:01:07 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:01:07.335636 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb44cdf-6d3d-4b76-89b4-4e4ed6357283 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:07.346839 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb44cdf-6d3d-4b76-89b4-4e4ed6357283 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:07.360317 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:07.405943 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acfda6c-b490-4723-aaf5-4c9d6a9a053f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:07.406682 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfda6c-b490-4723-aaf5-4c9d6a9a053f admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:07.406961 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfda6c-b490-4723-aaf5-4c9d6a9a053f admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:07.407228 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfda6c-b490-4723-aaf5-4c9d6a9a053f admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:07.407855 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acfda6c-b490-4723-aaf5-4c9d6a9a053f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:07.409817 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acfda6c-b490-4723-aaf5-4c9d6a9a053f admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:07.431108 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1255/2500] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 16:01:07 2022] POST /identity/v3/users => generated 298 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:01:07.435105 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc705cb-65f1-4cb6-b9b4-e2ea1083b64d admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:07.445136 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc705cb-65f1-4cb6-b9b4-e2ea1083b64d admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:07.449776 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb23f3-ea0a-4407-ad64-e408bc49f0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:07.450406 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb23f3-ea0a-4407-ad64-e408bc49f0be admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:07.450685 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb23f3-ea0a-4407-ad64-e408bc49f0be admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:07.450956 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb23f3-ea0a-4407-ad64-e408bc49f0be admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:07.451581 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb23f3-ea0a-4407-ad64-e408bc49f0be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:07.453156 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb23f3-ea0a-4407-ad64-e408bc49f0be admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:07.463825 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1246/2501] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:01:07.467749 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acfda6c-b490-4723-aaf5-4c9d6a9a053f admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:07.478345 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acfda6c-b490-4723-aaf5-4c9d6a9a053f admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:07.483188 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252aab3-cb9e-407e-a1dc-e9c878d2dc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:07.483831 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252aab3-cb9e-407e-a1dc-e9c878d2dc05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:07.484114 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252aab3-cb9e-407e-a1dc-e9c878d2dc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:07.484391 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252aab3-cb9e-407e-a1dc-e9c878d2dc05 admin admin] PATH_INFO: `/v3/projects/e44bf70da7bd40a787d8f399b7acaa37/users/edd9a1d9c9b84222b799b428460f72d4/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:07.499993 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6252aab3-cb9e-407e-a1dc-e9c878d2dc05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e44bf70da7bd40a787d8f399b7acaa37, user_id=edd9a1d9c9b84222b799b428460f72d4, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:07.502694 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6252aab3-cb9e-407e-a1dc-e9c878d2dc05 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:07.514820 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1256/2502] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 16:01:07 2022] PUT /identity/v3/projects/e44bf70da7bd40a787d8f399b7acaa37/users/edd9a1d9c9b84222b799b428460f72d4/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:01:07.518768 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb23f3-ea0a-4407-ad64-e408bc49f0be admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:07.528557 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb23f3-ea0a-4407-ad64-e408bc49f0be admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:07.569670 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:07.587088 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c686a-3205-492c-872a-24d98b6a095f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:07.587692 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c686a-3205-492c-872a-24d98b6a095f admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:07.587974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c686a-3205-492c-872a-24d98b6a095f admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:07.588249 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c686a-3205-492c-872a-24d98b6a095f admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:07.588886 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c686a-3205-492c-872a-24d98b6a095f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:07.590551 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c686a-3205-492c-872a-24d98b6a095f admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:07.600228 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1247/2503] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:01:07.604855 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252aab3-cb9e-407e-a1dc-e9c878d2dc05 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:07.615363 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252aab3-cb9e-407e-a1dc-e9c878d2dc05 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:07.620723 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a453b0-d6c9-4038-924a-09f78bf7e04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:07.621368 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a453b0-d6c9-4038-924a-09f78bf7e04e admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:07.621650 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a453b0-d6c9-4038-924a-09f78bf7e04e admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:07.621926 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a453b0-d6c9-4038-924a-09f78bf7e04e admin admin] PATH_INFO: `/v3/projects/e44bf70da7bd40a787d8f399b7acaa37/users/edd9a1d9c9b84222b799b428460f72d4/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:07.623965 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a453b0-d6c9-4038-924a-09f78bf7e04e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e44bf70da7bd40a787d8f399b7acaa37, user_id=edd9a1d9c9b84222b799b428460f72d4, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:07.626629 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a453b0-d6c9-4038-924a-09f78bf7e04e admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:07.636867 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1257/2504] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 16:01:07 2022] PUT /identity/v3/projects/e44bf70da7bd40a787d8f399b7acaa37/users/edd9a1d9c9b84222b799b428460f72d4/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:01:07.646800 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747208b-80ee-4605-af93-6b834bf282ba None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:07.647116 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747208b-80ee-4605-af93-6b834bf282ba None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:07.647419 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747208b-80ee-4605-af93-6b834bf282ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:07.676083 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-3747208b-80ee-4605-af93-6b834bf282ba None None] MFA Rules not processed for user `edd9a1d9c9b84222b799b428460f72d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:01:07.677305 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-3747208b-80ee-4605-af93-6b834bf282ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:07.747716 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1248/2505] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:01:07 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:01:07.759526 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a453b0-d6c9-4038-924a-09f78bf7e04e admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:07.761460 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-35a453b0-d6c9-4038-924a-09f78bf7e04e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:07.821899 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a453b0-d6c9-4038-924a-09f78bf7e04e admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:07.825508 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f76927-7aeb-454d-902a-ee0bab68db1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:07.826115 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f76927-7aeb-454d-902a-ee0bab68db1f service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:07.826420 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f76927-7aeb-454d-902a-ee0bab68db1f service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:07.826697 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f76927-7aeb-454d-902a-ee0bab68db1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:07.835720 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f76927-7aeb-454d-902a-ee0bab68db1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:07.837631 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f76927-7aeb-454d-902a-ee0bab68db1f service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:07.847231 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1258/2506] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:01:07 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:01:07.877577 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747208b-80ee-4605-af93-6b834bf282ba None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:07.942088 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747208b-80ee-4605-af93-6b834bf282ba None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:07.947041 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf232b4-37d5-4fd3-856f-4ae25c6de3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:07.947671 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf232b4-37d5-4fd3-856f-4ae25c6de3d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:07.947952 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf232b4-37d5-4fd3-856f-4ae25c6de3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:07.948224 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf232b4-37d5-4fd3-856f-4ae25c6de3d3 admin admin] PATH_INFO: `/v3/users/86cfa37129504f1f906e9bce37601b6d` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:07.949464 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf232b4-37d5-4fd3-856f-4ae25c6de3d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86cfa37129504f1f906e9bce37601b6d)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:07.951407 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf232b4-37d5-4fd3-856f-4ae25c6de3d3 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:07.997721 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-1cf232b4-37d5-4fd3-856f-4ae25c6de3d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86cfa37129504f1f906e9bce37601b6d'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:08.004509 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-1cf232b4-37d5-4fd3-856f-4ae25c6de3d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86cfa37129504f1f906e9bce37601b6d'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:08.005153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-1cf232b4-37d5-4fd3-856f-4ae25c6de3d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86cfa37129504f1f906e9bce37601b6d'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:08.012086 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-1cf232b4-37d5-4fd3-856f-4ae25c6de3d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86cfa37129504f1f906e9bce37601b6d'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:08.012711 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-1cf232b4-37d5-4fd3-856f-4ae25c6de3d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86cfa37129504f1f906e9bce37601b6d'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:08.014612 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:08.031669 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1249/2507] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 16:01:07 2022] DELETE /identity/v3/users/86cfa37129504f1f906e9bce37601b6d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:01:08.036241 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d271218-2421-43be-ae14-e7b69c3566c4 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:08.036531 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d271218-2421-43be-ae14-e7b69c3566c4 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:08.036816 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d271218-2421-43be-ae14-e7b69c3566c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:08.056439 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-9d271218-2421-43be-ae14-e7b69c3566c4 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:01:08.057632 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-9d271218-2421-43be-ae14-e7b69c3566c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:08.115966 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1259/2508] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:01:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:01:08.125782 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf232b4-37d5-4fd3-856f-4ae25c6de3d3 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:08.127233 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-1cf232b4-37d5-4fd3-856f-4ae25c6de3d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:08.185508 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf232b4-37d5-4fd3-856f-4ae25c6de3d3 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:08.189192 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd3530-a3e9-4b76-8890-17bf7ce0cdda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:08.189792 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd3530-a3e9-4b76-8890-17bf7ce0cdda service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:08.190071 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd3530-a3e9-4b76-8890-17bf7ce0cdda service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:08.190382 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd3530-a3e9-4b76-8890-17bf7ce0cdda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:08.200359 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd3530-a3e9-4b76-8890-17bf7ce0cdda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:08.201837 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd3530-a3e9-4b76-8890-17bf7ce0cdda service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:08.211997 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1250/2509] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:01:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:01:08.494617 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d271218-2421-43be-ae14-e7b69c3566c4 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:08.496100 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-9d271218-2421-43be-ae14-e7b69c3566c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:08.508112 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d271218-2421-43be-ae14-e7b69c3566c4 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:08.513884 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf38a1-881e-47e8-80d7-3b0a7273bd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:08.514554 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf38a1-881e-47e8-80d7-3b0a7273bd7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:08.514838 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf38a1-881e-47e8-80d7-3b0a7273bd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:08.515114 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf38a1-881e-47e8-80d7-3b0a7273bd7d admin admin] PATH_INFO: `/v3/projects/7a8064fdf75c4655b848134ef3bff9ca` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:08.516291 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cf38a1-881e-47e8-80d7-3b0a7273bd7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a8064fdf75c4655b848134ef3bff9ca)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:08.518229 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cf38a1-881e-47e8-80d7-3b0a7273bd7d admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:08.527359 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:08.566102 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-57cf38a1-881e-47e8-80d7-3b0a7273bd7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a8064fdf75c4655b848134ef3bff9ca', 'request_id': 'req-57cf38a1-881e-47e8-80d7-3b0a7273bd7d'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:08.572161 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-57cf38a1-881e-47e8-80d7-3b0a7273bd7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a8064fdf75c4655b848134ef3bff9ca', 'request_id': 'req-57cf38a1-881e-47e8-80d7-3b0a7273bd7d'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:08.578766 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-57cf38a1-881e-47e8-80d7-3b0a7273bd7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a8064fdf75c4655b848134ef3bff9ca', 'request_id': 'req-57cf38a1-881e-47e8-80d7-3b0a7273bd7d'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:08.591471 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-57cf38a1-881e-47e8-80d7-3b0a7273bd7d admin admin] The token cache is being invalidate because project 7a8064fdf75c4655b848134ef3bff9ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:01:08.591775 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-57cf38a1-881e-47e8-80d7-3b0a7273bd7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:08.592375 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-57cf38a1-881e-47e8-80d7-3b0a7273bd7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:08.593884 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1260/2510] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 16:01:08 2022] DELETE /identity/v3/projects/7a8064fdf75c4655b848134ef3bff9ca => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:01:08.597849 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd3530-a3e9-4b76-8890-17bf7ce0cdda service neutron] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:08.607777 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd3530-a3e9-4b76-8890-17bf7ce0cdda service neutron] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:08.663223 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13581117-5847-437f-8d61-50371d906b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:08.663771 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13581117-5847-437f-8d61-50371d906b55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:08.664065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13581117-5847-437f-8d61-50371d906b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:08.664581 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13581117-5847-437f-8d61-50371d906b55 admin admin] PATH_INFO: `/v3/users/edd9a1d9c9b84222b799b428460f72d4` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:08.665742 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13581117-5847-437f-8d61-50371d906b55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edd9a1d9c9b84222b799b428460f72d4)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:08.667673 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13581117-5847-437f-8d61-50371d906b55 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:08.713277 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-13581117-5847-437f-8d61-50371d906b55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edd9a1d9c9b84222b799b428460f72d4'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:08.720371 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-13581117-5847-437f-8d61-50371d906b55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edd9a1d9c9b84222b799b428460f72d4'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:08.721126 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-13581117-5847-437f-8d61-50371d906b55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edd9a1d9c9b84222b799b428460f72d4'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:08.728316 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-13581117-5847-437f-8d61-50371d906b55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edd9a1d9c9b84222b799b428460f72d4'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:08.729047 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-13581117-5847-437f-8d61-50371d906b55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edd9a1d9c9b84222b799b428460f72d4'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:08.746486 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1251/2511] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 16:01:08 2022] DELETE /identity/v3/users/edd9a1d9c9b84222b799b428460f72d4 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:01:09.014818 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf38a1-881e-47e8-80d7-3b0a7273bd7d admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:09.016263 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-57cf38a1-881e-47e8-80d7-3b0a7273bd7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:09.031374 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf38a1-881e-47e8-80d7-3b0a7273bd7d admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:09.093683 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86125479-458c-4873-8ff4-407a804c7c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:09.094563 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86125479-458c-4873-8ff4-407a804c7c54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:09.094769 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86125479-458c-4873-8ff4-407a804c7c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:09.095109 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86125479-458c-4873-8ff4-407a804c7c54 admin admin] PATH_INFO: `/v3/projects/e44bf70da7bd40a787d8f399b7acaa37` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:09.096308 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86125479-458c-4873-8ff4-407a804c7c54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e44bf70da7bd40a787d8f399b7acaa37)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:09.098307 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86125479-458c-4873-8ff4-407a804c7c54 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:09.147346 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-86125479-458c-4873-8ff4-407a804c7c54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e44bf70da7bd40a787d8f399b7acaa37', 'request_id': 'req-86125479-458c-4873-8ff4-407a804c7c54'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:09.153340 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-86125479-458c-4873-8ff4-407a804c7c54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e44bf70da7bd40a787d8f399b7acaa37', 'request_id': 'req-86125479-458c-4873-8ff4-407a804c7c54'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:09.159740 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-86125479-458c-4873-8ff4-407a804c7c54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e44bf70da7bd40a787d8f399b7acaa37', 'request_id': 'req-86125479-458c-4873-8ff4-407a804c7c54'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:09.172601 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-86125479-458c-4873-8ff4-407a804c7c54 admin admin] The token cache is being invalidate because project e44bf70da7bd40a787d8f399b7acaa37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:01:09.172891 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-86125479-458c-4873-8ff4-407a804c7c54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:09.173512 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-86125479-458c-4873-8ff4-407a804c7c54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:09.175035 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1261/2512] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 16:01:09 2022] DELETE /identity/v3/projects/e44bf70da7bd40a787d8f399b7acaa37 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:01:09.179903 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4697112-476c-4157-bd89-b8569eb1a3b3 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:09.180184 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4697112-476c-4157-bd89-b8569eb1a3b3 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:09.180461 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4697112-476c-4157-bd89-b8569eb1a3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:09.189873 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:09.203234 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-c4697112-476c-4157-bd89-b8569eb1a3b3 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:01:09.204437 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-c4697112-476c-4157-bd89-b8569eb1a3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:09.263383 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1252/2513] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:01:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:01:09.271008 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eef45b-82a1-48b2-ad4f-d96a5d68cb97 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:09.271295 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eef45b-82a1-48b2-ad4f-d96a5d68cb97 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:09.271572 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eef45b-82a1-48b2-ad4f-d96a5d68cb97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:09.293327 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-26eef45b-82a1-48b2-ad4f-d96a5d68cb97 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:01:09.294568 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-26eef45b-82a1-48b2-ad4f-d96a5d68cb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:09.302761 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1262/2514] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:01:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:01:09.307038 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4697112-476c-4157-bd89-b8569eb1a3b3 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:09.316605 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4697112-476c-4157-bd89-b8569eb1a3b3 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:09.321167 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ade21a-05ef-4d30-829d-068d6174f02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:09.321783 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ade21a-05ef-4d30-829d-068d6174f02b admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:09.322063 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ade21a-05ef-4d30-829d-068d6174f02b admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:09.322376 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ade21a-05ef-4d30-829d-068d6174f02b admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:09.323047 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ade21a-05ef-4d30-829d-068d6174f02b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:01:09.323349 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ade21a-05ef-4d30-829d-068d6174f02b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:09.324936 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ade21a-05ef-4d30-829d-068d6174f02b admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:09.336618 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1253/2515] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 16:01:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:01:09.341370 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eef45b-82a1-48b2-ad4f-d96a5d68cb97 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:09.350623 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eef45b-82a1-48b2-ad4f-d96a5d68cb97 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:09.355903 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0239b1d-65f2-4374-94ff-1337848d6f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:09.356487 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0239b1d-65f2-4374-94ff-1337848d6f8a admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:09.357011 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0239b1d-65f2-4374-94ff-1337848d6f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:09.357289 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0239b1d-65f2-4374-94ff-1337848d6f8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:09.357936 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0239b1d-65f2-4374-94ff-1337848d6f8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:09.359928 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0239b1d-65f2-4374-94ff-1337848d6f8a admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:09.381328 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:09.390534 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1263/2516] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 16:01:09 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:01:09.394822 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ade21a-05ef-4d30-829d-068d6174f02b admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:09.405296 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ade21a-05ef-4d30-829d-068d6174f02b admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:09.460146 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba76d9-9bc3-4c8d-9940-08d21b98f5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:09.460676 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba76d9-9bc3-4c8d-9940-08d21b98f5bb admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:09.460958 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba76d9-9bc3-4c8d-9940-08d21b98f5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:09.461232 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba76d9-9bc3-4c8d-9940-08d21b98f5bb admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:09.461852 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba76d9-9bc3-4c8d-9940-08d21b98f5bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:09.464321 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba76d9-9bc3-4c8d-9940-08d21b98f5bb admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:09.485554 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1254/2517] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 16:01:09 2022] POST /identity/v3/users => generated 294 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:01:09.490536 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0239b1d-65f2-4374-94ff-1337848d6f8a admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:09.501119 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0239b1d-65f2-4374-94ff-1337848d6f8a admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:09.505730 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e479421-2b86-41e2-a1fe-24e02290ae8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:09.506360 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e479421-2b86-41e2-a1fe-24e02290ae8a admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:09.506638 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e479421-2b86-41e2-a1fe-24e02290ae8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:09.506907 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e479421-2b86-41e2-a1fe-24e02290ae8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:09.507537 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e479421-2b86-41e2-a1fe-24e02290ae8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:09.509173 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e479421-2b86-41e2-a1fe-24e02290ae8a admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:09.519093 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1264/2518] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:01:09.523037 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba76d9-9bc3-4c8d-9940-08d21b98f5bb admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:09.533676 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba76d9-9bc3-4c8d-9940-08d21b98f5bb admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:09.538286 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd9414-2d1d-4a8e-b1bc-a5016aab5a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:09.538877 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd9414-2d1d-4a8e-b1bc-a5016aab5a9d admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:09.539156 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd9414-2d1d-4a8e-b1bc-a5016aab5a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:09.539435 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd9414-2d1d-4a8e-b1bc-a5016aab5a9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:09.540065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfd9414-2d1d-4a8e-b1bc-a5016aab5a9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:09.542315 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfd9414-2d1d-4a8e-b1bc-a5016aab5a9d admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:09.552702 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1255/2519] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:01:09.556688 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e479421-2b86-41e2-a1fe-24e02290ae8a admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:09.566407 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e479421-2b86-41e2-a1fe-24e02290ae8a admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:09.570966 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c61dab-6ef2-483b-8fb1-37cf4e299a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:09.571598 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c61dab-6ef2-483b-8fb1-37cf4e299a11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:09.572385 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c61dab-6ef2-483b-8fb1-37cf4e299a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:09.572651 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c61dab-6ef2-483b-8fb1-37cf4e299a11 admin admin] PATH_INFO: `/v3/projects/0f0c9430a0814a8faa6a049995816e50/users/951608e12f334c12ac6885faadb0fa3a/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:09.586931 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c61dab-6ef2-483b-8fb1-37cf4e299a11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f0c9430a0814a8faa6a049995816e50, user_id=951608e12f334c12ac6885faadb0fa3a, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:09.590112 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c61dab-6ef2-483b-8fb1-37cf4e299a11 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:09.606198 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1265/2520] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 16:01:09 2022] PUT /identity/v3/projects/0f0c9430a0814a8faa6a049995816e50/users/951608e12f334c12ac6885faadb0fa3a/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:01:09.617569 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61571b21-f940-4de2-985e-ffe01074ee86 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:09.618073 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61571b21-f940-4de2-985e-ffe01074ee86 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:09.618271 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61571b21-f940-4de2-985e-ffe01074ee86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:09.647321 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-61571b21-f940-4de2-985e-ffe01074ee86 None None] MFA Rules not processed for user `951608e12f334c12ac6885faadb0fa3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:01:09.648631 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-61571b21-f940-4de2-985e-ffe01074ee86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:09.712240 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:09.716903 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1256/2521] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:01:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:01:09.721669 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c61dab-6ef2-483b-8fb1-37cf4e299a11 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:09.789368 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c61dab-6ef2-483b-8fb1-37cf4e299a11 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:09.794508 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d11ba2-8dc4-4bde-8bd6-54fbfa1fe3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:09.795499 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d11ba2-8dc4-4bde-8bd6-54fbfa1fe3e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:09.795790 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d11ba2-8dc4-4bde-8bd6-54fbfa1fe3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:09.796071 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d11ba2-8dc4-4bde-8bd6-54fbfa1fe3e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:09.796753 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d11ba2-8dc4-4bde-8bd6-54fbfa1fe3e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:09.798754 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d11ba2-8dc4-4bde-8bd6-54fbfa1fe3e2 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:09.831677 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1266/2522] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 16:01:09 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:01:09.832875 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61571b21-f940-4de2-985e-ffe01074ee86 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:09.845361 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61571b21-f940-4de2-985e-ffe01074ee86 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:09.912115 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e858f2-2499-49b5-be12-9d7a28ae49d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:09.912856 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e858f2-2499-49b5-be12-9d7a28ae49d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:09.913256 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e858f2-2499-49b5-be12-9d7a28ae49d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:09.913568 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e858f2-2499-49b5-be12-9d7a28ae49d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:09.914298 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e858f2-2499-49b5-be12-9d7a28ae49d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:09.916383 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e858f2-2499-49b5-be12-9d7a28ae49d7 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:09.941900 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1257/2523] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 16:01:09 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:01:09.943587 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d11ba2-8dc4-4bde-8bd6-54fbfa1fe3e2 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:09.954656 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d11ba2-8dc4-4bde-8bd6-54fbfa1fe3e2 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:09.959411 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a9b77-6866-4a3b-adff-e6fc843887b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:09.960105 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a9b77-6866-4a3b-adff-e6fc843887b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:09.960366 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a9b77-6866-4a3b-adff-e6fc843887b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:09.960720 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a9b77-6866-4a3b-adff-e6fc843887b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:09.961619 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a9b77-6866-4a3b-adff-e6fc843887b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:09.964066 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a9b77-6866-4a3b-adff-e6fc843887b7 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:09.974663 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1267/2524] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:01:09.978611 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e858f2-2499-49b5-be12-9d7a28ae49d7 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:09.988718 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e858f2-2499-49b5-be12-9d7a28ae49d7 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:09.994236 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd06391a-1774-4f37-b4c8-b929218ca7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:09.994841 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06391a-1774-4f37-b4c8-b929218ca7fa admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:09.995125 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06391a-1774-4f37-b4c8-b929218ca7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:09.995422 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06391a-1774-4f37-b4c8-b929218ca7fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:09.996082 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd06391a-1774-4f37-b4c8-b929218ca7fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:09.997676 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd06391a-1774-4f37-b4c8-b929218ca7fa admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:10.007887 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1258/2525] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:01:10.012518 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a9b77-6866-4a3b-adff-e6fc843887b7 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:10.022437 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a9b77-6866-4a3b-adff-e6fc843887b7 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:10.027272 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c697341-86e9-4ac9-b429-b6af99a1cdc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:10.027913 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c697341-86e9-4ac9-b429-b6af99a1cdc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:10.028195 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c697341-86e9-4ac9-b429-b6af99a1cdc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:10.028478 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c697341-86e9-4ac9-b429-b6af99a1cdc2 admin admin] PATH_INFO: `/v3/projects/649f08b574024127bd836aab4609e46a/users/f5faaf6531e2470a92b2046937beb6d1/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:10.045178 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c697341-86e9-4ac9-b429-b6af99a1cdc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=649f08b574024127bd836aab4609e46a, user_id=f5faaf6531e2470a92b2046937beb6d1, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:10.047875 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c697341-86e9-4ac9-b429-b6af99a1cdc2 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:10.061310 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1268/2526] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 16:01:10 2022] PUT /identity/v3/projects/649f08b574024127bd836aab4609e46a/users/f5faaf6531e2470a92b2046937beb6d1/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:01:10.071426 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d442e39-d65f-4222-8f9e-78981747185f None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:10.071718 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d442e39-d65f-4222-8f9e-78981747185f None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:10.072608 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d442e39-d65f-4222-8f9e-78981747185f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:10.101444 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-6d442e39-d65f-4222-8f9e-78981747185f None None] MFA Rules not processed for user `f5faaf6531e2470a92b2046937beb6d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:01:10.102697 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-6d442e39-d65f-4222-8f9e-78981747185f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:10.170596 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1259/2527] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:01:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:01:10.175214 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c697341-86e9-4ac9-b429-b6af99a1cdc2 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:10.241312 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c697341-86e9-4ac9-b429-b6af99a1cdc2 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:10.247114 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7529e062-c8be-416d-9a33-1e192e22f2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:10.247231 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529e062-c8be-416d-9a33-1e192e22f2dd admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:10.247433 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529e062-c8be-416d-9a33-1e192e22f2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:10.247710 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529e062-c8be-416d-9a33-1e192e22f2dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:10.248339 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7529e062-c8be-416d-9a33-1e192e22f2dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:10.250281 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7529e062-c8be-416d-9a33-1e192e22f2dd admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:10.272792 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:10.282887 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1269/2528] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 16:01:10 2022] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:01:10.286951 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d442e39-d65f-4222-8f9e-78981747185f None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:10.298415 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d442e39-d65f-4222-8f9e-78981747185f None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:10.358710 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54308d2d-4458-4b02-b763-002fde0a0987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:10.359316 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54308d2d-4458-4b02-b763-002fde0a0987 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:10.359594 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54308d2d-4458-4b02-b763-002fde0a0987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:10.359864 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54308d2d-4458-4b02-b763-002fde0a0987 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:10.360477 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54308d2d-4458-4b02-b763-002fde0a0987 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:10.362399 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54308d2d-4458-4b02-b763-002fde0a0987 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:10.378396 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:10.384756 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1260/2529] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 16:01:10 2022] POST /identity/v3/users => generated 300 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:01:10.388725 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7529e062-c8be-416d-9a33-1e192e22f2dd admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:10.398980 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7529e062-c8be-416d-9a33-1e192e22f2dd admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:10.403790 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d317b0a5-8108-4d54-be02-76ea64bac9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:10.404384 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317b0a5-8108-4d54-be02-76ea64bac9c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:10.404663 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317b0a5-8108-4d54-be02-76ea64bac9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:10.404936 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317b0a5-8108-4d54-be02-76ea64bac9c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:10.405566 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d317b0a5-8108-4d54-be02-76ea64bac9c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:10.407174 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d317b0a5-8108-4d54-be02-76ea64bac9c3 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:10.418508 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1270/2530] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:01:10.422389 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54308d2d-4458-4b02-b763-002fde0a0987 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:10.432886 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54308d2d-4458-4b02-b763-002fde0a0987 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:10.437485 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e914b7-c2a5-44eb-bffc-9fea23e6856a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:10.438125 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e914b7-c2a5-44eb-bffc-9fea23e6856a admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:10.438447 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e914b7-c2a5-44eb-bffc-9fea23e6856a admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:10.438723 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e914b7-c2a5-44eb-bffc-9fea23e6856a admin admin] PATH_INFO: `/v3/projects/9f62382b8c004c03a152f0b3374c512e/users/d180888db724483897fe64b53b080265/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:10.453134 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e914b7-c2a5-44eb-bffc-9fea23e6856a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f62382b8c004c03a152f0b3374c512e, user_id=d180888db724483897fe64b53b080265, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:10.455814 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e914b7-c2a5-44eb-bffc-9fea23e6856a admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:10.468429 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1261/2531] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 16:01:10 2022] PUT /identity/v3/projects/9f62382b8c004c03a152f0b3374c512e/users/d180888db724483897fe64b53b080265/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:01:10.472347 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d317b0a5-8108-4d54-be02-76ea64bac9c3 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:10.483482 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d317b0a5-8108-4d54-be02-76ea64bac9c3 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:10.539247 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ce127-9c99-40b0-8c1a-daa8bf9f73ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:10.539768 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ce127-9c99-40b0-8c1a-daa8bf9f73ae admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:10.540045 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ce127-9c99-40b0-8c1a-daa8bf9f73ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:10.540321 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ce127-9c99-40b0-8c1a-daa8bf9f73ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:10.541684 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ce127-9c99-40b0-8c1a-daa8bf9f73ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:10.543305 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ce127-9c99-40b0-8c1a-daa8bf9f73ae admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:10.552702 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1271/2532] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:01:10.557740 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e914b7-c2a5-44eb-bffc-9fea23e6856a admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:10.567940 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e914b7-c2a5-44eb-bffc-9fea23e6856a admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:10.573012 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0aad95-9654-4450-b7f0-7d4c15a23c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:10.573653 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0aad95-9654-4450-b7f0-7d4c15a23c2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:10.573932 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0aad95-9654-4450-b7f0-7d4c15a23c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:10.574245 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0aad95-9654-4450-b7f0-7d4c15a23c2f admin admin] PATH_INFO: `/v3/projects/9f62382b8c004c03a152f0b3374c512e/users/d180888db724483897fe64b53b080265/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:10.576150 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0aad95-9654-4450-b7f0-7d4c15a23c2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f62382b8c004c03a152f0b3374c512e, user_id=d180888db724483897fe64b53b080265, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:10.578802 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0aad95-9654-4450-b7f0-7d4c15a23c2f admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:10.588969 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1262/2533] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 16:01:10 2022] PUT /identity/v3/projects/9f62382b8c004c03a152f0b3374c512e/users/d180888db724483897fe64b53b080265/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:01:10.598936 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ee695-39ac-4681-9dce-425138fdf99e None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:10.599252 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ee695-39ac-4681-9dce-425138fdf99e None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:10.599563 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ee695-39ac-4681-9dce-425138fdf99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:10.628966 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-b25ee695-39ac-4681-9dce-425138fdf99e None None] MFA Rules not processed for user `d180888db724483897fe64b53b080265`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:01:10.630167 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-b25ee695-39ac-4681-9dce-425138fdf99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:10.695693 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1272/2534] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:01:10 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:01:10.706590 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0aad95-9654-4450-b7f0-7d4c15a23c2f admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:10.708345 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-ed0aad95-9654-4450-b7f0-7d4c15a23c2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:10.765774 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0aad95-9654-4450-b7f0-7d4c15a23c2f admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:10.769401 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c57c77-ea8d-4cf4-9681-67ec2b5745dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:10.769993 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c57c77-ea8d-4cf4-9681-67ec2b5745dd service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:10.770303 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c57c77-ea8d-4cf4-9681-67ec2b5745dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:10.770581 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c57c77-ea8d-4cf4-9681-67ec2b5745dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:10.780074 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c57c77-ea8d-4cf4-9681-67ec2b5745dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:10.781494 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c57c77-ea8d-4cf4-9681-67ec2b5745dd service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:10.791559 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1263/2535] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:01:10 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:01:11.315461 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ee695-39ac-4681-9dce-425138fdf99e None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:11.316899 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-b25ee695-39ac-4681-9dce-425138fdf99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:11.329912 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ee695-39ac-4681-9dce-425138fdf99e None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:11.346798 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5e802-75d0-4824-9992-acdee68cdef0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:11.347433 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5e802-75d0-4824-9992-acdee68cdef0 service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:11.348033 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5e802-75d0-4824-9992-acdee68cdef0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:11.348033 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5e802-75d0-4824-9992-acdee68cdef0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:11.412320 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a5e802-75d0-4824-9992-acdee68cdef0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:11.413776 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a5e802-75d0-4824-9992-acdee68cdef0 service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:11.424258 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1273/2536] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:01:11 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:01:15.466689 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c57c77-ea8d-4cf4-9681-67ec2b5745dd service cinder] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:15.475126 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c57c77-ea8d-4cf4-9681-67ec2b5745dd service cinder] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:15.480259 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60c421-5d06-4a34-a427-8e392fdb7e41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:15.481018 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60c421-5d06-4a34-a427-8e392fdb7e41 service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:15.481299 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60c421-5d06-4a34-a427-8e392fdb7e41 service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:15.481576 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60c421-5d06-4a34-a427-8e392fdb7e41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:15.541415 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c60c421-5d06-4a34-a427-8e392fdb7e41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:15.542866 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c60c421-5d06-4a34-a427-8e392fdb7e41 service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:15.551602 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1264/2537] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:01:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:01:17.629307 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5e802-75d0-4824-9992-acdee68cdef0 service cinder] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:17.638635 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:17.694591 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5e802-75d0-4824-9992-acdee68cdef0 service cinder] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:17.700765 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d87b9b-8a89-462b-acbd-8a94ac50e008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:17.701396 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d87b9b-8a89-462b-acbd-8a94ac50e008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:17.701676 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d87b9b-8a89-462b-acbd-8a94ac50e008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:17.701952 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d87b9b-8a89-462b-acbd-8a94ac50e008 admin admin] PATH_INFO: `/v3/users/951608e12f334c12ac6885faadb0fa3a` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:17.703296 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60c421-5d06-4a34-a427-8e392fdb7e41 service cinder] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:17.703791 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d87b9b-8a89-462b-acbd-8a94ac50e008 admin admin] RBAC: Authorizing `identity:delete_user(user_id=951608e12f334c12ac6885faadb0fa3a)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:17.704694 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-3c60c421-5d06-4a34-a427-8e392fdb7e41 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:17.705227 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d87b9b-8a89-462b-acbd-8a94ac50e008 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:17.754667 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-94d87b9b-8a89-462b-acbd-8a94ac50e008 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '951608e12f334c12ac6885faadb0fa3a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:17.763561 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-94d87b9b-8a89-462b-acbd-8a94ac50e008 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '951608e12f334c12ac6885faadb0fa3a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:17.764239 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-94d87b9b-8a89-462b-acbd-8a94ac50e008 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '951608e12f334c12ac6885faadb0fa3a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:17.765700 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:17.777776 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-94d87b9b-8a89-462b-acbd-8a94ac50e008 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '951608e12f334c12ac6885faadb0fa3a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:17.778675 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-94d87b9b-8a89-462b-acbd-8a94ac50e008 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '951608e12f334c12ac6885faadb0fa3a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:17.782194 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60c421-5d06-4a34-a427-8e392fdb7e41 service cinder] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:17.787636 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63965f-c183-42f3-a17c-1d81269249a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:17.788240 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63965f-c183-42f3-a17c-1d81269249a6 service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:17.788519 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63965f-c183-42f3-a17c-1d81269249a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:17.788790 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63965f-c183-42f3-a17c-1d81269249a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:17.790522 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-9e63965f-c183-42f3-a17c-1d81269249a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:17.791162 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1274/2538] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 16:01:17 2022] DELETE /identity/v3/users/951608e12f334c12ac6885faadb0fa3a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:01:17.795490 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d5359-cf42-4143-9aa1-e0377782fbff None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:17.795782 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d5359-cf42-4143-9aa1-e0377782fbff None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:17.796061 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d5359-cf42-4143-9aa1-e0377782fbff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:17.815845 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-5d2d5359-cf42-4143-9aa1-e0377782fbff None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:01:17.817072 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-5d2d5359-cf42-4143-9aa1-e0377782fbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:17.850837 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e63965f-c183-42f3-a17c-1d81269249a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:17.852573 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e63965f-c183-42f3-a17c-1d81269249a6 service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:17.862472 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1265/2539] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:01:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:01:17.881615 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1275/2540] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:01:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:01:17.888928 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63965f-c183-42f3-a17c-1d81269249a6 service nova] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:17.890354 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-9e63965f-c183-42f3-a17c-1d81269249a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:17.959646 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63965f-c183-42f3-a17c-1d81269249a6 service nova] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:18.010383 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a62c0b-31d3-408e-be64-88b3c2305f9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:18.010997 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a62c0b-31d3-408e-be64-88b3c2305f9c service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:18.011281 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a62c0b-31d3-408e-be64-88b3c2305f9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:18.011555 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a62c0b-31d3-408e-be64-88b3c2305f9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:18.022761 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a62c0b-31d3-408e-be64-88b3c2305f9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:18.024211 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a62c0b-31d3-408e-be64-88b3c2305f9c service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:18.039983 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1266/2541] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:01:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:01:18.334835 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d5359-cf42-4143-9aa1-e0377782fbff None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:18.336301 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-5d2d5359-cf42-4143-9aa1-e0377782fbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:18.350021 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d5359-cf42-4143-9aa1-e0377782fbff None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:18.355538 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3a083-ee85-413c-903e-f50f058d5dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:18.356153 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3a083-ee85-413c-903e-f50f058d5dd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:18.356440 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3a083-ee85-413c-903e-f50f058d5dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:18.357095 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3a083-ee85-413c-903e-f50f058d5dd9 admin admin] PATH_INFO: `/v3/projects/0f0c9430a0814a8faa6a049995816e50` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:18.358247 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3a083-ee85-413c-903e-f50f058d5dd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f0c9430a0814a8faa6a049995816e50)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:18.360175 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3a083-ee85-413c-903e-f50f058d5dd9 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:18.383075 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:18.411134 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-5de3a083-ee85-413c-903e-f50f058d5dd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f0c9430a0814a8faa6a049995816e50', 'request_id': 'req-5de3a083-ee85-413c-903e-f50f058d5dd9'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:18.417627 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-5de3a083-ee85-413c-903e-f50f058d5dd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f0c9430a0814a8faa6a049995816e50', 'request_id': 'req-5de3a083-ee85-413c-903e-f50f058d5dd9'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:18.424125 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-5de3a083-ee85-413c-903e-f50f058d5dd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f0c9430a0814a8faa6a049995816e50', 'request_id': 'req-5de3a083-ee85-413c-903e-f50f058d5dd9'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:18.436703 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-5de3a083-ee85-413c-903e-f50f058d5dd9 admin admin] The token cache is being invalidate because project 0f0c9430a0814a8faa6a049995816e50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:01:18.436994 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-5de3a083-ee85-413c-903e-f50f058d5dd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:18.437619 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-5de3a083-ee85-413c-903e-f50f058d5dd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:18.439369 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1276/2542] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 16:01:18 2022] DELETE /identity/v3/projects/0f0c9430a0814a8faa6a049995816e50 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:01:18.443154 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a62c0b-31d3-408e-be64-88b3c2305f9c service neutron] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:18.452724 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a62c0b-31d3-408e-be64-88b3c2305f9c service neutron] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:18.505118 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:18.512419 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a716853-9550-4d18-a61c-22cb2167bc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:18.513076 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a716853-9550-4d18-a61c-22cb2167bc9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:18.513364 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a716853-9550-4d18-a61c-22cb2167bc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:18.513666 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a716853-9550-4d18-a61c-22cb2167bc9e admin admin] PATH_INFO: `/v3/users/f5faaf6531e2470a92b2046937beb6d1` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:18.514874 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a716853-9550-4d18-a61c-22cb2167bc9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5faaf6531e2470a92b2046937beb6d1)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:18.516802 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a716853-9550-4d18-a61c-22cb2167bc9e admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:18.562502 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-3a716853-9550-4d18-a61c-22cb2167bc9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5faaf6531e2470a92b2046937beb6d1'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:18.570623 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-3a716853-9550-4d18-a61c-22cb2167bc9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5faaf6531e2470a92b2046937beb6d1'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:18.571235 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-3a716853-9550-4d18-a61c-22cb2167bc9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5faaf6531e2470a92b2046937beb6d1'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:18.578848 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-3a716853-9550-4d18-a61c-22cb2167bc9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5faaf6531e2470a92b2046937beb6d1'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:18.579500 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-3a716853-9550-4d18-a61c-22cb2167bc9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5faaf6531e2470a92b2046937beb6d1'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:18.597400 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1267/2543] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 16:01:18 2022] DELETE /identity/v3/users/f5faaf6531e2470a92b2046937beb6d1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:01:18.875835 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3a083-ee85-413c-903e-f50f058d5dd9 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:18.877369 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-5de3a083-ee85-413c-903e-f50f058d5dd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:18.891672 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3a083-ee85-413c-903e-f50f058d5dd9 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:18.958673 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f6164-9e5c-4621-b83b-33476c87aa2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:18.959320 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f6164-9e5c-4621-b83b-33476c87aa2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:18.959612 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f6164-9e5c-4621-b83b-33476c87aa2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:18.959880 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f6164-9e5c-4621-b83b-33476c87aa2a admin admin] PATH_INFO: `/v3/projects/649f08b574024127bd836aab4609e46a` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:18.961024 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f6164-9e5c-4621-b83b-33476c87aa2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=649f08b574024127bd836aab4609e46a)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:18.963557 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f6164-9e5c-4621-b83b-33476c87aa2a admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:19.010757 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2f9f6164-9e5c-4621-b83b-33476c87aa2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '649f08b574024127bd836aab4609e46a', 'request_id': 'req-2f9f6164-9e5c-4621-b83b-33476c87aa2a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:19.016209 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2f9f6164-9e5c-4621-b83b-33476c87aa2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '649f08b574024127bd836aab4609e46a', 'request_id': 'req-2f9f6164-9e5c-4621-b83b-33476c87aa2a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:19.022324 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2f9f6164-9e5c-4621-b83b-33476c87aa2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '649f08b574024127bd836aab4609e46a', 'request_id': 'req-2f9f6164-9e5c-4621-b83b-33476c87aa2a'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:19.034576 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2f9f6164-9e5c-4621-b83b-33476c87aa2a admin admin] The token cache is being invalidate because project 649f08b574024127bd836aab4609e46a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:01:19.034869 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2f9f6164-9e5c-4621-b83b-33476c87aa2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:19.035533 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-2f9f6164-9e5c-4621-b83b-33476c87aa2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:19.040214 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1277/2544] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 16:01:18 2022] DELETE /identity/v3/projects/649f08b574024127bd836aab4609e46a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:01:19.041438 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a716853-9550-4d18-a61c-22cb2167bc9e admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:19.043461 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-3a716853-9550-4d18-a61c-22cb2167bc9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:19.056637 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a716853-9550-4d18-a61c-22cb2167bc9e admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:19.115878 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0bb84c-e2b2-42fa-b237-be829a036330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:19.116516 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0bb84c-e2b2-42fa-b237-be829a036330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:19.116823 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0bb84c-e2b2-42fa-b237-be829a036330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:19.117073 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0bb84c-e2b2-42fa-b237-be829a036330 admin admin] PATH_INFO: `/v3/users/d180888db724483897fe64b53b080265` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:19.118807 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0bb84c-e2b2-42fa-b237-be829a036330 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d180888db724483897fe64b53b080265)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:19.121223 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0bb84c-e2b2-42fa-b237-be829a036330 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:19.169450 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-fa0bb84c-e2b2-42fa-b237-be829a036330 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd180888db724483897fe64b53b080265'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:19.177346 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-fa0bb84c-e2b2-42fa-b237-be829a036330 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd180888db724483897fe64b53b080265'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:19.177995 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-fa0bb84c-e2b2-42fa-b237-be829a036330 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd180888db724483897fe64b53b080265'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:19.185634 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-fa0bb84c-e2b2-42fa-b237-be829a036330 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd180888db724483897fe64b53b080265'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:19.186392 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-fa0bb84c-e2b2-42fa-b237-be829a036330 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd180888db724483897fe64b53b080265'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:19.199585 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:19.208768 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1268/2545] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 16:01:19 2022] DELETE /identity/v3/users/d180888db724483897fe64b53b080265 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:01:19.515892 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f6164-9e5c-4621-b83b-33476c87aa2a admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:19.517838 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-2f9f6164-9e5c-4621-b83b-33476c87aa2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:19.532985 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f6164-9e5c-4621-b83b-33476c87aa2a admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:19.573719 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:19.593958 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae257a-d035-4a33-a426-62c9d208d0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:19.594629 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae257a-d035-4a33-a426-62c9d208d0f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:19.594917 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae257a-d035-4a33-a426-62c9d208d0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:19.595198 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae257a-d035-4a33-a426-62c9d208d0f3 admin admin] PATH_INFO: `/v3/projects/9f62382b8c004c03a152f0b3374c512e` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:19.596372 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ae257a-d035-4a33-a426-62c9d208d0f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f62382b8c004c03a152f0b3374c512e)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:19.598439 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ae257a-d035-4a33-a426-62c9d208d0f3 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:19.645685 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-44ae257a-d035-4a33-a426-62c9d208d0f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f62382b8c004c03a152f0b3374c512e', 'request_id': 'req-44ae257a-d035-4a33-a426-62c9d208d0f3'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:19.651182 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-44ae257a-d035-4a33-a426-62c9d208d0f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f62382b8c004c03a152f0b3374c512e', 'request_id': 'req-44ae257a-d035-4a33-a426-62c9d208d0f3'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:19.657238 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-44ae257a-d035-4a33-a426-62c9d208d0f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f62382b8c004c03a152f0b3374c512e', 'request_id': 'req-44ae257a-d035-4a33-a426-62c9d208d0f3'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:19.671240 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-44ae257a-d035-4a33-a426-62c9d208d0f3 admin admin] The token cache is being invalidate because project 9f62382b8c004c03a152f0b3374c512e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:01:19.671523 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-44ae257a-d035-4a33-a426-62c9d208d0f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:19.672145 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-44ae257a-d035-4a33-a426-62c9d208d0f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:19.673621 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1278/2546] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 16:01:19 2022] DELETE /identity/v3/projects/9f62382b8c004c03a152f0b3374c512e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:01:19.679610 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b3f86-9121-477a-a0e7-f0b9f74ecda5 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:19.680055 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b3f86-9121-477a-a0e7-f0b9f74ecda5 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:19.680334 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b3f86-9121-477a-a0e7-f0b9f74ecda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:19.701012 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-4e4b3f86-9121-477a-a0e7-f0b9f74ecda5 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:01:19.702248 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-4e4b3f86-9121-477a-a0e7-f0b9f74ecda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:19.762822 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1269/2547] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:01:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:01:19.771287 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d99fcb-2ecc-43e9-88dc-758a9467fcbd None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:19.771576 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d99fcb-2ecc-43e9-88dc-758a9467fcbd None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:19.771850 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d99fcb-2ecc-43e9-88dc-758a9467fcbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:19.792708 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-c1d99fcb-2ecc-43e9-88dc-758a9467fcbd None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:01:19.793932 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-c1d99fcb-2ecc-43e9-88dc-758a9467fcbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:19.801803 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1279/2548] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:01:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:01:19.806025 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b3f86-9121-477a-a0e7-f0b9f74ecda5 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:19.815835 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b3f86-9121-477a-a0e7-f0b9f74ecda5 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:19.820744 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d8a6e-e5fb-45b2-8fd5-801982eddf1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:19.821777 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d8a6e-e5fb-45b2-8fd5-801982eddf1c admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:19.822063 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d8a6e-e5fb-45b2-8fd5-801982eddf1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:19.822584 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d8a6e-e5fb-45b2-8fd5-801982eddf1c admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:19.823486 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d8a6e-e5fb-45b2-8fd5-801982eddf1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:01:19.823796 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d8a6e-e5fb-45b2-8fd5-801982eddf1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:19.825419 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d8a6e-e5fb-45b2-8fd5-801982eddf1c admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:19.837885 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1270/2549] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 16:01:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:01:19.842412 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d99fcb-2ecc-43e9-88dc-758a9467fcbd None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:19.851795 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d99fcb-2ecc-43e9-88dc-758a9467fcbd None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:19.857654 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d361695a-b3db-4114-b5b1-c55b82aa5714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:19.858294 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361695a-b3db-4114-b5b1-c55b82aa5714 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:19.858584 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361695a-b3db-4114-b5b1-c55b82aa5714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:19.858857 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361695a-b3db-4114-b5b1-c55b82aa5714 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:19.859484 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d361695a-b3db-4114-b5b1-c55b82aa5714 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:19.861387 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d361695a-b3db-4114-b5b1-c55b82aa5714 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:19.889777 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1280/2550] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 16:01:19 2022] POST /identity/v3/projects => generated 391 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:01:19.893850 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d8a6e-e5fb-45b2-8fd5-801982eddf1c admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:19.904903 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d8a6e-e5fb-45b2-8fd5-801982eddf1c admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:19.964653 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84027b0c-d42e-4ea6-b5c0-5620ac3d764f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:19.965262 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84027b0c-d42e-4ea6-b5c0-5620ac3d764f admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:19.965592 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84027b0c-d42e-4ea6-b5c0-5620ac3d764f admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:19.965846 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84027b0c-d42e-4ea6-b5c0-5620ac3d764f admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:19.966553 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84027b0c-d42e-4ea6-b5c0-5620ac3d764f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:19.968475 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84027b0c-d42e-4ea6-b5c0-5620ac3d764f admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:19.992739 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1271/2551] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 16:01:19 2022] POST /identity/v3/users => generated 296 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:01:19.997971 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d361695a-b3db-4114-b5b1-c55b82aa5714 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:20.009421 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d361695a-b3db-4114-b5b1-c55b82aa5714 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:20.014311 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c852f5-ba8d-48c9-8b30-07e69f2b0f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:20.014916 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c852f5-ba8d-48c9-8b30-07e69f2b0f79 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:20.015199 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c852f5-ba8d-48c9-8b30-07e69f2b0f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:20.015475 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c852f5-ba8d-48c9-8b30-07e69f2b0f79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:20.016122 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c852f5-ba8d-48c9-8b30-07e69f2b0f79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:20.017720 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c852f5-ba8d-48c9-8b30-07e69f2b0f79 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:20.028693 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1281/2552] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:01:20.032745 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84027b0c-d42e-4ea6-b5c0-5620ac3d764f admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:20.044143 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84027b0c-d42e-4ea6-b5c0-5620ac3d764f admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:20.049007 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4174e-9120-4a1b-a836-7f8b60f5bfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:20.049602 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4174e-9120-4a1b-a836-7f8b60f5bfe2 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:20.049907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4174e-9120-4a1b-a836-7f8b60f5bfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:20.050221 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4174e-9120-4a1b-a836-7f8b60f5bfe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:20.050842 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c4174e-9120-4a1b-a836-7f8b60f5bfe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:20.052418 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c4174e-9120-4a1b-a836-7f8b60f5bfe2 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:20.063306 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1272/2553] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:01:20.067486 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c852f5-ba8d-48c9-8b30-07e69f2b0f79 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:20.078013 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c852f5-ba8d-48c9-8b30-07e69f2b0f79 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:20.082775 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9501a-1127-4640-9f6f-c4888705d9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:20.083418 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9501a-1127-4640-9f6f-c4888705d9e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:20.083703 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9501a-1127-4640-9f6f-c4888705d9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:20.083981 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9501a-1127-4640-9f6f-c4888705d9e2 admin admin] PATH_INFO: `/v3/projects/4b6147efbed84f1d9e529c03b33808e6/users/df358d55f33a4dc8975ef47967d4bc78/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:20.099318 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b9501a-1127-4640-9f6f-c4888705d9e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b6147efbed84f1d9e529c03b33808e6, user_id=df358d55f33a4dc8975ef47967d4bc78, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:20.101977 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b9501a-1127-4640-9f6f-c4888705d9e2 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:20.115311 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1282/2554] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 16:01:20 2022] PUT /identity/v3/projects/4b6147efbed84f1d9e529c03b33808e6/users/df358d55f33a4dc8975ef47967d4bc78/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:01:20.126510 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e59dc-0302-4bce-9633-a0b4561fa2a4 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:20.126795 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e59dc-0302-4bce-9633-a0b4561fa2a4 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:20.127066 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e59dc-0302-4bce-9633-a0b4561fa2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:20.155090 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-4e8e59dc-0302-4bce-9633-a0b4561fa2a4 None None] MFA Rules not processed for user `df358d55f33a4dc8975ef47967d4bc78`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:01:20.156224 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-4e8e59dc-0302-4bce-9633-a0b4561fa2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:20.202380 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:20.219631 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1273/2555] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:01:20 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:01:20.224124 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9501a-1127-4640-9f6f-c4888705d9e2 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:20.294318 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9501a-1127-4640-9f6f-c4888705d9e2 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:20.298892 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48290c48-e056-41f7-abaf-5b15fbf2193b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:20.299488 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48290c48-e056-41f7-abaf-5b15fbf2193b admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:20.299769 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48290c48-e056-41f7-abaf-5b15fbf2193b admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:20.300044 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48290c48-e056-41f7-abaf-5b15fbf2193b admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:20.300657 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48290c48-e056-41f7-abaf-5b15fbf2193b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:20.302760 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48290c48-e056-41f7-abaf-5b15fbf2193b admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:20.314319 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:20.332327 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1283/2556] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 16:01:20 2022] POST /identity/v3/projects => generated 393 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:01:20.336389 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e59dc-0302-4bce-9633-a0b4561fa2a4 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:20.347013 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e59dc-0302-4bce-9633-a0b4561fa2a4 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:20.403189 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e14de-ec92-4196-b355-d0f8ebb5f874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:20.403790 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e14de-ec92-4196-b355-d0f8ebb5f874 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:20.404070 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e14de-ec92-4196-b355-d0f8ebb5f874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:20.404341 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e14de-ec92-4196-b355-d0f8ebb5f874 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:20.404959 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e14de-ec92-4196-b355-d0f8ebb5f874 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:20.406964 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e14de-ec92-4196-b355-d0f8ebb5f874 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:20.428095 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1274/2557] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 16:01:20 2022] POST /identity/v3/users => generated 303 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:01:20.432823 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48290c48-e056-41f7-abaf-5b15fbf2193b admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:20.443289 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48290c48-e056-41f7-abaf-5b15fbf2193b admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:20.448377 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb62818-7904-425b-b615-fd531e452380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:20.448975 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb62818-7904-425b-b615-fd531e452380 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:20.449258 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb62818-7904-425b-b615-fd531e452380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:20.449535 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb62818-7904-425b-b615-fd531e452380 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:20.450170 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb62818-7904-425b-b615-fd531e452380 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:20.451795 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb62818-7904-425b-b615-fd531e452380 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:20.461610 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1284/2558] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:01:20.466128 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e14de-ec92-4196-b355-d0f8ebb5f874 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:20.476491 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e14de-ec92-4196-b355-d0f8ebb5f874 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:20.482366 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938449a5-6954-4788-a778-a062b336a431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:20.483079 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938449a5-6954-4788-a778-a062b336a431 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:20.483364 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938449a5-6954-4788-a778-a062b336a431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:20.483644 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938449a5-6954-4788-a778-a062b336a431 admin admin] PATH_INFO: `/v3/projects/71bcfc378c0f40e989e9508a1ccef2a5/users/060715165973475fa94651f549b204d8/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:20.499842 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938449a5-6954-4788-a778-a062b336a431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71bcfc378c0f40e989e9508a1ccef2a5, user_id=060715165973475fa94651f549b204d8, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:20.502530 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938449a5-6954-4788-a778-a062b336a431 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:20.515727 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1275/2559] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 16:01:20 2022] PUT /identity/v3/projects/71bcfc378c0f40e989e9508a1ccef2a5/users/060715165973475fa94651f549b204d8/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:01:20.519877 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb62818-7904-425b-b615-fd531e452380 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:20.532127 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb62818-7904-425b-b615-fd531e452380 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:20.591320 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fea743-5803-48b0-bd15-284ba3009848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:20.591944 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fea743-5803-48b0-bd15-284ba3009848 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:20.592230 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fea743-5803-48b0-bd15-284ba3009848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:20.592506 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fea743-5803-48b0-bd15-284ba3009848 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:20.593146 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fea743-5803-48b0-bd15-284ba3009848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:20.594982 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fea743-5803-48b0-bd15-284ba3009848 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:20.605648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1285/2560] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:01:20.610043 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938449a5-6954-4788-a778-a062b336a431 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:20.621282 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938449a5-6954-4788-a778-a062b336a431 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:20.626112 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceeb4cb-c2b7-4f56-a7fa-561ff91da896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:20.626809 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceeb4cb-c2b7-4f56-a7fa-561ff91da896 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:20.627095 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceeb4cb-c2b7-4f56-a7fa-561ff91da896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:20.627372 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceeb4cb-c2b7-4f56-a7fa-561ff91da896 admin admin] PATH_INFO: `/v3/projects/71bcfc378c0f40e989e9508a1ccef2a5/users/060715165973475fa94651f549b204d8/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:20.629303 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceeb4cb-c2b7-4f56-a7fa-561ff91da896 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71bcfc378c0f40e989e9508a1ccef2a5, user_id=060715165973475fa94651f549b204d8, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:20.631976 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceeb4cb-c2b7-4f56-a7fa-561ff91da896 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:20.644286 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1276/2561] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 16:01:20 2022] PUT /identity/v3/projects/71bcfc378c0f40e989e9508a1ccef2a5/users/060715165973475fa94651f549b204d8/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:01:20.655986 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e08af4-e0fe-4eff-86e2-e21edc30c5ee None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:20.656277 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e08af4-e0fe-4eff-86e2-e21edc30c5ee None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:20.656591 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e08af4-e0fe-4eff-86e2-e21edc30c5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:20.686887 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-92e08af4-e0fe-4eff-86e2-e21edc30c5ee None None] MFA Rules not processed for user `060715165973475fa94651f549b204d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:01:20.688109 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-92e08af4-e0fe-4eff-86e2-e21edc30c5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:20.761644 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1286/2562] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:01:20 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:01:20.773278 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceeb4cb-c2b7-4f56-a7fa-561ff91da896 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:20.776025 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-fceeb4cb-c2b7-4f56-a7fa-561ff91da896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:20.834622 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceeb4cb-c2b7-4f56-a7fa-561ff91da896 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:20.838991 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f8f040-09d9-4c99-96e8-fa08ac0e3fa4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:20.839653 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8f040-09d9-4c99-96e8-fa08ac0e3fa4 service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:20.839927 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8f040-09d9-4c99-96e8-fa08ac0e3fa4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:20.840198 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8f040-09d9-4c99-96e8-fa08ac0e3fa4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:20.849828 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f8f040-09d9-4c99-96e8-fa08ac0e3fa4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:20.851301 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f8f040-09d9-4c99-96e8-fa08ac0e3fa4 service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:20.861213 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1277/2563] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:01:20 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:01:20.920264 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e08af4-e0fe-4eff-86e2-e21edc30c5ee None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:20.921804 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-92e08af4-e0fe-4eff-86e2-e21edc30c5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:20.934975 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e08af4-e0fe-4eff-86e2-e21edc30c5ee None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:20.938680 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304d2190-838e-428b-9289-48416e2d3da5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:20.939293 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d2190-838e-428b-9289-48416e2d3da5 service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:20.939605 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d2190-838e-428b-9289-48416e2d3da5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:20.939884 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d2190-838e-428b-9289-48416e2d3da5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:21.005091 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304d2190-838e-428b-9289-48416e2d3da5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:21.007234 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304d2190-838e-428b-9289-48416e2d3da5 service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:21.014625 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:21.019779 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1287/2564] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:01:20 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:01:24.433106 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f8f040-09d9-4c99-96e8-fa08ac0e3fa4 service cinder] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:24.482872 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:24.500086 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f8f040-09d9-4c99-96e8-fa08ac0e3fa4 service cinder] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:24.504669 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf4173-c0e4-4316-8612-b56a5bd33598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:24.505299 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf4173-c0e4-4316-8612-b56a5bd33598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:24.505587 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf4173-c0e4-4316-8612-b56a5bd33598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:24.505861 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf4173-c0e4-4316-8612-b56a5bd33598 admin admin] PATH_INFO: `/v3/users/df358d55f33a4dc8975ef47967d4bc78` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:24.507045 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf4173-c0e4-4316-8612-b56a5bd33598 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df358d55f33a4dc8975ef47967d4bc78)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:24.509114 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf4173-c0e4-4316-8612-b56a5bd33598 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:24.559938 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b8bf4173-c0e4-4316-8612-b56a5bd33598 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df358d55f33a4dc8975ef47967d4bc78'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:24.567172 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b8bf4173-c0e4-4316-8612-b56a5bd33598 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df358d55f33a4dc8975ef47967d4bc78'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:24.567982 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b8bf4173-c0e4-4316-8612-b56a5bd33598 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df358d55f33a4dc8975ef47967d4bc78'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:24.576037 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b8bf4173-c0e4-4316-8612-b56a5bd33598 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df358d55f33a4dc8975ef47967d4bc78'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:24.576694 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-b8bf4173-c0e4-4316-8612-b56a5bd33598 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df358d55f33a4dc8975ef47967d4bc78'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:24.596552 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1278/2565] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 16:01:24 2022] DELETE /identity/v3/users/df358d55f33a4dc8975ef47967d4bc78 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:01:24.600787 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497b4a2-94de-4aab-abfb-2b07292b348b None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:24.601303 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497b4a2-94de-4aab-abfb-2b07292b348b None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:24.601429 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497b4a2-94de-4aab-abfb-2b07292b348b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:24.621676 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-a497b4a2-94de-4aab-abfb-2b07292b348b None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:01:24.623162 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-a497b4a2-94de-4aab-abfb-2b07292b348b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:24.686618 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1288/2566] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:01:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:01:24.698743 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf4173-c0e4-4316-8612-b56a5bd33598 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:24.701068 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b8bf4173-c0e4-4316-8612-b56a5bd33598 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:24.767248 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf4173-c0e4-4316-8612-b56a5bd33598 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:24.771471 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef211b-b229-457a-9e55-ceb5546f83ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:24.772082 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef211b-b229-457a-9e55-ceb5546f83ec service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:24.772360 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef211b-b229-457a-9e55-ceb5546f83ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:24.772638 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef211b-b229-457a-9e55-ceb5546f83ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:24.783238 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef211b-b229-457a-9e55-ceb5546f83ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:24.784681 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef211b-b229-457a-9e55-ceb5546f83ec service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:24.795998 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1279/2567] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:01:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:01:25.113960 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497b4a2-94de-4aab-abfb-2b07292b348b None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:25.116124 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-a497b4a2-94de-4aab-abfb-2b07292b348b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:25.135830 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497b4a2-94de-4aab-abfb-2b07292b348b None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:25.143813 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7418d2f8-4bd5-4913-9385-0692844e0b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:25.144822 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418d2f8-4bd5-4913-9385-0692844e0b91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:25.145319 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418d2f8-4bd5-4913-9385-0692844e0b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:25.145820 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418d2f8-4bd5-4913-9385-0692844e0b91 admin admin] PATH_INFO: `/v3/projects/4b6147efbed84f1d9e529c03b33808e6` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:25.147570 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7418d2f8-4bd5-4913-9385-0692844e0b91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b6147efbed84f1d9e529c03b33808e6)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:25.151486 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7418d2f8-4bd5-4913-9385-0692844e0b91 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:25.215568 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-7418d2f8-4bd5-4913-9385-0692844e0b91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b6147efbed84f1d9e529c03b33808e6', 'request_id': 'req-7418d2f8-4bd5-4913-9385-0692844e0b91'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:25.226449 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-7418d2f8-4bd5-4913-9385-0692844e0b91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b6147efbed84f1d9e529c03b33808e6', 'request_id': 'req-7418d2f8-4bd5-4913-9385-0692844e0b91'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:25.234949 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-7418d2f8-4bd5-4913-9385-0692844e0b91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b6147efbed84f1d9e529c03b33808e6', 'request_id': 'req-7418d2f8-4bd5-4913-9385-0692844e0b91'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:25.253592 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-7418d2f8-4bd5-4913-9385-0692844e0b91 admin admin] The token cache is being invalidate because project 4b6147efbed84f1d9e529c03b33808e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:01:25.253940 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-7418d2f8-4bd5-4913-9385-0692844e0b91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:25.254690 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-7418d2f8-4bd5-4913-9385-0692844e0b91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:25.260618 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1289/2568] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 16:01:25 2022] DELETE /identity/v3/projects/4b6147efbed84f1d9e529c03b33808e6 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:01:25.261721 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef211b-b229-457a-9e55-ceb5546f83ec service neutron] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:25.272448 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef211b-b229-457a-9e55-ceb5546f83ec service neutron] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:25.338010 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e18c91-be01-4f18-ae69-b8c56fe36c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:25.338684 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e18c91-be01-4f18-ae69-b8c56fe36c49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:25.339038 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e18c91-be01-4f18-ae69-b8c56fe36c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:25.339387 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e18c91-be01-4f18-ae69-b8c56fe36c49 admin admin] PATH_INFO: `/v3/users/060715165973475fa94651f549b204d8` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:25.340608 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e18c91-be01-4f18-ae69-b8c56fe36c49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=060715165973475fa94651f549b204d8)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:25.342641 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e18c91-be01-4f18-ae69-b8c56fe36c49 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:25.363072 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:25.420698 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-e0e18c91-be01-4f18-ae69-b8c56fe36c49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '060715165973475fa94651f549b204d8'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:25.430437 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-e0e18c91-be01-4f18-ae69-b8c56fe36c49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '060715165973475fa94651f549b204d8'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:25.431993 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-e0e18c91-be01-4f18-ae69-b8c56fe36c49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '060715165973475fa94651f549b204d8'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:25.446237 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-e0e18c91-be01-4f18-ae69-b8c56fe36c49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '060715165973475fa94651f549b204d8'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:25.447172 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-e0e18c91-be01-4f18-ae69-b8c56fe36c49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '060715165973475fa94651f549b204d8'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:25.478725 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1280/2569] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 16:01:25 2022] DELETE /identity/v3/users/060715165973475fa94651f549b204d8 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:01:25.799217 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7418d2f8-4bd5-4913-9385-0692844e0b91 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:25.800855 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-7418d2f8-4bd5-4913-9385-0692844e0b91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:25.816599 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7418d2f8-4bd5-4913-9385-0692844e0b91 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:25.882017 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5682325-68b2-413a-8e4e-25198fbb4e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:25.882687 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5682325-68b2-413a-8e4e-25198fbb4e08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:25.882967 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5682325-68b2-413a-8e4e-25198fbb4e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:25.883239 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5682325-68b2-413a-8e4e-25198fbb4e08 admin admin] PATH_INFO: `/v3/projects/71bcfc378c0f40e989e9508a1ccef2a5` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:25.884624 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5682325-68b2-413a-8e4e-25198fbb4e08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71bcfc378c0f40e989e9508a1ccef2a5)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:25.886558 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5682325-68b2-413a-8e4e-25198fbb4e08 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:25.918411 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:25.936857 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-d5682325-68b2-413a-8e4e-25198fbb4e08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71bcfc378c0f40e989e9508a1ccef2a5', 'request_id': 'req-d5682325-68b2-413a-8e4e-25198fbb4e08'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:25.942523 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-d5682325-68b2-413a-8e4e-25198fbb4e08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71bcfc378c0f40e989e9508a1ccef2a5', 'request_id': 'req-d5682325-68b2-413a-8e4e-25198fbb4e08'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:25.949151 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-d5682325-68b2-413a-8e4e-25198fbb4e08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71bcfc378c0f40e989e9508a1ccef2a5', 'request_id': 'req-d5682325-68b2-413a-8e4e-25198fbb4e08'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:25.961312 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-d5682325-68b2-413a-8e4e-25198fbb4e08 admin admin] The token cache is being invalidate because project 71bcfc378c0f40e989e9508a1ccef2a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:01:25.961599 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-d5682325-68b2-413a-8e4e-25198fbb4e08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:25.962823 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-d5682325-68b2-413a-8e4e-25198fbb4e08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:25.964292 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1290/2570] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 16:01:25 2022] DELETE /identity/v3/projects/71bcfc378c0f40e989e9508a1ccef2a5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:01:25.969916 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a3fa0-12d0-4369-8f64-c35b9b07a9f1 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:25.970277 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a3fa0-12d0-4369-8f64-c35b9b07a9f1 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:25.970664 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a3fa0-12d0-4369-8f64-c35b9b07a9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:25.994036 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-747a3fa0-12d0-4369-8f64-c35b9b07a9f1 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:01:25.995628 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-747a3fa0-12d0-4369-8f64-c35b9b07a9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:26.061245 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1281/2571] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:01:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:01:26.068835 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a909f14-f787-4d6e-9568-281fb4769241 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:26.069115 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a909f14-f787-4d6e-9568-281fb4769241 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:26.069389 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a909f14-f787-4d6e-9568-281fb4769241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:26.090125 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-6a909f14-f787-4d6e-9568-281fb4769241 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:01:26.091405 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-6a909f14-f787-4d6e-9568-281fb4769241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:26.099201 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1291/2572] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:01:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:01:26.103333 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a3fa0-12d0-4369-8f64-c35b9b07a9f1 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:26.113121 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a3fa0-12d0-4369-8f64-c35b9b07a9f1 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:26.117705 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816dd813-8e5e-476f-abb4-2dd0d2d8c457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:26.118387 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816dd813-8e5e-476f-abb4-2dd0d2d8c457 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:26.118824 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816dd813-8e5e-476f-abb4-2dd0d2d8c457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:26.119107 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816dd813-8e5e-476f-abb4-2dd0d2d8c457 admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:26.119753 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816dd813-8e5e-476f-abb4-2dd0d2d8c457 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:01:26.120058 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816dd813-8e5e-476f-abb4-2dd0d2d8c457 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:26.121647 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816dd813-8e5e-476f-abb4-2dd0d2d8c457 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:26.133264 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1282/2573] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 16:01:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:01:26.138482 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a909f14-f787-4d6e-9568-281fb4769241 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:26.147868 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a909f14-f787-4d6e-9568-281fb4769241 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:26.153279 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1afdba-14d6-4339-a832-97753256fedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:26.153869 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1afdba-14d6-4339-a832-97753256fedf admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:26.154144 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1afdba-14d6-4339-a832-97753256fedf admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:26.154448 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1afdba-14d6-4339-a832-97753256fedf admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:26.155078 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1afdba-14d6-4339-a832-97753256fedf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:26.156959 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1afdba-14d6-4339-a832-97753256fedf admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:26.183372 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1292/2574] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 16:01:26 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:01:26.187373 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816dd813-8e5e-476f-abb4-2dd0d2d8c457 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:26.197898 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816dd813-8e5e-476f-abb4-2dd0d2d8c457 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:26.254023 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1035473-f95f-45e7-84af-73c876ac5209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:26.254657 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1035473-f95f-45e7-84af-73c876ac5209 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:26.254940 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1035473-f95f-45e7-84af-73c876ac5209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:26.255215 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1035473-f95f-45e7-84af-73c876ac5209 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:26.255843 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1035473-f95f-45e7-84af-73c876ac5209 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:26.257752 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1035473-f95f-45e7-84af-73c876ac5209 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:26.281132 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1283/2575] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 16:01:26 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:01:26.285199 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1afdba-14d6-4339-a832-97753256fedf admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:26.295599 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1afdba-14d6-4339-a832-97753256fedf admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:26.300699 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67d4e0-7720-4c05-85cd-9101857f7a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:26.301299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67d4e0-7720-4c05-85cd-9101857f7a4b admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:26.301581 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67d4e0-7720-4c05-85cd-9101857f7a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:26.301858 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67d4e0-7720-4c05-85cd-9101857f7a4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:26.302535 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d67d4e0-7720-4c05-85cd-9101857f7a4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:26.304147 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d67d4e0-7720-4c05-85cd-9101857f7a4b admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:26.314252 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1293/2576] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:01:26.318131 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1035473-f95f-45e7-84af-73c876ac5209 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:26.325002 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:26.328978 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1035473-f95f-45e7-84af-73c876ac5209 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:26.334731 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e2289-8211-48c1-8777-2aac11732db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:26.335494 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e2289-8211-48c1-8777-2aac11732db6 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:26.336004 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e2289-8211-48c1-8777-2aac11732db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:26.336464 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e2289-8211-48c1-8777-2aac11732db6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:26.337726 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e2289-8211-48c1-8777-2aac11732db6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:26.339350 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e2289-8211-48c1-8777-2aac11732db6 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:26.349797 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1284/2577] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:01:26.353893 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67d4e0-7720-4c05-85cd-9101857f7a4b admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:26.364184 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67d4e0-7720-4c05-85cd-9101857f7a4b admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:26.368855 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190c654-96fb-4bd6-9ae6-bd37a3690317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:26.369502 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190c654-96fb-4bd6-9ae6-bd37a3690317 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:26.369787 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190c654-96fb-4bd6-9ae6-bd37a3690317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:26.370066 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190c654-96fb-4bd6-9ae6-bd37a3690317 admin admin] PATH_INFO: `/v3/projects/49054234e4c542828b8003a581f94fb6/users/7e991b596b7e4c60b0e7636168e23d64/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:26.386018 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2190c654-96fb-4bd6-9ae6-bd37a3690317 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49054234e4c542828b8003a581f94fb6, user_id=7e991b596b7e4c60b0e7636168e23d64, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:26.388750 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2190c654-96fb-4bd6-9ae6-bd37a3690317 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:26.402991 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1294/2578] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 16:01:26 2022] PUT /identity/v3/projects/49054234e4c542828b8003a581f94fb6/users/7e991b596b7e4c60b0e7636168e23d64/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:01:26.413132 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033ed45-0f84-470a-85cd-907613cd6bdb None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:26.413465 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033ed45-0f84-470a-85cd-907613cd6bdb None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:26.413743 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033ed45-0f84-470a-85cd-907613cd6bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:26.442049 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-2033ed45-0f84-470a-85cd-907613cd6bdb None None] MFA Rules not processed for user `7e991b596b7e4c60b0e7636168e23d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:01:26.443283 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-2033ed45-0f84-470a-85cd-907613cd6bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:26.511100 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1285/2579] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:01:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:01:26.515741 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190c654-96fb-4bd6-9ae6-bd37a3690317 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:26.577163 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190c654-96fb-4bd6-9ae6-bd37a3690317 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:26.581891 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5540efbe-cc2e-4e8c-a29d-42dfd371a434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:26.582529 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540efbe-cc2e-4e8c-a29d-42dfd371a434 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:26.582814 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540efbe-cc2e-4e8c-a29d-42dfd371a434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:26.583092 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540efbe-cc2e-4e8c-a29d-42dfd371a434 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:26.583747 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5540efbe-cc2e-4e8c-a29d-42dfd371a434 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:26.585651 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5540efbe-cc2e-4e8c-a29d-42dfd371a434 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:26.611854 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1295/2580] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 16:01:26 2022] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:01:26.615803 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2033ed45-0f84-470a-85cd-907613cd6bdb None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:26.627692 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2033ed45-0f84-470a-85cd-907613cd6bdb None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:26.684174 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a693663-5d01-4b57-b96f-bf72d7c00055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:26.684777 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a693663-5d01-4b57-b96f-bf72d7c00055 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:26.685054 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a693663-5d01-4b57-b96f-bf72d7c00055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:26.685323 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a693663-5d01-4b57-b96f-bf72d7c00055 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:26.685952 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a693663-5d01-4b57-b96f-bf72d7c00055 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:26.687922 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a693663-5d01-4b57-b96f-bf72d7c00055 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:26.709155 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1286/2581] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 16:01:26 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:01:26.713224 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5540efbe-cc2e-4e8c-a29d-42dfd371a434 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:26.723521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5540efbe-cc2e-4e8c-a29d-42dfd371a434 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:26.728267 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c2d45-3d33-46b8-aab3-97c7cddcf93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:26.728874 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c2d45-3d33-46b8-aab3-97c7cddcf93d admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:26.729142 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c2d45-3d33-46b8-aab3-97c7cddcf93d admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:26.729415 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c2d45-3d33-46b8-aab3-97c7cddcf93d admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:26.730049 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c2d45-3d33-46b8-aab3-97c7cddcf93d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:26.731944 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c2d45-3d33-46b8-aab3-97c7cddcf93d admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:26.742385 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1296/2582] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:01:26.746978 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a693663-5d01-4b57-b96f-bf72d7c00055 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:26.756598 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a693663-5d01-4b57-b96f-bf72d7c00055 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:26.761890 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa639857-eedd-42f7-bd8e-67857b5973cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:26.762525 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa639857-eedd-42f7-bd8e-67857b5973cc admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:26.762808 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa639857-eedd-42f7-bd8e-67857b5973cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:26.763083 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa639857-eedd-42f7-bd8e-67857b5973cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:26.763714 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa639857-eedd-42f7-bd8e-67857b5973cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:26.765289 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa639857-eedd-42f7-bd8e-67857b5973cc admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:26.775415 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1287/2583] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:01:26.779377 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c2d45-3d33-46b8-aab3-97c7cddcf93d admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:26.789511 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c2d45-3d33-46b8-aab3-97c7cddcf93d admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:26.794427 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145908d-ac2e-41d4-bd50-222bbab96dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:26.795131 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145908d-ac2e-41d4-bd50-222bbab96dd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:26.795409 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145908d-ac2e-41d4-bd50-222bbab96dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:26.796185 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145908d-ac2e-41d4-bd50-222bbab96dd5 admin admin] PATH_INFO: `/v3/projects/990a7deebd994fc483ed91ff1bc986c4/users/1db8d583c36b48529b6a62d691657498/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:26.810881 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3145908d-ac2e-41d4-bd50-222bbab96dd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=990a7deebd994fc483ed91ff1bc986c4, user_id=1db8d583c36b48529b6a62d691657498, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:26.813498 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3145908d-ac2e-41d4-bd50-222bbab96dd5 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:26.823889 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:26.828713 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1297/2584] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 16:01:26 2022] PUT /identity/v3/projects/990a7deebd994fc483ed91ff1bc986c4/users/1db8d583c36b48529b6a62d691657498/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:01:26.899872 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4c10b-8c2b-4fc9-9c73-cd5624d664c1 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:26.899872 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4c10b-8c2b-4fc9-9c73-cd5624d664c1 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:26.900080 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4c10b-8c2b-4fc9-9c73-cd5624d664c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:26.942819 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-4df4c10b-8c2b-4fc9-9c73-cd5624d664c1 None None] MFA Rules not processed for user `1db8d583c36b48529b6a62d691657498`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:01:26.944041 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-4df4c10b-8c2b-4fc9-9c73-cd5624d664c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:27.018239 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:27.035868 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1288/2585] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:01:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:01:27.040789 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145908d-ac2e-41d4-bd50-222bbab96dd5 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:27.101134 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145908d-ac2e-41d4-bd50-222bbab96dd5 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:27.106311 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e1eab-41d9-48fa-aab8-c57732bb540f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:27.107163 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e1eab-41d9-48fa-aab8-c57732bb540f admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:27.107440 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e1eab-41d9-48fa-aab8-c57732bb540f admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:27.107717 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e1eab-41d9-48fa-aab8-c57732bb540f admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:27.108346 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e1eab-41d9-48fa-aab8-c57732bb540f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:27.110248 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e1eab-41d9-48fa-aab8-c57732bb540f admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:27.137789 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1298/2586] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 16:01:27 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:01:27.141880 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df4c10b-8c2b-4fc9-9c73-cd5624d664c1 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:27.152982 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df4c10b-8c2b-4fc9-9c73-cd5624d664c1 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:27.210450 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19f071-353d-4202-8799-e656ad5219d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:27.211054 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19f071-353d-4202-8799-e656ad5219d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:27.211330 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19f071-353d-4202-8799-e656ad5219d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:27.211602 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19f071-353d-4202-8799-e656ad5219d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:27.212970 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b19f071-353d-4202-8799-e656ad5219d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:27.215059 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b19f071-353d-4202-8799-e656ad5219d2 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:27.237292 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1289/2587] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 16:01:27 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:01:27.241303 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e1eab-41d9-48fa-aab8-c57732bb540f admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:27.251809 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e1eab-41d9-48fa-aab8-c57732bb540f admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:27.256363 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f158bbf-b4ee-45e1-be03-8bf5dcd78473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:27.256962 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f158bbf-b4ee-45e1-be03-8bf5dcd78473 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:27.257240 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f158bbf-b4ee-45e1-be03-8bf5dcd78473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:27.257512 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f158bbf-b4ee-45e1-be03-8bf5dcd78473 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:27.258141 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f158bbf-b4ee-45e1-be03-8bf5dcd78473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:27.260069 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f158bbf-b4ee-45e1-be03-8bf5dcd78473 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:27.270903 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1299/2588] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:01:27.275827 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19f071-353d-4202-8799-e656ad5219d2 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:27.286324 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19f071-353d-4202-8799-e656ad5219d2 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:27.291954 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61441dcc-a4ed-48d6-b268-91637eac5a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:27.292605 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61441dcc-a4ed-48d6-b268-91637eac5a44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:27.292890 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61441dcc-a4ed-48d6-b268-91637eac5a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:27.293164 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61441dcc-a4ed-48d6-b268-91637eac5a44 admin admin] PATH_INFO: `/v3/projects/83db781351b1465688d762f36bb8fb94/users/279b2fa446844c1dbf8c04b23f157ce0/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:27.308017 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61441dcc-a4ed-48d6-b268-91637eac5a44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83db781351b1465688d762f36bb8fb94, user_id=279b2fa446844c1dbf8c04b23f157ce0, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:27.310719 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61441dcc-a4ed-48d6-b268-91637eac5a44 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:27.324515 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1290/2589] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 16:01:27 2022] PUT /identity/v3/projects/83db781351b1465688d762f36bb8fb94/users/279b2fa446844c1dbf8c04b23f157ce0/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:01:27.328531 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f158bbf-b4ee-45e1-be03-8bf5dcd78473 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:27.339367 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f158bbf-b4ee-45e1-be03-8bf5dcd78473 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:27.394410 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f10f579-f16b-481e-b9c2-8d7bd6d73253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:27.394936 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10f579-f16b-481e-b9c2-8d7bd6d73253 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:27.395212 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10f579-f16b-481e-b9c2-8d7bd6d73253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:27.395485 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10f579-f16b-481e-b9c2-8d7bd6d73253 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:27.396112 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f10f579-f16b-481e-b9c2-8d7bd6d73253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:27.397684 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f10f579-f16b-481e-b9c2-8d7bd6d73253 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:27.408041 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1300/2590] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:01:27.412256 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61441dcc-a4ed-48d6-b268-91637eac5a44 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:27.422925 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61441dcc-a4ed-48d6-b268-91637eac5a44 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:27.427503 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4baeb-ebe2-4f27-bd20-88c7c77eb5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:27.428138 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4baeb-ebe2-4f27-bd20-88c7c77eb5ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:27.428430 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4baeb-ebe2-4f27-bd20-88c7c77eb5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:27.428687 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4baeb-ebe2-4f27-bd20-88c7c77eb5ca admin admin] PATH_INFO: `/v3/projects/83db781351b1465688d762f36bb8fb94/users/279b2fa446844c1dbf8c04b23f157ce0/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:27.430632 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd4baeb-ebe2-4f27-bd20-88c7c77eb5ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=83db781351b1465688d762f36bb8fb94, user_id=279b2fa446844c1dbf8c04b23f157ce0, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:27.433239 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd4baeb-ebe2-4f27-bd20-88c7c77eb5ca admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:27.443110 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1291/2591] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 16:01:27 2022] PUT /identity/v3/projects/83db781351b1465688d762f36bb8fb94/users/279b2fa446844c1dbf8c04b23f157ce0/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:01:27.453038 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8c323-276c-4d17-91f9-b5c2306ebaf0 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:27.453328 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8c323-276c-4d17-91f9-b5c2306ebaf0 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:27.453632 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8c323-276c-4d17-91f9-b5c2306ebaf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:27.482330 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-efc8c323-276c-4d17-91f9-b5c2306ebaf0 None None] MFA Rules not processed for user `279b2fa446844c1dbf8c04b23f157ce0`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:01:27.483539 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-efc8c323-276c-4d17-91f9-b5c2306ebaf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:27.543916 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:27.553443 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1301/2592] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:01:27 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:01:27.564812 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4baeb-ebe2-4f27-bd20-88c7c77eb5ca admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:27.566654 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-4cd4baeb-ebe2-4f27-bd20-88c7c77eb5ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:27.625841 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4baeb-ebe2-4f27-bd20-88c7c77eb5ca admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:27.629565 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418f026-e972-4ccf-b540-4dfa6f4d0439 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:27.630168 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418f026-e972-4ccf-b540-4dfa6f4d0439 service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:27.630549 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418f026-e972-4ccf-b540-4dfa6f4d0439 service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:27.630823 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418f026-e972-4ccf-b540-4dfa6f4d0439 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:27.640343 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c418f026-e972-4ccf-b540-4dfa6f4d0439 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:27.641772 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c418f026-e972-4ccf-b540-4dfa6f4d0439 service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:27.651883 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1292/2593] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:01:27 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:01:27.691674 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc8c323-276c-4d17-91f9-b5c2306ebaf0 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:27.693068 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-efc8c323-276c-4d17-91f9-b5c2306ebaf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:27.705536 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc8c323-276c-4d17-91f9-b5c2306ebaf0 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:27.709212 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e0b7e-0598-45ce-b0cf-f3fc1bf6481c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:27.709818 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e0b7e-0598-45ce-b0cf-f3fc1bf6481c service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:27.710102 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e0b7e-0598-45ce-b0cf-f3fc1bf6481c service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:27.710413 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e0b7e-0598-45ce-b0cf-f3fc1bf6481c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:27.767871 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e0b7e-0598-45ce-b0cf-f3fc1bf6481c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:27.769301 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e0b7e-0598-45ce-b0cf-f3fc1bf6481c service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:27.778743 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1302/2594] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:01:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:01:29.387181 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418f026-e972-4ccf-b540-4dfa6f4d0439 service cinder] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:29.388702 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-c418f026-e972-4ccf-b540-4dfa6f4d0439 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:29.443196 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:29.451335 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418f026-e972-4ccf-b540-4dfa6f4d0439 service cinder] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:29.455274 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a45e45e-4af5-42fe-aba4-3723c51e2460 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:29.456019 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45e45e-4af5-42fe-aba4-3723c51e2460 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:29.456396 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45e45e-4af5-42fe-aba4-3723c51e2460 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:29.456738 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45e45e-4af5-42fe-aba4-3723c51e2460 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:29.459342 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-3a45e45e-4af5-42fe-aba4-3723c51e2460 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:29.534380 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a45e45e-4af5-42fe-aba4-3723c51e2460 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:29.535861 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a45e45e-4af5-42fe-aba4-3723c51e2460 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:29.546240 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1293/2595] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:01:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:01:30.714761 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e0b7e-0598-45ce-b0cf-f3fc1bf6481c service cinder] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:30.726545 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e0b7e-0598-45ce-b0cf-f3fc1bf6481c service cinder] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:30.732539 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf4e39-0b96-448a-8269-a0ebfd606861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:30.733170 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf4e39-0b96-448a-8269-a0ebfd606861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:30.733454 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf4e39-0b96-448a-8269-a0ebfd606861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:30.733732 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf4e39-0b96-448a-8269-a0ebfd606861 admin admin] PATH_INFO: `/v3/users/7e991b596b7e4c60b0e7636168e23d64` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:30.734899 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdf4e39-0b96-448a-8269-a0ebfd606861 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e991b596b7e4c60b0e7636168e23d64)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:30.736849 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdf4e39-0b96-448a-8269-a0ebfd606861 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:30.786535 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-9fdf4e39-0b96-448a-8269-a0ebfd606861 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e991b596b7e4c60b0e7636168e23d64'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:30.795301 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-9fdf4e39-0b96-448a-8269-a0ebfd606861 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e991b596b7e4c60b0e7636168e23d64'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:30.795928 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-9fdf4e39-0b96-448a-8269-a0ebfd606861 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e991b596b7e4c60b0e7636168e23d64'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:30.809546 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-9fdf4e39-0b96-448a-8269-a0ebfd606861 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e991b596b7e4c60b0e7636168e23d64'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:30.810251 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-9fdf4e39-0b96-448a-8269-a0ebfd606861 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e991b596b7e4c60b0e7636168e23d64'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:30.825279 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1303/2596] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 16:01:30 2022] DELETE /identity/v3/users/7e991b596b7e4c60b0e7636168e23d64 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:01:30.829535 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99c056-707a-4850-9d1e-aa1258697348 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:30.830012 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99c056-707a-4850-9d1e-aa1258697348 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:30.830119 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99c056-707a-4850-9d1e-aa1258697348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:30.850094 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-9d99c056-707a-4850-9d1e-aa1258697348 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:01:30.851337 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-9d99c056-707a-4850-9d1e-aa1258697348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:30.914089 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1294/2597] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:01:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:01:30.924919 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf4e39-0b96-448a-8269-a0ebfd606861 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:30.926423 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-9fdf4e39-0b96-448a-8269-a0ebfd606861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:30.988689 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf4e39-0b96-448a-8269-a0ebfd606861 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:30.992278 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c930a985-eea8-4030-85ec-0db2e7ea430e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:30.992907 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930a985-eea8-4030-85ec-0db2e7ea430e service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:30.993208 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930a985-eea8-4030-85ec-0db2e7ea430e service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:30.993457 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930a985-eea8-4030-85ec-0db2e7ea430e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:31.003271 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c930a985-eea8-4030-85ec-0db2e7ea430e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:31.004712 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c930a985-eea8-4030-85ec-0db2e7ea430e service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:31.015441 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1304/2598] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:01:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:01:31.445558 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99c056-707a-4850-9d1e-aa1258697348 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:31.447762 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-9d99c056-707a-4850-9d1e-aa1258697348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:31.459706 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99c056-707a-4850-9d1e-aa1258697348 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:31.465079 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a77975-1bc6-4a18-b50a-ee31003f7270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:31.465733 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a77975-1bc6-4a18-b50a-ee31003f7270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:31.466011 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a77975-1bc6-4a18-b50a-ee31003f7270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:31.466317 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a77975-1bc6-4a18-b50a-ee31003f7270 admin admin] PATH_INFO: `/v3/projects/49054234e4c542828b8003a581f94fb6` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:31.467443 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a77975-1bc6-4a18-b50a-ee31003f7270 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49054234e4c542828b8003a581f94fb6)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:31.469344 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a77975-1bc6-4a18-b50a-ee31003f7270 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:31.526691 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-29a77975-1bc6-4a18-b50a-ee31003f7270 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49054234e4c542828b8003a581f94fb6', 'request_id': 'req-29a77975-1bc6-4a18-b50a-ee31003f7270'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:31.534660 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-29a77975-1bc6-4a18-b50a-ee31003f7270 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49054234e4c542828b8003a581f94fb6', 'request_id': 'req-29a77975-1bc6-4a18-b50a-ee31003f7270'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:31.542434 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-29a77975-1bc6-4a18-b50a-ee31003f7270 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49054234e4c542828b8003a581f94fb6', 'request_id': 'req-29a77975-1bc6-4a18-b50a-ee31003f7270'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:31.556802 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-29a77975-1bc6-4a18-b50a-ee31003f7270 admin admin] The token cache is being invalidate because project 49054234e4c542828b8003a581f94fb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:01:31.557254 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-29a77975-1bc6-4a18-b50a-ee31003f7270 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:31.557910 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-29a77975-1bc6-4a18-b50a-ee31003f7270 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:31.559457 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1295/2599] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 16:01:31 2022] DELETE /identity/v3/projects/49054234e4c542828b8003a581f94fb6 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:01:31.563772 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c930a985-eea8-4030-85ec-0db2e7ea430e service neutron] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:31.574994 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c930a985-eea8-4030-85ec-0db2e7ea430e service neutron] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:31.580610 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:31.655080 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b9c22e-f73f-4e1d-8a18-6fd93e43734b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:31.655708 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9c22e-f73f-4e1d-8a18-6fd93e43734b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:31.655990 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9c22e-f73f-4e1d-8a18-6fd93e43734b admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:31.656266 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9c22e-f73f-4e1d-8a18-6fd93e43734b admin admin] PATH_INFO: `/v3/users/1db8d583c36b48529b6a62d691657498` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:31.657415 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b9c22e-f73f-4e1d-8a18-6fd93e43734b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1db8d583c36b48529b6a62d691657498)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:31.659391 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b9c22e-f73f-4e1d-8a18-6fd93e43734b admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:31.846950 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-d1b9c22e-f73f-4e1d-8a18-6fd93e43734b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1db8d583c36b48529b6a62d691657498'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:31.855455 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-d1b9c22e-f73f-4e1d-8a18-6fd93e43734b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1db8d583c36b48529b6a62d691657498'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:31.856225 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-d1b9c22e-f73f-4e1d-8a18-6fd93e43734b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1db8d583c36b48529b6a62d691657498'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:31.874329 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-d1b9c22e-f73f-4e1d-8a18-6fd93e43734b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1db8d583c36b48529b6a62d691657498'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:31.875536 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-d1b9c22e-f73f-4e1d-8a18-6fd93e43734b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1db8d583c36b48529b6a62d691657498'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:31.890477 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1305/2600] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 16:01:31 2022] DELETE /identity/v3/users/1db8d583c36b48529b6a62d691657498 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:01:32.227783 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a77975-1bc6-4a18-b50a-ee31003f7270 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:32.229505 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-29a77975-1bc6-4a18-b50a-ee31003f7270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:32.244069 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a77975-1bc6-4a18-b50a-ee31003f7270 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:32.263325 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:32.306997 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f3dea-023f-4849-841f-452a184299a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:32.307708 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f3dea-023f-4849-841f-452a184299a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:32.308057 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f3dea-023f-4849-841f-452a184299a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:32.308395 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f3dea-023f-4849-841f-452a184299a1 admin admin] PATH_INFO: `/v3/projects/990a7deebd994fc483ed91ff1bc986c4` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:32.309587 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433f3dea-023f-4849-841f-452a184299a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=990a7deebd994fc483ed91ff1bc986c4)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:32.311530 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433f3dea-023f-4849-841f-452a184299a1 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:32.362965 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-433f3dea-023f-4849-841f-452a184299a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '990a7deebd994fc483ed91ff1bc986c4', 'request_id': 'req-433f3dea-023f-4849-841f-452a184299a1'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:32.368982 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-433f3dea-023f-4849-841f-452a184299a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '990a7deebd994fc483ed91ff1bc986c4', 'request_id': 'req-433f3dea-023f-4849-841f-452a184299a1'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:32.375558 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-433f3dea-023f-4849-841f-452a184299a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '990a7deebd994fc483ed91ff1bc986c4', 'request_id': 'req-433f3dea-023f-4849-841f-452a184299a1'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:32.393443 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-433f3dea-023f-4849-841f-452a184299a1 admin admin] The token cache is being invalidate because project 990a7deebd994fc483ed91ff1bc986c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:01:32.393749 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-433f3dea-023f-4849-841f-452a184299a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:32.394857 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-433f3dea-023f-4849-841f-452a184299a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:32.396614 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1296/2601] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 16:01:32 2022] DELETE /identity/v3/projects/990a7deebd994fc483ed91ff1bc986c4 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:01:32.401224 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b9c22e-f73f-4e1d-8a18-6fd93e43734b admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:32.403185 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-d1b9c22e-f73f-4e1d-8a18-6fd93e43734b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:32.416217 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b9c22e-f73f-4e1d-8a18-6fd93e43734b admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:32.483806 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c38c437-43d9-49ad-8533-70c7df5f1f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:32.484458 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38c437-43d9-49ad-8533-70c7df5f1f36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:32.484735 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38c437-43d9-49ad-8533-70c7df5f1f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:32.485007 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38c437-43d9-49ad-8533-70c7df5f1f36 admin admin] PATH_INFO: `/v3/users/279b2fa446844c1dbf8c04b23f157ce0` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:32.486161 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c38c437-43d9-49ad-8533-70c7df5f1f36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=279b2fa446844c1dbf8c04b23f157ce0)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:32.488391 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c38c437-43d9-49ad-8533-70c7df5f1f36 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:32.544268 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:32.572978 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-6c38c437-43d9-49ad-8533-70c7df5f1f36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '279b2fa446844c1dbf8c04b23f157ce0'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:32.581411 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-6c38c437-43d9-49ad-8533-70c7df5f1f36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '279b2fa446844c1dbf8c04b23f157ce0'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:32.582287 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-6c38c437-43d9-49ad-8533-70c7df5f1f36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '279b2fa446844c1dbf8c04b23f157ce0'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:32.595228 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-6c38c437-43d9-49ad-8533-70c7df5f1f36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '279b2fa446844c1dbf8c04b23f157ce0'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:32.595922 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-6c38c437-43d9-49ad-8533-70c7df5f1f36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '279b2fa446844c1dbf8c04b23f157ce0'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:32.615653 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1306/2602] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 16:01:32 2022] DELETE /identity/v3/users/279b2fa446844c1dbf8c04b23f157ce0 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:01:32.970213 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f3dea-023f-4849-841f-452a184299a1 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:32.972264 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-433f3dea-023f-4849-841f-452a184299a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:32.990441 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f3dea-023f-4849-841f-452a184299a1 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:33.065009 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b96fcd-12bb-47b2-be8a-5d067a5927b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:33.065663 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c38c437-43d9-49ad-8533-70c7df5f1f36 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:33.066105 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b96fcd-12bb-47b2-be8a-5d067a5927b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:33.066105 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b96fcd-12bb-47b2-be8a-5d067a5927b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:33.066490 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b96fcd-12bb-47b2-be8a-5d067a5927b9 admin admin] PATH_INFO: `/v3/projects/83db781351b1465688d762f36bb8fb94` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:33.067373 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-6c38c437-43d9-49ad-8533-70c7df5f1f36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:33.067912 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b96fcd-12bb-47b2-be8a-5d067a5927b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83db781351b1465688d762f36bb8fb94)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:33.069903 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b96fcd-12bb-47b2-be8a-5d067a5927b9 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:33.130537 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-11b96fcd-12bb-47b2-be8a-5d067a5927b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83db781351b1465688d762f36bb8fb94', 'request_id': 'req-11b96fcd-12bb-47b2-be8a-5d067a5927b9'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:33.133061 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:33.140926 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-11b96fcd-12bb-47b2-be8a-5d067a5927b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83db781351b1465688d762f36bb8fb94', 'request_id': 'req-11b96fcd-12bb-47b2-be8a-5d067a5927b9'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:33.157728 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-11b96fcd-12bb-47b2-be8a-5d067a5927b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83db781351b1465688d762f36bb8fb94', 'request_id': 'req-11b96fcd-12bb-47b2-be8a-5d067a5927b9'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:33.172597 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c38c437-43d9-49ad-8533-70c7df5f1f36 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:33.177377 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-11b96fcd-12bb-47b2-be8a-5d067a5927b9 admin admin] The token cache is being invalidate because project 83db781351b1465688d762f36bb8fb94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:01:33.177872 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-11b96fcd-12bb-47b2-be8a-5d067a5927b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:33.178913 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-11b96fcd-12bb-47b2-be8a-5d067a5927b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:33.181637 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1297/2603] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 16:01:32 2022] DELETE /identity/v3/projects/83db781351b1465688d762f36bb8fb94 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:01:33.187801 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25675696-f3d7-4576-8093-16ed4a07415d None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:33.188292 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25675696-f3d7-4576-8093-16ed4a07415d None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:33.188572 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25675696-f3d7-4576-8093-16ed4a07415d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:33.210541 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-25675696-f3d7-4576-8093-16ed4a07415d None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:01:33.211769 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-25675696-f3d7-4576-8093-16ed4a07415d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:33.248767 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db621aa1-46c9-42aa-b06b-d575252302b6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c270b488024605af84e52d874474e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:33.249538 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db621aa1-46c9-42aa-b06b-d575252302b6 service placement] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:33.249898 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db621aa1-46c9-42aa-b06b-d575252302b6 service placement] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:33.250169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db621aa1-46c9-42aa-b06b-d575252302b6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:33.252384 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-db621aa1-46c9-42aa-b06b-d575252302b6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:33.264352 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db621aa1-46c9-42aa-b06b-d575252302b6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:33.265932 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db621aa1-46c9-42aa-b06b-d575252302b6 service placement] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:33.272489 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1298/2604] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:01:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:01:33.273334 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25675696-f3d7-4576-8093-16ed4a07415d None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:33.274620 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-25675696-f3d7-4576-8093-16ed4a07415d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:33.280779 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1307/2605] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:01:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:01:33.283191 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f184686-f520-4ee4-9f28-0245bbcc5952 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:33.283593 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f184686-f520-4ee4-9f28-0245bbcc5952 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:33.283936 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f184686-f520-4ee4-9f28-0245bbcc5952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:33.286433 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25675696-f3d7-4576-8093-16ed4a07415d None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:33.291642 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5dd582-0e67-4d66-8194-a489d9418394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:33.292310 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5dd582-0e67-4d66-8194-a489d9418394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:33.292541 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5dd582-0e67-4d66-8194-a489d9418394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:33.292812 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5dd582-0e67-4d66-8194-a489d9418394 admin admin] PATH_INFO: `/v3/users/1eec1d820efc467a8e5856e6302a1885` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:33.293947 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5dd582-0e67-4d66-8194-a489d9418394 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1eec1d820efc467a8e5856e6302a1885)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:33.295920 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5dd582-0e67-4d66-8194-a489d9418394 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:33.315659 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-2f184686-f520-4ee4-9f28-0245bbcc5952 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:01:33.316886 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-2f184686-f520-4ee4-9f28-0245bbcc5952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:33.325795 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1308/2606] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:01:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:01:33.331580 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f184686-f520-4ee4-9f28-0245bbcc5952 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:33.341260 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f184686-f520-4ee4-9f28-0245bbcc5952 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:33.346545 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36099b83-6882-451b-a584-1f7ee2817d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:33.347141 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36099b83-6882-451b-a584-1f7ee2817d21 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:33.349302 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36099b83-6882-451b-a584-1f7ee2817d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:33.349302 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36099b83-6882-451b-a584-1f7ee2817d21 admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:33.349302 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36099b83-6882-451b-a584-1f7ee2817d21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:01:33.349302 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36099b83-6882-451b-a584-1f7ee2817d21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:33.350194 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36099b83-6882-451b-a584-1f7ee2817d21 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:33.361973 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1309/2607] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 16:01:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:01:33.362854 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-8a5dd582-0e67-4d66-8194-a489d9418394 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1eec1d820efc467a8e5856e6302a1885'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:33.366273 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36099b83-6882-451b-a584-1f7ee2817d21 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:33.372218 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-8a5dd582-0e67-4d66-8194-a489d9418394 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1eec1d820efc467a8e5856e6302a1885'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:33.372837 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-8a5dd582-0e67-4d66-8194-a489d9418394 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1eec1d820efc467a8e5856e6302a1885'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:33.377326 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36099b83-6882-451b-a584-1f7ee2817d21 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:33.381878 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c298118-95c5-47ec-93cb-20d2f9a2f960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:33.382493 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c298118-95c5-47ec-93cb-20d2f9a2f960 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:33.382769 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c298118-95c5-47ec-93cb-20d2f9a2f960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:33.383038 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c298118-95c5-47ec-93cb-20d2f9a2f960 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:33.383658 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c298118-95c5-47ec-93cb-20d2f9a2f960 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:33.385995 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-8a5dd582-0e67-4d66-8194-a489d9418394 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1eec1d820efc467a8e5856e6302a1885'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:33.386156 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c298118-95c5-47ec-93cb-20d2f9a2f960 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:33.386717 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-8a5dd582-0e67-4d66-8194-a489d9418394 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1eec1d820efc467a8e5856e6302a1885'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:33.406420 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1299/2608] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 16:01:33 2022] DELETE /identity/v3/users/1eec1d820efc467a8e5856e6302a1885 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:01:33.407346 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:33.417514 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1310/2609] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 16:01:33 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:01:33.419271 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5dd582-0e67-4d66-8194-a489d9418394 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:33.420721 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-8a5dd582-0e67-4d66-8194-a489d9418394 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:33.476438 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:33.491847 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5dd582-0e67-4d66-8194-a489d9418394 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:33.550443 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a94a4-c6ef-4292-807c-309c52f66fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:33.551059 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a94a4-c6ef-4292-807c-309c52f66fa4 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:33.551346 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a94a4-c6ef-4292-807c-309c52f66fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:33.551623 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a94a4-c6ef-4292-807c-309c52f66fa4 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:33.552255 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7a94a4-c6ef-4292-807c-309c52f66fa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:33.554200 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7a94a4-c6ef-4292-807c-309c52f66fa4 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:33.578156 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1300/2610] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 16:01:33 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:01:33.582581 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c298118-95c5-47ec-93cb-20d2f9a2f960 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:33.583906 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a94a4-c6ef-4292-807c-309c52f66fa4 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:33.585810 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-4a7a94a4-c6ef-4292-807c-309c52f66fa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:33.594963 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c298118-95c5-47ec-93cb-20d2f9a2f960 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:33.599744 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3b5b9-0e35-4cfb-8e7b-98cd4984446f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:33.601044 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3b5b9-0e35-4cfb-8e7b-98cd4984446f admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:33.601334 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3b5b9-0e35-4cfb-8e7b-98cd4984446f admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:33.601610 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3b5b9-0e35-4cfb-8e7b-98cd4984446f admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:33.602295 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f3b5b9-0e35-4cfb-8e7b-98cd4984446f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:33.603708 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a94a4-c6ef-4292-807c-309c52f66fa4 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:33.604727 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f3b5b9-0e35-4cfb-8e7b-98cd4984446f admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:33.610806 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d49e4-7348-47b0-bf0e-ec445e1fbd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:33.611902 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d49e4-7348-47b0-bf0e-ec445e1fbd25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:33.612212 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d49e4-7348-47b0-bf0e-ec445e1fbd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:33.612428 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d49e4-7348-47b0-bf0e-ec445e1fbd25 admin admin] PATH_INFO: `/v3/projects/88ce96327a2d49489714d08aa5b155cf` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:33.613922 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d49e4-7348-47b0-bf0e-ec445e1fbd25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88ce96327a2d49489714d08aa5b155cf)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:33.615927 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d49e4-7348-47b0-bf0e-ec445e1fbd25 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:33.616249 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1311/2611] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:01:33.620825 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3b5b9-0e35-4cfb-8e7b-98cd4984446f admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:33.631024 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3b5b9-0e35-4cfb-8e7b-98cd4984446f admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:33.636786 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fafc37-e56c-43e8-a72b-d03728991500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:33.637360 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fafc37-e56c-43e8-a72b-d03728991500 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:33.637640 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fafc37-e56c-43e8-a72b-d03728991500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:33.637915 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fafc37-e56c-43e8-a72b-d03728991500 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:33.638589 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fafc37-e56c-43e8-a72b-d03728991500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:33.640210 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fafc37-e56c-43e8-a72b-d03728991500 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:33.651250 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1312/2612] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:01:33.655445 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fafc37-e56c-43e8-a72b-d03728991500 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:33.666503 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fafc37-e56c-43e8-a72b-d03728991500 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:33.666954 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-564d49e4-7348-47b0-bf0e-ec445e1fbd25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88ce96327a2d49489714d08aa5b155cf', 'request_id': 'req-564d49e4-7348-47b0-bf0e-ec445e1fbd25'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:33.673658 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-564d49e4-7348-47b0-bf0e-ec445e1fbd25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88ce96327a2d49489714d08aa5b155cf', 'request_id': 'req-564d49e4-7348-47b0-bf0e-ec445e1fbd25'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:33.682317 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-564d49e4-7348-47b0-bf0e-ec445e1fbd25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88ce96327a2d49489714d08aa5b155cf', 'request_id': 'req-564d49e4-7348-47b0-bf0e-ec445e1fbd25'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:33.695405 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-564d49e4-7348-47b0-bf0e-ec445e1fbd25 admin admin] The token cache is being invalidate because project 88ce96327a2d49489714d08aa5b155cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:01:33.695722 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-564d49e4-7348-47b0-bf0e-ec445e1fbd25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:33.696402 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-564d49e4-7348-47b0-bf0e-ec445e1fbd25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:01:33.697928 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1301/2613] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 16:01:33 2022] DELETE /identity/v3/projects/88ce96327a2d49489714d08aa5b155cf => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:01:33.702808 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96246eda-3da5-4809-9eee-a8526cfa4059 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:33.703097 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96246eda-3da5-4809-9eee-a8526cfa4059 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:33.703373 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96246eda-3da5-4809-9eee-a8526cfa4059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:33.723183 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-96246eda-3da5-4809-9eee-a8526cfa4059 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:01:33.724381 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-96246eda-3da5-4809-9eee-a8526cfa4059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:33.729120 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575069b-7aed-45b6-ba1d-23db85543862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:33.729890 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575069b-7aed-45b6-ba1d-23db85543862 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:33.730188 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575069b-7aed-45b6-ba1d-23db85543862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:33.730483 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575069b-7aed-45b6-ba1d-23db85543862 admin admin] PATH_INFO: `/v3/projects/d3ef84e7786d446c8de6df478f2a928b/users/53495fcef2f046449458f91f2933dc71/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:33.734558 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1302/2614] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:01:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:01:33.741787 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f7779-8a59-475e-920c-2a5d5922e830 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:33.742078 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f7779-8a59-475e-920c-2a5d5922e830 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:33.742396 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f7779-8a59-475e-920c-2a5d5922e830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:33.746503 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2575069b-7aed-45b6-ba1d-23db85543862 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3ef84e7786d446c8de6df478f2a928b, user_id=53495fcef2f046449458f91f2933dc71, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:33.749178 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2575069b-7aed-45b6-ba1d-23db85543862 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:33.763260 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1313/2615] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 16:01:33 2022] PUT /identity/v3/projects/d3ef84e7786d446c8de6df478f2a928b/users/53495fcef2f046449458f91f2933dc71/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:01:33.765531 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-408f7779-8a59-475e-920c-2a5d5922e830 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:01:33.766884 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-408f7779-8a59-475e-920c-2a5d5922e830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:33.768273 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada16dd0-0b3b-48ad-a6b8-dcc935162170 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:33.768564 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada16dd0-0b3b-48ad-a6b8-dcc935162170 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:33.768839 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada16dd0-0b3b-48ad-a6b8-dcc935162170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:33.789498 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-ada16dd0-0b3b-48ad-a6b8-dcc935162170 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:01:33.791404 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-ada16dd0-0b3b-48ad-a6b8-dcc935162170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:33.846112 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1303/2616] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:01:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:01:33.847050 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f7779-8a59-475e-920c-2a5d5922e830 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:33.857772 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f7779-8a59-475e-920c-2a5d5922e830 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:33.861125 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1314/2617] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:01:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:01:33.862879 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee90799-2d9e-4e13-aad4-6a3e6363c136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:33.863558 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee90799-2d9e-4e13-aad4-6a3e6363c136 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:33.863908 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee90799-2d9e-4e13-aad4-6a3e6363c136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:33.864188 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee90799-2d9e-4e13-aad4-6a3e6363c136 admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:33.864839 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee90799-2d9e-4e13-aad4-6a3e6363c136 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:01:33.865270 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee90799-2d9e-4e13-aad4-6a3e6363c136 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:33.866915 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee90799-2d9e-4e13-aad4-6a3e6363c136 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:33.868650 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:33.873468 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada16dd0-0b3b-48ad-a6b8-dcc935162170 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:33.878275 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-ada16dd0-0b3b-48ad-a6b8-dcc935162170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:33.887710 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1304/2618] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 16:01:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:01:33.893168 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee90799-2d9e-4e13-aad4-6a3e6363c136 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:33.910007 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee90799-2d9e-4e13-aad4-6a3e6363c136 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:33.914691 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b6e43-6fe1-469d-bcad-68f2ae661d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:33.915290 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b6e43-6fe1-469d-bcad-68f2ae661d99 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:33.916639 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b6e43-6fe1-469d-bcad-68f2ae661d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:33.916639 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b6e43-6fe1-469d-bcad-68f2ae661d99 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:33.917319 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990b6e43-6fe1-469d-bcad-68f2ae661d99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:33.919358 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990b6e43-6fe1-469d-bcad-68f2ae661d99 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:33.946292 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada16dd0-0b3b-48ad-a6b8-dcc935162170 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:33.952445 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1305/2619] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 16:01:33 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:01:33.952591 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a03117-a2a8-43b7-b191-8772532ec57f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:33.952591 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a03117-a2a8-43b7-b191-8772532ec57f service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:33.952591 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a03117-a2a8-43b7-b191-8772532ec57f service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:33.952591 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a03117-a2a8-43b7-b191-8772532ec57f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:33.953474 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b6e43-6fe1-469d-bcad-68f2ae661d99 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:33.960811 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a03117-a2a8-43b7-b191-8772532ec57f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:33.963251 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a03117-a2a8-43b7-b191-8772532ec57f service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:33.972869 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1315/2620] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:01:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:01:34.019201 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b6e43-6fe1-469d-bcad-68f2ae661d99 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:34.024405 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4556f00-5b5e-447e-ab34-04c780a72aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:34.025678 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4556f00-5b5e-447e-ab34-04c780a72aa7 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:34.026000 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4556f00-5b5e-447e-ab34-04c780a72aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:34.026415 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4556f00-5b5e-447e-ab34-04c780a72aa7 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:34.027051 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4556f00-5b5e-447e-ab34-04c780a72aa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:34.029097 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4556f00-5b5e-447e-ab34-04c780a72aa7 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:34.054050 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1306/2621] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 16:01:33 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:01:34.058396 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a03117-a2a8-43b7-b191-8772532ec57f service neutron] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:34.063354 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:34.069352 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a03117-a2a8-43b7-b191-8772532ec57f service neutron] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:34.075923 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c579b-5736-4f92-831e-601b259b1542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:34.076605 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c579b-5736-4f92-831e-601b259b1542 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:34.077147 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c579b-5736-4f92-831e-601b259b1542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:34.077579 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c579b-5736-4f92-831e-601b259b1542 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:34.078092 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90c579b-5736-4f92-831e-601b259b1542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:34.079861 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90c579b-5736-4f92-831e-601b259b1542 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:34.090852 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1316/2622] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:01:34.096383 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4556f00-5b5e-447e-ab34-04c780a72aa7 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:34.106201 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4556f00-5b5e-447e-ab34-04c780a72aa7 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:34.111445 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fdb16d-bce1-4032-98a3-5b419dd8a2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:34.112055 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdb16d-bce1-4032-98a3-5b419dd8a2dd admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:34.112341 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdb16d-bce1-4032-98a3-5b419dd8a2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:34.112613 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdb16d-bce1-4032-98a3-5b419dd8a2dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:34.113252 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fdb16d-bce1-4032-98a3-5b419dd8a2dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:34.115171 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fdb16d-bce1-4032-98a3-5b419dd8a2dd admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:34.125591 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1307/2623] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:01:34.129924 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c579b-5736-4f92-831e-601b259b1542 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:34.139978 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c579b-5736-4f92-831e-601b259b1542 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:34.144709 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafa7c3-0c74-43f2-8319-9c7109fb4258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:34.145361 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafa7c3-0c74-43f2-8319-9c7109fb4258 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:34.145638 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafa7c3-0c74-43f2-8319-9c7109fb4258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:34.145907 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafa7c3-0c74-43f2-8319-9c7109fb4258 admin admin] PATH_INFO: `/v3/projects/e445b17dd7744832a480fd3bbab438ce/users/f8cff93bade24d5581dcbbe90a7bf647/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:34.164580 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aafa7c3-0c74-43f2-8319-9c7109fb4258 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e445b17dd7744832a480fd3bbab438ce, user_id=f8cff93bade24d5581dcbbe90a7bf647, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:34.168432 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aafa7c3-0c74-43f2-8319-9c7109fb4258 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:34.184856 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1317/2624] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 16:01:34 2022] PUT /identity/v3/projects/e445b17dd7744832a480fd3bbab438ce/users/f8cff93bade24d5581dcbbe90a7bf647/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:01:34.189817 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f0bb93-c268-4afe-8b3b-293463389e1c None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:34.190166 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f0bb93-c268-4afe-8b3b-293463389e1c None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:34.190489 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f0bb93-c268-4afe-8b3b-293463389e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:34.215544 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-c9f0bb93-c268-4afe-8b3b-293463389e1c None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:01:34.216793 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-c9f0bb93-c268-4afe-8b3b-293463389e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:34.288696 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1308/2625] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:01:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:01:34.302391 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafa7c3-0c74-43f2-8319-9c7109fb4258 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:34.304122 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-6aafa7c3-0c74-43f2-8319-9c7109fb4258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:34.380911 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafa7c3-0c74-43f2-8319-9c7109fb4258 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:34.385270 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f8fd5-a53a-42a0-8301-7977148b4bb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:34.385979 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f8fd5-a53a-42a0-8301-7977148b4bb8 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:34.386425 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f8fd5-a53a-42a0-8301-7977148b4bb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:34.386795 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f8fd5-a53a-42a0-8301-7977148b4bb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:34.396365 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f8fd5-a53a-42a0-8301-7977148b4bb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:34.397939 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f8fd5-a53a-42a0-8301-7977148b4bb8 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:34.411064 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1318/2626] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:01:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:01:34.693116 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a87e2-2c4f-4398-b4fa-db07e02c93e5 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:34.693664 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a87e2-2c4f-4398-b4fa-db07e02c93e5 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:34.693966 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a87e2-2c4f-4398-b4fa-db07e02c93e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:34.734401 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-ef0a87e2-2c4f-4398-b4fa-db07e02c93e5 None None] MFA Rules not processed for user `53495fcef2f046449458f91f2933dc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:01:34.735731 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-ef0a87e2-2c4f-4398-b4fa-db07e02c93e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:34.788360 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:34.823482 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1309/2627] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:01:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:01:34.824754 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f8fd5-a53a-42a0-8301-7977148b4bb8 service neutron] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:34.826643 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-279f8fd5-a53a-42a0-8301-7977148b4bb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:34.840187 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f8fd5-a53a-42a0-8301-7977148b4bb8 service neutron] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:34.846480 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577702b4-46fb-46d4-91dd-fcd244d5cf93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:34.847294 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577702b4-46fb-46d4-91dd-fcd244d5cf93 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:34.848025 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577702b4-46fb-46d4-91dd-fcd244d5cf93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:34.848400 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577702b4-46fb-46d4-91dd-fcd244d5cf93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:34.849136 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577702b4-46fb-46d4-91dd-fcd244d5cf93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:34.851167 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577702b4-46fb-46d4-91dd-fcd244d5cf93 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:34.882262 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1319/2628] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 16:01:34 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:01:34.888000 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a87e2-2c4f-4398-b4fa-db07e02c93e5 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:34.899693 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a87e2-2c4f-4398-b4fa-db07e02c93e5 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:34.974034 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ff2e0-ecae-44eb-bf77-701bcc269be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:34.974697 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ff2e0-ecae-44eb-bf77-701bcc269be9 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:34.974976 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ff2e0-ecae-44eb-bf77-701bcc269be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:34.975246 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ff2e0-ecae-44eb-bf77-701bcc269be9 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:34.975876 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ff2e0-ecae-44eb-bf77-701bcc269be9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:34.977799 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ff2e0-ecae-44eb-bf77-701bcc269be9 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:35.010678 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1310/2629] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 16:01:34 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:01:35.014750 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577702b4-46fb-46d4-91dd-fcd244d5cf93 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:35.025707 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577702b4-46fb-46d4-91dd-fcd244d5cf93 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:35.031814 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851bd239-7e86-4cee-b865-df4cbf083776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:35.032097 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851bd239-7e86-4cee-b865-df4cbf083776 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:35.032503 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851bd239-7e86-4cee-b865-df4cbf083776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:35.032658 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851bd239-7e86-4cee-b865-df4cbf083776 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:35.033291 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851bd239-7e86-4cee-b865-df4cbf083776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:35.035052 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851bd239-7e86-4cee-b865-df4cbf083776 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:35.063694 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1320/2630] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:01:35.065342 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ff2e0-ecae-44eb-bf77-701bcc269be9 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:35.083468 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ff2e0-ecae-44eb-bf77-701bcc269be9 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:35.090039 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cfe4b4-dc1b-4f53-a591-13bac9890429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:35.090819 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cfe4b4-dc1b-4f53-a591-13bac9890429 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:35.091121 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cfe4b4-dc1b-4f53-a591-13bac9890429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:35.091306 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cfe4b4-dc1b-4f53-a591-13bac9890429 admin admin] PATH_INFO: `/v3/projects/040430a3e65a433aa9398ecb8633c51d/users/9599551fa1e64aac83e319c02ff20eae/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:35.109558 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cfe4b4-dc1b-4f53-a591-13bac9890429 admin admin] RBAC: Authorizing `identity:create_grant(project_id=040430a3e65a433aa9398ecb8633c51d, user_id=9599551fa1e64aac83e319c02ff20eae, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:35.112301 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cfe4b4-dc1b-4f53-a591-13bac9890429 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:35.128681 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1311/2631] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 16:01:35 2022] PUT /identity/v3/projects/040430a3e65a433aa9398ecb8633c51d/users/9599551fa1e64aac83e319c02ff20eae/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:01:35.132251 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851bd239-7e86-4cee-b865-df4cbf083776 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:35.142727 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851bd239-7e86-4cee-b865-df4cbf083776 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:35.209408 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed3d0b-0224-4402-be76-e4d6065a6112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:35.210472 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed3d0b-0224-4402-be76-e4d6065a6112 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:35.211056 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed3d0b-0224-4402-be76-e4d6065a6112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:35.211430 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed3d0b-0224-4402-be76-e4d6065a6112 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:35.212177 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aed3d0b-0224-4402-be76-e4d6065a6112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:35.214407 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aed3d0b-0224-4402-be76-e4d6065a6112 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:35.226799 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1321/2632] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:01:35.232066 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cfe4b4-dc1b-4f53-a591-13bac9890429 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:35.243169 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cfe4b4-dc1b-4f53-a591-13bac9890429 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:35.249005 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f113665d-fd15-4ea2-a148-31ef8a069c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:35.249889 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113665d-fd15-4ea2-a148-31ef8a069c6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:35.250379 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113665d-fd15-4ea2-a148-31ef8a069c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:35.250660 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113665d-fd15-4ea2-a148-31ef8a069c6f admin admin] PATH_INFO: `/v3/projects/040430a3e65a433aa9398ecb8633c51d/users/9599551fa1e64aac83e319c02ff20eae/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:35.252604 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f113665d-fd15-4ea2-a148-31ef8a069c6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=040430a3e65a433aa9398ecb8633c51d, user_id=9599551fa1e64aac83e319c02ff20eae, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:35.255292 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f113665d-fd15-4ea2-a148-31ef8a069c6f admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:35.267612 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1312/2633] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 16:01:35 2022] PUT /identity/v3/projects/040430a3e65a433aa9398ecb8633c51d/users/9599551fa1e64aac83e319c02ff20eae/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:01:36.417800 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3992ed-0c15-4a30-bbe5-9fc48085335f None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:36.418379 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3992ed-0c15-4a30-bbe5-9fc48085335f None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:36.418379 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3992ed-0c15-4a30-bbe5-9fc48085335f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:36.452392 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-8c3992ed-0c15-4a30-bbe5-9fc48085335f None None] MFA Rules not processed for user `9599551fa1e64aac83e319c02ff20eae`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:01:36.453613 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-8c3992ed-0c15-4a30-bbe5-9fc48085335f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:36.479726 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:36.549373 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1322/2634] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:01:36 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:01:36.562580 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a2d71-ebd2-48b8-9018-2dc6785695d1 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:36.563106 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a2d71-ebd2-48b8-9018-2dc6785695d1 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:36.563106 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a2d71-ebd2-48b8-9018-2dc6785695d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:36.585112 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-d42a2d71-ebd2-48b8-9018-2dc6785695d1 None None] MFA Rules not processed for user `53495fcef2f046449458f91f2933dc71`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:01:36.586500 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-d42a2d71-ebd2-48b8-9018-2dc6785695d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:36.653402 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1313/2635] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:01:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:01:36.670761 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3992ed-0c15-4a30-bbe5-9fc48085335f None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:36.672178 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-8c3992ed-0c15-4a30-bbe5-9fc48085335f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:36.776446 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3992ed-0c15-4a30-bbe5-9fc48085335f None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:36.784137 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bafe76-34a7-4dc3-b4f7-4b7dff96d96c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:36.784776 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bafe76-34a7-4dc3-b4f7-4b7dff96d96c service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:36.785059 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bafe76-34a7-4dc3-b4f7-4b7dff96d96c service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:36.785356 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bafe76-34a7-4dc3-b4f7-4b7dff96d96c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:36.800853 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bafe76-34a7-4dc3-b4f7-4b7dff96d96c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:36.803006 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bafe76-34a7-4dc3-b4f7-4b7dff96d96c service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:36.817802 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1323/2636] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:01:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:01:37.281265 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a2d71-ebd2-48b8-9018-2dc6785695d1 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:37.354529 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:37.383046 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a2d71-ebd2-48b8-9018-2dc6785695d1 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:37.391610 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5e9fb-8ab8-4934-ad2b-5b5abfcc4910 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:37.393140 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5e9fb-8ab8-4934-ad2b-5b5abfcc4910 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:37.394383 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5e9fb-8ab8-4934-ad2b-5b5abfcc4910 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:37.395303 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5e9fb-8ab8-4934-ad2b-5b5abfcc4910 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:37.399797 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-21b5e9fb-8ab8-4934-ad2b-5b5abfcc4910 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:37.421148 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b5e9fb-8ab8-4934-ad2b-5b5abfcc4910 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:37.425119 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b5e9fb-8ab8-4934-ad2b-5b5abfcc4910 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:37.450751 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1314/2637] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:01:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:01:37.835323 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bafe76-34a7-4dc3-b4f7-4b7dff96d96c service nova] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:37.837034 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-c5bafe76-34a7-4dc3-b4f7-4b7dff96d96c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:37.962034 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bafe76-34a7-4dc3-b4f7-4b7dff96d96c service nova] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:37.969322 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106e612-1b00-4e0d-90ef-55435d061fea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c270b488024605af84e52d874474e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:37.970883 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106e612-1b00-4e0d-90ef-55435d061fea service placement] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:37.971093 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106e612-1b00-4e0d-90ef-55435d061fea service placement] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:37.971342 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106e612-1b00-4e0d-90ef-55435d061fea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:37.974437 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-0106e612-1b00-4e0d-90ef-55435d061fea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:37.995183 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0106e612-1b00-4e0d-90ef-55435d061fea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:37.996823 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0106e612-1b00-4e0d-90ef-55435d061fea service placement] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:38.008409 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1324/2638] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:01:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:01:39.237324 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd80ba74-90dd-4de1-b326-cf1031f261eb None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:39.237789 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd80ba74-90dd-4de1-b326-cf1031f261eb None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:39.238044 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd80ba74-90dd-4de1-b326-cf1031f261eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:39.302163 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-cd80ba74-90dd-4de1-b326-cf1031f261eb None None] MFA Rules not processed for user `f8cff93bade24d5581dcbbe90a7bf647`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:01:39.303655 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-cd80ba74-90dd-4de1-b326-cf1031f261eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:39.427974 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1315/2639] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:01:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:01:39.445439 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106e612-1b00-4e0d-90ef-55435d061fea service placement] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:39.447760 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-0106e612-1b00-4e0d-90ef-55435d061fea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:39.465247 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106e612-1b00-4e0d-90ef-55435d061fea service placement] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:39.471460 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb39775-9047-4b4f-8c3b-9d5944f1e7c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:39.472501 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb39775-9047-4b4f-8c3b-9d5944f1e7c6 service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:39.472948 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb39775-9047-4b4f-8c3b-9d5944f1e7c6 service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:39.473218 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb39775-9047-4b4f-8c3b-9d5944f1e7c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:39.483735 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb39775-9047-4b4f-8c3b-9d5944f1e7c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:39.485745 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb39775-9047-4b4f-8c3b-9d5944f1e7c6 service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:39.501038 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1325/2640] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:01:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:01:40.876881 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd80ba74-90dd-4de1-b326-cf1031f261eb None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:40.888249 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd80ba74-90dd-4de1-b326-cf1031f261eb None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:40.892404 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19704780-82cb-4e67-983d-2193b7ccae9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:40.893100 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19704780-82cb-4e67-983d-2193b7ccae9e service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:40.893450 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19704780-82cb-4e67-983d-2193b7ccae9e service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:40.893796 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19704780-82cb-4e67-983d-2193b7ccae9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:40.895930 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-19704780-82cb-4e67-983d-2193b7ccae9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:40.906870 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19704780-82cb-4e67-983d-2193b7ccae9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:40.908543 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19704780-82cb-4e67-983d-2193b7ccae9e service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:40.918290 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1316/2641] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:01:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:01:41.721055 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5751f-a1a7-45a1-a12e-b123cc9b152a None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:41.721546 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5751f-a1a7-45a1-a12e-b123cc9b152a None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:41.721663 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5751f-a1a7-45a1-a12e-b123cc9b152a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:41.747610 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-09a5751f-a1a7-45a1-a12e-b123cc9b152a None None] MFA Rules not processed for user `f8cff93bade24d5581dcbbe90a7bf647`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:01:41.748909 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-09a5751f-a1a7-45a1-a12e-b123cc9b152a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:41.757516 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1326/2642] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:01:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:01:42.436990 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19704780-82cb-4e67-983d-2193b7ccae9e service neutron] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:42.447350 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19704780-82cb-4e67-983d-2193b7ccae9e service neutron] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:42.457065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c141f-4a3a-44db-abbe-a9697ecccada service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:42.458026 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c141f-4a3a-44db-abbe-a9697ecccada service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:42.458813 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c141f-4a3a-44db-abbe-a9697ecccada service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:42.459376 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c141f-4a3a-44db-abbe-a9697ecccada service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:42.461936 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-632c141f-4a3a-44db-abbe-a9697ecccada service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:42.482167 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632c141f-4a3a-44db-abbe-a9697ecccada service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:42.483660 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632c141f-4a3a-44db-abbe-a9697ecccada service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:42.501231 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1317/2643] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:01:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:01:44.418729 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8ca90-c963-47ea-b356-1101736a3a31 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:44.419396 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8ca90-c963-47ea-b356-1101736a3a31 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:44.419396 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8ca90-c963-47ea-b356-1101736a3a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:44.441147 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-a6f8ca90-c963-47ea-b356-1101736a3a31 None None] MFA Rules not processed for user `3e20e40a37df4898bfe692535e5e4f25`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:01:44.442410 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-a6f8ca90-c963-47ea-b356-1101736a3a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:44.452766 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=100 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:01:44.511512 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1327/2644] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Sep 7 16:01:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:01:44.586264 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c141f-4a3a-44db-abbe-a9697ecccada service neutron] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:44.589166 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-632c141f-4a3a-44db-abbe-a9697ecccada service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:44.700345 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c141f-4a3a-44db-abbe-a9697ecccada service neutron] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:44.707652 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1914cf3-d8d4-4192-a00f-cd67bbc8e330 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16c4b090a4aa4d56a90ccf090b9caba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:44.708512 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1914cf3-d8d4-4192-a00f-cd67bbc8e330 service swift] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:44.708893 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1914cf3-d8d4-4192-a00f-cd67bbc8e330 service swift] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:44.709204 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1914cf3-d8d4-4192-a00f-cd67bbc8e330 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:44.720053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1914cf3-d8d4-4192-a00f-cd67bbc8e330 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:44.721937 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1914cf3-d8d4-4192-a00f-cd67bbc8e330 service swift] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:44.732359 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1318/2645] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Sep 7 16:01:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 16:01:46.881448 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8ca90-c963-47ea-b356-1101736a3a31 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:46.911208 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8ca90-c963-47ea-b356-1101736a3a31 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:46.928671 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8dffb3-0658-42bd-8b68-71a6267e4cb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:46.932394 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8dffb3-0658-42bd-8b68-71a6267e4cb2 service nova] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:46.934297 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8dffb3-0658-42bd-8b68-71a6267e4cb2 service nova] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:46.934884 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8dffb3-0658-42bd-8b68-71a6267e4cb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:46.940874 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-0b8dffb3-0658-42bd-8b68-71a6267e4cb2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:46.970411 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8dffb3-0658-42bd-8b68-71a6267e4cb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:46.975716 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8dffb3-0658-42bd-8b68-71a6267e4cb2 service nova] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:46.989723 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1328/2646] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:01:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:01:49.917495 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1914cf3-d8d4-4192-a00f-cd67bbc8e330 service swift] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:49.931406 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1914cf3-d8d4-4192-a00f-cd67bbc8e330 service swift] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:49.951199 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86b431-7aa5-4ae8-a8e6-c073cfe3201b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:49.951828 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86b431-7aa5-4ae8-a8e6-c073cfe3201b service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:49.952110 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86b431-7aa5-4ae8-a8e6-c073cfe3201b service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:49.952391 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86b431-7aa5-4ae8-a8e6-c073cfe3201b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:49.957355 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-7b86b431-7aa5-4ae8-a8e6-c073cfe3201b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:49.999105 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b86b431-7aa5-4ae8-a8e6-c073cfe3201b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:50.001289 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b86b431-7aa5-4ae8-a8e6-c073cfe3201b service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:50.019675 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1319/2647] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:01:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:01:50.992128 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8dffb3-0658-42bd-8b68-71a6267e4cb2 service nova] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:50.996214 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-0b8dffb3-0658-42bd-8b68-71a6267e4cb2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:51.148179 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8dffb3-0658-42bd-8b68-71a6267e4cb2 service nova] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:51.158143 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de080f-bfd1-462c-bc8c-e18ebff697da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:51.159219 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de080f-bfd1-462c-bc8c-e18ebff697da service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:51.159743 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de080f-bfd1-462c-bc8c-e18ebff697da service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:51.160178 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de080f-bfd1-462c-bc8c-e18ebff697da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:51.187473 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de080f-bfd1-462c-bc8c-e18ebff697da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:51.189237 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de080f-bfd1-462c-bc8c-e18ebff697da service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:51.227059 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1329/2648] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:01:50 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:01:52.324517 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86b431-7aa5-4ae8-a8e6-c073cfe3201b service nova] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:01:52.336576 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86b431-7aa5-4ae8-a8e6-c073cfe3201b service nova] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:01:52.342669 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a7556-977d-467b-bf4a-2be1bdb691d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:01:52.343284 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a7556-977d-467b-bf4a-2be1bdb691d7 service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:01:52.343565 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a7556-977d-467b-bf4a-2be1bdb691d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:01:52.343838 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a7556-977d-467b-bf4a-2be1bdb691d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:01:52.345631 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-7b0a7556-977d-467b-bf4a-2be1bdb691d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:01:52.362225 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a7556-977d-467b-bf4a-2be1bdb691d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:01:52.363889 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a7556-977d-467b-bf4a-2be1bdb691d7 service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:01:52.389066 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1320/2649] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:01:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:02:01.221090 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=51 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:02.373257 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:02.926656 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55105f61-8417-4aa6-b06f-fd7885e026e4 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:02.927193 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55105f61-8417-4aa6-b06f-fd7885e026e4 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:02.927292 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55105f61-8417-4aa6-b06f-fd7885e026e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:02.947915 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-55105f61-8417-4aa6-b06f-fd7885e026e4 None None] MFA Rules not processed for user `3e20e40a37df4898bfe692535e5e4f25`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:02:02.949115 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-55105f61-8417-4aa6-b06f-fd7885e026e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:02.956320 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1330/2650] 10.222.0.16 () {58 vars in 967 bytes} [Wed Sep 7 16:02:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:02:02.973385 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a7556-977d-467b-bf4a-2be1bdb691d7 service nova] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:02:02.987797 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a7556-977d-467b-bf4a-2be1bdb691d7 service nova] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:02:02.993977 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87592f6d-f8e9-41a2-9f37-54a41628c8d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16c4b090a4aa4d56a90ccf090b9caba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:02:02.994992 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87592f6d-f8e9-41a2-9f37-54a41628c8d4 service swift] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:02.995544 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87592f6d-f8e9-41a2-9f37-54a41628c8d4 service swift] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:02.995823 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87592f6d-f8e9-41a2-9f37-54a41628c8d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:03.004351 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87592f6d-f8e9-41a2-9f37-54a41628c8d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:02:03.005991 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87592f6d-f8e9-41a2-9f37-54a41628c8d4 service swift] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:02:03.016945 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1321/2651] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Sep 7 16:02:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 16:02:06.045323 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a20c6-1b0b-4949-8525-bb8518f8cd02 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:06.045323 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a20c6-1b0b-4949-8525-bb8518f8cd02 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:06.045775 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a20c6-1b0b-4949-8525-bb8518f8cd02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:06.065004 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-967a20c6-1b0b-4949-8525-bb8518f8cd02 None None] MFA Rules not processed for user `3e20e40a37df4898bfe692535e5e4f25`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:02:06.066350 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-967a20c6-1b0b-4949-8525-bb8518f8cd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:06.075153 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1331/2652] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Sep 7 16:02:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:02:06.089950 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87592f6d-f8e9-41a2-9f37-54a41628c8d4 service swift] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:02:06.103331 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87592f6d-f8e9-41a2-9f37-54a41628c8d4 service swift] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:02:06.109618 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7cdb65-9dd1-44ca-9ca5-3dd27e674167 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16c4b090a4aa4d56a90ccf090b9caba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:02:06.110299 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7cdb65-9dd1-44ca-9ca5-3dd27e674167 service swift] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:06.110685 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7cdb65-9dd1-44ca-9ca5-3dd27e674167 service swift] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:06.110973 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7cdb65-9dd1-44ca-9ca5-3dd27e674167 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:06.119740 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7cdb65-9dd1-44ca-9ca5-3dd27e674167 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:02:06.121439 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7cdb65-9dd1-44ca-9ca5-3dd27e674167 service swift] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:02:06.134109 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1322/2653] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Sep 7 16:02:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 16:02:12.342836 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a20c6-1b0b-4949-8525-bb8518f8cd02 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:02:12.344093 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-967a20c6-1b0b-4949-8525-bb8518f8cd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:12.439887 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a20c6-1b0b-4949-8525-bb8518f8cd02 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:02:12.445492 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef4c3b0-dcb0-4a74-ba18-1a8546644ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:02:12.446939 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4c3b0-dcb0-4a74-ba18-1a8546644ede admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:12.447469 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4c3b0-dcb0-4a74-ba18-1a8546644ede admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:12.447970 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4c3b0-dcb0-4a74-ba18-1a8546644ede admin admin] PATH_INFO: `/v3/users/ffef8094ff9147b6abc9e61fd2d42231` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:12.449425 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef4c3b0-dcb0-4a74-ba18-1a8546644ede admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffef8094ff9147b6abc9e61fd2d42231)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:02:12.452169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef4c3b0-dcb0-4a74-ba18-1a8546644ede admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:02:12.518768 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-7ef4c3b0-dcb0-4a74-ba18-1a8546644ede admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffef8094ff9147b6abc9e61fd2d42231'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:02:12.541317 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-7ef4c3b0-dcb0-4a74-ba18-1a8546644ede admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffef8094ff9147b6abc9e61fd2d42231'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:02:12.542072 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-7ef4c3b0-dcb0-4a74-ba18-1a8546644ede admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffef8094ff9147b6abc9e61fd2d42231'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:02:12.559586 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-7ef4c3b0-dcb0-4a74-ba18-1a8546644ede admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffef8094ff9147b6abc9e61fd2d42231'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:02:12.560394 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-7ef4c3b0-dcb0-4a74-ba18-1a8546644ede admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffef8094ff9147b6abc9e61fd2d42231'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:02:12.584907 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1332/2654] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 16:02:12 2022] DELETE /identity/v3/users/ffef8094ff9147b6abc9e61fd2d42231 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:02:12.640359 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7cdb65-9dd1-44ca-9ca5-3dd27e674167 service swift] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:02:12.641921 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-5c7cdb65-9dd1-44ca-9ca5-3dd27e674167 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:12.667364 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7cdb65-9dd1-44ca-9ca5-3dd27e674167 service swift] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:02:12.768838 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fbc065-2174-4b08-9f63-2406ac2bef0f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c270b488024605af84e52d874474e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:02:12.776288 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fbc065-2174-4b08-9f63-2406ac2bef0f service placement] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:12.776920 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fbc065-2174-4b08-9f63-2406ac2bef0f service placement] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:12.777386 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fbc065-2174-4b08-9f63-2406ac2bef0f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:12.779928 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-34fbc065-2174-4b08-9f63-2406ac2bef0f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:12.796427 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fbc065-2174-4b08-9f63-2406ac2bef0f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:02:12.798678 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fbc065-2174-4b08-9f63-2406ac2bef0f service placement] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:02:12.821634 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1323/2655] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:02:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:02:12.908335 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef4c3b0-dcb0-4a74-ba18-1a8546644ede admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:02:12.910482 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-7ef4c3b0-dcb0-4a74-ba18-1a8546644ede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:13.018653 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef4c3b0-dcb0-4a74-ba18-1a8546644ede admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:02:13.024087 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c42ec-416d-4daf-a79a-412914224c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:02:13.025139 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c42ec-416d-4daf-a79a-412914224c99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:13.025476 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c42ec-416d-4daf-a79a-412914224c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:13.025967 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c42ec-416d-4daf-a79a-412914224c99 admin admin] PATH_INFO: `/v3/projects/0ba27ab8e53846eab2a8e698c9001cd2` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:13.027329 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c42ec-416d-4daf-a79a-412914224c99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ba27ab8e53846eab2a8e698c9001cd2)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:02:13.029460 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c42ec-416d-4daf-a79a-412914224c99 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:02:13.056371 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:13.140598 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-932c42ec-416d-4daf-a79a-412914224c99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ba27ab8e53846eab2a8e698c9001cd2', 'request_id': 'req-932c42ec-416d-4daf-a79a-412914224c99'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:02:13.147475 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-932c42ec-416d-4daf-a79a-412914224c99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ba27ab8e53846eab2a8e698c9001cd2', 'request_id': 'req-932c42ec-416d-4daf-a79a-412914224c99'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:02:13.155905 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-932c42ec-416d-4daf-a79a-412914224c99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ba27ab8e53846eab2a8e698c9001cd2', 'request_id': 'req-932c42ec-416d-4daf-a79a-412914224c99'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:02:13.172787 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-932c42ec-416d-4daf-a79a-412914224c99 admin admin] The token cache is being invalidate because project 0ba27ab8e53846eab2a8e698c9001cd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:02:13.173102 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-932c42ec-416d-4daf-a79a-412914224c99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:02:13.174054 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-932c42ec-416d-4daf-a79a-412914224c99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:02:13.179033 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1333/2656] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 16:02:12 2022] DELETE /identity/v3/projects/0ba27ab8e53846eab2a8e698c9001cd2 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:02:13.180858 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fbc065-2174-4b08-9f63-2406ac2bef0f service placement] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:02:13.203362 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fbc065-2174-4b08-9f63-2406ac2bef0f service placement] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:02:13.277705 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b2f7c-f4c7-4374-b36d-4419c288d7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:02:13.278380 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b2f7c-f4c7-4374-b36d-4419c288d7f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:13.278660 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b2f7c-f4c7-4374-b36d-4419c288d7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:13.278935 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b2f7c-f4c7-4374-b36d-4419c288d7f6 admin admin] PATH_INFO: `/v3/users/d324900938284ed3baa1ab6d491bbc8d` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:13.280068 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9b2f7c-f4c7-4374-b36d-4419c288d7f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d324900938284ed3baa1ab6d491bbc8d)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:02:13.282000 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9b2f7c-f4c7-4374-b36d-4419c288d7f6 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:02:13.355350 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-1c9b2f7c-f4c7-4374-b36d-4419c288d7f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd324900938284ed3baa1ab6d491bbc8d'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:02:13.378660 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-1c9b2f7c-f4c7-4374-b36d-4419c288d7f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd324900938284ed3baa1ab6d491bbc8d'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:02:13.379992 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-1c9b2f7c-f4c7-4374-b36d-4419c288d7f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd324900938284ed3baa1ab6d491bbc8d'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:02:13.395167 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-1c9b2f7c-f4c7-4374-b36d-4419c288d7f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd324900938284ed3baa1ab6d491bbc8d'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:02:13.396097 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-1c9b2f7c-f4c7-4374-b36d-4419c288d7f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd324900938284ed3baa1ab6d491bbc8d'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:02:13.405054 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:13.435088 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1324/2657] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 16:02:13 2022] DELETE /identity/v3/users/d324900938284ed3baa1ab6d491bbc8d => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:02:13.564306 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c42ec-416d-4daf-a79a-412914224c99 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:02:13.565828 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-932c42ec-416d-4daf-a79a-412914224c99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:13.587498 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c42ec-416d-4daf-a79a-412914224c99 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:02:13.674904 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe6c4b8-75d8-425a-a074-6d0518bff37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:02:13.675859 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6c4b8-75d8-425a-a074-6d0518bff37c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:13.676324 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6c4b8-75d8-425a-a074-6d0518bff37c admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:13.676793 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6c4b8-75d8-425a-a074-6d0518bff37c admin admin] PATH_INFO: `/v3/users/53495fcef2f046449458f91f2933dc71` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:13.678744 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe6c4b8-75d8-425a-a074-6d0518bff37c admin admin] RBAC: Authorizing `identity:delete_user(user_id=53495fcef2f046449458f91f2933dc71)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:02:13.681571 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe6c4b8-75d8-425a-a074-6d0518bff37c admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:02:13.715599 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b2f7c-f4c7-4374-b36d-4419c288d7f6 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:02:13.717137 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-1c9b2f7c-f4c7-4374-b36d-4419c288d7f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:13.742086 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b2f7c-f4c7-4374-b36d-4419c288d7f6 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:02:13.749121 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3baef-7862-4216-af2b-a1df4b760067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:02:13.749783 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3baef-7862-4216-af2b-a1df4b760067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:13.750206 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3baef-7862-4216-af2b-a1df4b760067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:13.750645 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3baef-7862-4216-af2b-a1df4b760067 admin admin] PATH_INFO: `/v3/projects/05578ca31d5649ff8d9b21a971b6751a` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:13.752181 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec3baef-7862-4216-af2b-a1df4b760067 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05578ca31d5649ff8d9b21a971b6751a)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:02:13.754605 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec3baef-7862-4216-af2b-a1df4b760067 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:02:13.768591 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-afe6c4b8-75d8-425a-a074-6d0518bff37c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53495fcef2f046449458f91f2933dc71'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:02:13.779437 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-afe6c4b8-75d8-425a-a074-6d0518bff37c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53495fcef2f046449458f91f2933dc71'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:02:13.780394 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-afe6c4b8-75d8-425a-a074-6d0518bff37c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53495fcef2f046449458f91f2933dc71'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:02:13.802239 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-afe6c4b8-75d8-425a-a074-6d0518bff37c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53495fcef2f046449458f91f2933dc71'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:02:13.802988 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-afe6c4b8-75d8-425a-a074-6d0518bff37c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53495fcef2f046449458f91f2933dc71'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:02:13.818246 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1334/2658] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 16:02:13 2022] DELETE /identity/v3/users/53495fcef2f046449458f91f2933dc71 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:02:13.846732 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-aec3baef-7862-4216-af2b-a1df4b760067 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05578ca31d5649ff8d9b21a971b6751a', 'request_id': 'req-aec3baef-7862-4216-af2b-a1df4b760067'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:02:13.852873 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-aec3baef-7862-4216-af2b-a1df4b760067 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05578ca31d5649ff8d9b21a971b6751a', 'request_id': 'req-aec3baef-7862-4216-af2b-a1df4b760067'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:02:13.860917 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-aec3baef-7862-4216-af2b-a1df4b760067 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05578ca31d5649ff8d9b21a971b6751a', 'request_id': 'req-aec3baef-7862-4216-af2b-a1df4b760067'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:02:13.881697 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-aec3baef-7862-4216-af2b-a1df4b760067 admin admin] The token cache is being invalidate because project 05578ca31d5649ff8d9b21a971b6751a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:02:13.881941 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-aec3baef-7862-4216-af2b-a1df4b760067 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:02:13.886110 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-aec3baef-7862-4216-af2b-a1df4b760067 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:02:13.887873 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1325/2659] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 16:02:13 2022] DELETE /identity/v3/projects/05578ca31d5649ff8d9b21a971b6751a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:02:13.893221 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae7ab4-7f8a-464f-9da6-f731ad964cba None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:13.893637 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae7ab4-7f8a-464f-9da6-f731ad964cba None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:13.893919 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae7ab4-7f8a-464f-9da6-f731ad964cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:13.918102 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-06ae7ab4-7f8a-464f-9da6-f731ad964cba None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:02:13.919417 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-06ae7ab4-7f8a-464f-9da6-f731ad964cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:13.946747 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:14.028817 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1335/2660] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:02:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:02:14.054502 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3baef-7862-4216-af2b-a1df4b760067 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:02:14.056962 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-aec3baef-7862-4216-af2b-a1df4b760067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:14.104708 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4398d57-03f5-4b88-b677-5252f59648cd None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:14.105334 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4398d57-03f5-4b88-b677-5252f59648cd None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:14.105808 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4398d57-03f5-4b88-b677-5252f59648cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:14.133884 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-e4398d57-03f5-4b88-b677-5252f59648cd None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:02:14.135447 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-e4398d57-03f5-4b88-b677-5252f59648cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:14.144182 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1336/2661] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:02:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:02:14.149455 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4398d57-03f5-4b88-b677-5252f59648cd None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:02:14.165117 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4398d57-03f5-4b88-b677-5252f59648cd None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:02:14.170508 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5339072-3848-4237-9385-754e431c1bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:02:14.171349 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5339072-3848-4237-9385-754e431c1bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:14.171636 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5339072-3848-4237-9385-754e431c1bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:14.171913 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5339072-3848-4237-9385-754e431c1bf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:14.172565 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5339072-3848-4237-9385-754e431c1bf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:02:14.172869 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5339072-3848-4237-9385-754e431c1bf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:02:14.174500 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5339072-3848-4237-9385-754e431c1bf9 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:02:14.174793 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3baef-7862-4216-af2b-a1df4b760067 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:02:14.180299 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea410e2-6fb0-4e32-9b7b-13802d702c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:02:14.181393 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea410e2-6fb0-4e32-9b7b-13802d702c04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:14.181736 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea410e2-6fb0-4e32-9b7b-13802d702c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:14.182040 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea410e2-6fb0-4e32-9b7b-13802d702c04 admin admin] PATH_INFO: `/v3/projects/d3ef84e7786d446c8de6df478f2a928b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:14.183320 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea410e2-6fb0-4e32-9b7b-13802d702c04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3ef84e7786d446c8de6df478f2a928b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:02:14.185382 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea410e2-6fb0-4e32-9b7b-13802d702c04 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:02:14.193855 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1337/2662] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 16:02:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:02:14.199794 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5339072-3848-4237-9385-754e431c1bf9 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:02:14.212642 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5339072-3848-4237-9385-754e431c1bf9 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:02:14.219034 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd281d0-afad-4da0-b3c9-b73b695b6557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:02:14.221012 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd281d0-afad-4da0-b3c9-b73b695b6557 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:14.222678 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd281d0-afad-4da0-b3c9-b73b695b6557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:14.223413 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd281d0-afad-4da0-b3c9-b73b695b6557 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:14.224059 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd281d0-afad-4da0-b3c9-b73b695b6557 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:02:14.225995 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd281d0-afad-4da0-b3c9-b73b695b6557 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:02:14.249395 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-1ea410e2-6fb0-4e32-9b7b-13802d702c04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3ef84e7786d446c8de6df478f2a928b', 'request_id': 'req-1ea410e2-6fb0-4e32-9b7b-13802d702c04'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:02:14.260577 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-1ea410e2-6fb0-4e32-9b7b-13802d702c04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3ef84e7786d446c8de6df478f2a928b', 'request_id': 'req-1ea410e2-6fb0-4e32-9b7b-13802d702c04'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:02:14.262066 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1338/2663] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 16:02:14 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:02:14.266124 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd281d0-afad-4da0-b3c9-b73b695b6557 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:02:14.271042 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-1ea410e2-6fb0-4e32-9b7b-13802d702c04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3ef84e7786d446c8de6df478f2a928b', 'request_id': 'req-1ea410e2-6fb0-4e32-9b7b-13802d702c04'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:02:14.276640 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:14.302477 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-1ea410e2-6fb0-4e32-9b7b-13802d702c04 admin admin] The token cache is being invalidate because project d3ef84e7786d446c8de6df478f2a928b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:02:14.302867 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-1ea410e2-6fb0-4e32-9b7b-13802d702c04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:02:14.303844 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-1ea410e2-6fb0-4e32-9b7b-13802d702c04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:02:14.309573 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1326/2664] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 16:02:14 2022] DELETE /identity/v3/projects/d3ef84e7786d446c8de6df478f2a928b => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:02:14.311032 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea410e2-6fb0-4e32-9b7b-13802d702c04 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:02:14.315297 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-1ea410e2-6fb0-4e32-9b7b-13802d702c04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:14.373551 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd281d0-afad-4da0-b3c9-b73b695b6557 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:02:14.388282 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144b108-aaeb-4f86-8f4f-e463f8be50ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:02:14.389027 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144b108-aaeb-4f86-8f4f-e463f8be50ae admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:14.389869 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144b108-aaeb-4f86-8f4f-e463f8be50ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:14.390241 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144b108-aaeb-4f86-8f4f-e463f8be50ae admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:14.391747 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d144b108-aaeb-4f86-8f4f-e463f8be50ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:02:14.393769 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d144b108-aaeb-4f86-8f4f-e463f8be50ae admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:02:14.394885 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea410e2-6fb0-4e32-9b7b-13802d702c04 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:02:14.400814 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a5ef9c-7b54-40e0-a939-159541e3551b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:02:14.401720 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5ef9c-7b54-40e0-a939-159541e3551b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:14.404000 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5ef9c-7b54-40e0-a939-159541e3551b admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:14.404463 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5ef9c-7b54-40e0-a939-159541e3551b admin admin] PATH_INFO: `/v3/users/9599551fa1e64aac83e319c02ff20eae` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:14.408033 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a5ef9c-7b54-40e0-a939-159541e3551b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9599551fa1e64aac83e319c02ff20eae)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:02:14.412953 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a5ef9c-7b54-40e0-a939-159541e3551b admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:02:14.433314 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1339/2665] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 16:02:14 2022] POST /identity/v3/users => generated 287 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:02:14.435301 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144b108-aaeb-4f86-8f4f-e463f8be50ae admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:02:14.438027 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-d144b108-aaeb-4f86-8f4f-e463f8be50ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:14.452394 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144b108-aaeb-4f86-8f4f-e463f8be50ae admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:02:14.459133 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2bdbf6-7278-420a-b18d-b624b5070156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:02:14.460049 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2bdbf6-7278-420a-b18d-b624b5070156 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:14.460509 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2bdbf6-7278-420a-b18d-b624b5070156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:14.461754 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2bdbf6-7278-420a-b18d-b624b5070156 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:14.462828 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2bdbf6-7278-420a-b18d-b624b5070156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:02:14.464602 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2bdbf6-7278-420a-b18d-b624b5070156 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:02:14.483978 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1340/2666] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:02:14 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:02:14.487143 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2bdbf6-7278-420a-b18d-b624b5070156 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:02:14.502439 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-05a5ef9c-7b54-40e0-a939-159541e3551b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9599551fa1e64aac83e319c02ff20eae'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:02:14.506632 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2bdbf6-7278-420a-b18d-b624b5070156 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:02:14.512517 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-05a5ef9c-7b54-40e0-a939-159541e3551b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9599551fa1e64aac83e319c02ff20eae'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:02:14.513153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-05a5ef9c-7b54-40e0-a939-159541e3551b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9599551fa1e64aac83e319c02ff20eae'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:02:14.513964 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ced68-36e4-41cb-b500-431533436e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:02:14.514871 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ced68-36e4-41cb-b500-431533436e61 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:14.515160 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ced68-36e4-41cb-b500-431533436e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:14.515559 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ced68-36e4-41cb-b500-431533436e61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:14.516525 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555ced68-36e4-41cb-b500-431533436e61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:02:14.517986 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555ced68-36e4-41cb-b500-431533436e61 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:02:14.525917 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-05a5ef9c-7b54-40e0-a939-159541e3551b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9599551fa1e64aac83e319c02ff20eae'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:02:14.526890 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-05a5ef9c-7b54-40e0-a939-159541e3551b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9599551fa1e64aac83e319c02ff20eae'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:02:14.543614 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1341/2667] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:02:14 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:02:14.548264 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ced68-36e4-41cb-b500-431533436e61 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:02:14.550410 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-555ced68-36e4-41cb-b500-431533436e61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:14.563504 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1327/2668] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 16:02:14 2022] DELETE /identity/v3/users/9599551fa1e64aac83e319c02ff20eae => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:02:14.578596 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ced68-36e4-41cb-b500-431533436e61 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:02:14.662088 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:14.703481 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b995d8-740f-45fc-8fd6-47426feada30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:02:14.704844 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b995d8-740f-45fc-8fd6-47426feada30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:14.705895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b995d8-740f-45fc-8fd6-47426feada30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:14.706604 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b995d8-740f-45fc-8fd6-47426feada30 admin admin] PATH_INFO: `/v3/projects/724d220e9813474a95a94134b4d1644b/users/2f6d0f4c6d99493191e3e0a7da7e88bb/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:14.729623 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b995d8-740f-45fc-8fd6-47426feada30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=724d220e9813474a95a94134b4d1644b, user_id=2f6d0f4c6d99493191e3e0a7da7e88bb, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:02:14.733149 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b995d8-740f-45fc-8fd6-47426feada30 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:02:14.755383 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1342/2669] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 16:02:14 2022] PUT /identity/v3/projects/724d220e9813474a95a94134b4d1644b/users/2f6d0f4c6d99493191e3e0a7da7e88bb/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:02:14.761994 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b8420-f8b6-4515-93f6-b9dbced93920 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:14.762616 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b8420-f8b6-4515-93f6-b9dbced93920 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:14.762795 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b8420-f8b6-4515-93f6-b9dbced93920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:14.808770 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-b24b8420-f8b6-4515-93f6-b9dbced93920 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:02:14.810068 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b24b8420-f8b6-4515-93f6-b9dbced93920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:14.840079 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b995d8-740f-45fc-8fd6-47426feada30 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:02:14.842010 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-12b995d8-740f-45fc-8fd6-47426feada30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:14.890581 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1328/2670] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:02:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:02:14.904384 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b8420-f8b6-4515-93f6-b9dbced93920 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:02:14.905888 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b24b8420-f8b6-4515-93f6-b9dbced93920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:14.935841 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:14.941908 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b995d8-740f-45fc-8fd6-47426feada30 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:02:14.950615 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd5bc9-6ed1-4267-9448-ed49d389db1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:02:14.951270 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd5bc9-6ed1-4267-9448-ed49d389db1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:14.951555 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd5bc9-6ed1-4267-9448-ed49d389db1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:14.951831 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd5bc9-6ed1-4267-9448-ed49d389db1e admin admin] PATH_INFO: `/v3/projects/040430a3e65a433aa9398ecb8633c51d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:14.953045 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcd5bc9-6ed1-4267-9448-ed49d389db1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=040430a3e65a433aa9398ecb8633c51d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:02:14.955008 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcd5bc9-6ed1-4267-9448-ed49d389db1e admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:02:14.991962 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b8420-f8b6-4515-93f6-b9dbced93920 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:02:15.014129 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-9dcd5bc9-6ed1-4267-9448-ed49d389db1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '040430a3e65a433aa9398ecb8633c51d', 'request_id': 'req-9dcd5bc9-6ed1-4267-9448-ed49d389db1e'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:02:15.021009 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-9dcd5bc9-6ed1-4267-9448-ed49d389db1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '040430a3e65a433aa9398ecb8633c51d', 'request_id': 'req-9dcd5bc9-6ed1-4267-9448-ed49d389db1e'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:02:15.030378 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-9dcd5bc9-6ed1-4267-9448-ed49d389db1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '040430a3e65a433aa9398ecb8633c51d', 'request_id': 'req-9dcd5bc9-6ed1-4267-9448-ed49d389db1e'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:02:15.049377 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-9dcd5bc9-6ed1-4267-9448-ed49d389db1e admin admin] The token cache is being invalidate because project 040430a3e65a433aa9398ecb8633c51d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:02:15.049912 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-9dcd5bc9-6ed1-4267-9448-ed49d389db1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:02:15.050659 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-9dcd5bc9-6ed1-4267-9448-ed49d389db1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:02:15.055875 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1343/2671] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 16:02:14 2022] DELETE /identity/v3/projects/040430a3e65a433aa9398ecb8633c51d => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:02:15.057605 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4912410-aa35-4d51-8180-84c9e2bfbc14 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:15.057923 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4912410-aa35-4d51-8180-84c9e2bfbc14 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:15.058306 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4912410-aa35-4d51-8180-84c9e2bfbc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:15.063892 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7301e27-6de6-46db-b37d-c733c41b0d43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:02:15.064595 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7301e27-6de6-46db-b37d-c733c41b0d43 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:15.065124 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7301e27-6de6-46db-b37d-c733c41b0d43 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:15.065634 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7301e27-6de6-46db-b37d-c733c41b0d43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:15.068802 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b7301e27-6de6-46db-b37d-c733c41b0d43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:15.081432 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-c4912410-aa35-4d51-8180-84c9e2bfbc14 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:02:15.082690 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-c4912410-aa35-4d51-8180-84c9e2bfbc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:15.139095 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:15.151384 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7301e27-6de6-46db-b37d-c733c41b0d43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:02:15.153328 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7301e27-6de6-46db-b37d-c733c41b0d43 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:02:15.155298 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1344/2672] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:02:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:02:15.163671 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b30076-275e-451e-8a19-a4a56efbad2b None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:15.163955 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b30076-275e-451e-8a19-a4a56efbad2b None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:15.164276 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b30076-275e-451e-8a19-a4a56efbad2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:15.165055 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1329/2673] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:02:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:02:15.185922 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-f3b30076-275e-451e-8a19-a4a56efbad2b None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:02:15.187190 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-f3b30076-275e-451e-8a19-a4a56efbad2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:15.199200 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1345/2674] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:02:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:02:15.205762 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7301e27-6de6-46db-b37d-c733c41b0d43 service neutron] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:02:15.219820 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7301e27-6de6-46db-b37d-c733c41b0d43 service neutron] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:02:15.224779 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1760838d-12a7-4b23-a72b-ea6725e41f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:02:15.225664 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760838d-12a7-4b23-a72b-ea6725e41f16 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:15.225664 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760838d-12a7-4b23-a72b-ea6725e41f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:15.225936 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760838d-12a7-4b23-a72b-ea6725e41f16 admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:15.226645 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1760838d-12a7-4b23-a72b-ea6725e41f16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:02:15.227002 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1760838d-12a7-4b23-a72b-ea6725e41f16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:02:15.229024 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1760838d-12a7-4b23-a72b-ea6725e41f16 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:02:15.241838 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1330/2675] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 16:02:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:02:15.247288 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b30076-275e-451e-8a19-a4a56efbad2b None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:02:15.259745 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b30076-275e-451e-8a19-a4a56efbad2b None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:02:15.265970 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561861f1-173e-4011-b205-6231f13f9792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:02:15.266647 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561861f1-173e-4011-b205-6231f13f9792 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:15.266925 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561861f1-173e-4011-b205-6231f13f9792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:15.267200 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561861f1-173e-4011-b205-6231f13f9792 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:15.267936 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561861f1-173e-4011-b205-6231f13f9792 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:02:15.270171 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561861f1-173e-4011-b205-6231f13f9792 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:02:15.301703 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1346/2676] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 16:02:15 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:02:15.307097 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1760838d-12a7-4b23-a72b-ea6725e41f16 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:02:15.319927 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1760838d-12a7-4b23-a72b-ea6725e41f16 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:02:15.395045 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c9b0a7-4f6a-436e-8a2d-b3d76b93eef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:02:15.395666 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9b0a7-4f6a-436e-8a2d-b3d76b93eef2 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:15.395950 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9b0a7-4f6a-436e-8a2d-b3d76b93eef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:15.396225 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9b0a7-4f6a-436e-8a2d-b3d76b93eef2 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:15.396861 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c9b0a7-4f6a-436e-8a2d-b3d76b93eef2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:02:15.399453 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c9b0a7-4f6a-436e-8a2d-b3d76b93eef2 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:02:15.417401 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:15.428132 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1331/2677] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 16:02:15 2022] POST /identity/v3/users => generated 287 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:02:15.429428 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561861f1-173e-4011-b205-6231f13f9792 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:02:15.441257 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561861f1-173e-4011-b205-6231f13f9792 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:02:15.446426 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c088b0-5151-4c21-9845-0fbd39b363f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:02:15.447044 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c088b0-5151-4c21-9845-0fbd39b363f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:15.447328 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c088b0-5151-4c21-9845-0fbd39b363f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:15.447604 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c088b0-5151-4c21-9845-0fbd39b363f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:15.448247 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c088b0-5151-4c21-9845-0fbd39b363f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:02:15.449851 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c088b0-5151-4c21-9845-0fbd39b363f4 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:02:15.463857 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1347/2678] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:02:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:02:15.466244 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c9b0a7-4f6a-436e-8a2d-b3d76b93eef2 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:02:15.477440 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c9b0a7-4f6a-436e-8a2d-b3d76b93eef2 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:02:15.482725 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63194465-8c8c-4d58-99b6-e770019dc517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:02:15.483429 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63194465-8c8c-4d58-99b6-e770019dc517 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:15.483717 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63194465-8c8c-4d58-99b6-e770019dc517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:15.483993 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63194465-8c8c-4d58-99b6-e770019dc517 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:15.484633 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63194465-8c8c-4d58-99b6-e770019dc517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:02:15.486406 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63194465-8c8c-4d58-99b6-e770019dc517 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:02:15.499933 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1332/2679] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:02:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:02:15.506650 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c088b0-5151-4c21-9845-0fbd39b363f4 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:02:15.520354 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c088b0-5151-4c21-9845-0fbd39b363f4 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:02:15.528747 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f0418-aeec-4415-9453-abc718ef9348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:02:15.529619 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f0418-aeec-4415-9453-abc718ef9348 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:15.529822 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f0418-aeec-4415-9453-abc718ef9348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:15.530100 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f0418-aeec-4415-9453-abc718ef9348 admin admin] PATH_INFO: `/v3/projects/49e02d0dd4a2445fa20d11b454bd50d6/users/4ca75aa7ae6443e3a8a9a52b80181ade/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:15.547524 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f0418-aeec-4415-9453-abc718ef9348 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49e02d0dd4a2445fa20d11b454bd50d6, user_id=4ca75aa7ae6443e3a8a9a52b80181ade, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:02:15.550711 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f0418-aeec-4415-9453-abc718ef9348 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:02:15.565924 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1348/2680] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 16:02:15 2022] PUT /identity/v3/projects/49e02d0dd4a2445fa20d11b454bd50d6/users/4ca75aa7ae6443e3a8a9a52b80181ade/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:02:15.572504 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329cd8d-8475-47bd-b893-d93000616c74 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:15.572748 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329cd8d-8475-47bd-b893-d93000616c74 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:15.573000 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329cd8d-8475-47bd-b893-d93000616c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:15.594574 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-0329cd8d-8475-47bd-b893-d93000616c74 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:02:15.596065 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-0329cd8d-8475-47bd-b893-d93000616c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:15.663313 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1333/2681] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:02:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:02:15.682060 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f0418-aeec-4415-9453-abc718ef9348 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:02:15.684066 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-e12f0418-aeec-4415-9453-abc718ef9348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:15.752634 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f0418-aeec-4415-9453-abc718ef9348 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:02:15.756908 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d54ee-c4de-401c-84bc-af26b2645a26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:02:15.759475 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d54ee-c4de-401c-84bc-af26b2645a26 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:15.759475 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d54ee-c4de-401c-84bc-af26b2645a26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:15.759475 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d54ee-c4de-401c-84bc-af26b2645a26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:15.769825 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d54ee-c4de-401c-84bc-af26b2645a26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:02:15.771364 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d54ee-c4de-401c-84bc-af26b2645a26 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:02:15.784964 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1349/2682] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:02:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:02:16.963740 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255ea98-6101-4605-89d0-5acc1379af66 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:16.964289 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255ea98-6101-4605-89d0-5acc1379af66 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:16.964418 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255ea98-6101-4605-89d0-5acc1379af66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:16.996772 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-3255ea98-6101-4605-89d0-5acc1379af66 None None] MFA Rules not processed for user `4ca75aa7ae6443e3a8a9a52b80181ade`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:02:16.998028 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-3255ea98-6101-4605-89d0-5acc1379af66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:17.110636 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1334/2683] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:02:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:02:17.121732 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d54ee-c4de-401c-84bc-af26b2645a26 service neutron] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:02:17.123917 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-e86d54ee-c4de-401c-84bc-af26b2645a26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:17.193328 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d54ee-c4de-401c-84bc-af26b2645a26 service neutron] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:02:17.199576 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf74a3-ab6e-42d5-bf13-93dda6bd8481 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:02:17.200220 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf74a3-ab6e-42d5-bf13-93dda6bd8481 service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:17.201177 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf74a3-ab6e-42d5-bf13-93dda6bd8481 service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:17.201469 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf74a3-ab6e-42d5-bf13-93dda6bd8481 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:17.213707 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cf74a3-ab6e-42d5-bf13-93dda6bd8481 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:02:17.215592 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cf74a3-ab6e-42d5-bf13-93dda6bd8481 service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:02:17.228488 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1350/2684] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:02:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:02:18.786899 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9056191-c457-4874-85b0-2ad31c831a80 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:18.787370 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9056191-c457-4874-85b0-2ad31c831a80 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:18.787486 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9056191-c457-4874-85b0-2ad31c831a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:18.809189 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-e9056191-c457-4874-85b0-2ad31c831a80 None None] MFA Rules not processed for user `4ca75aa7ae6443e3a8a9a52b80181ade`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:02:18.810778 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-e9056191-c457-4874-85b0-2ad31c831a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:18.824478 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1335/2685] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:02:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:02:20.213332 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3ed5c-f1dc-40b2-92be-5fb29289ee5f None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:20.214598 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3ed5c-f1dc-40b2-92be-5fb29289ee5f None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:20.214945 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3ed5c-f1dc-40b2-92be-5fb29289ee5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:20.254460 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-5ba3ed5c-f1dc-40b2-92be-5fb29289ee5f None None] MFA Rules not processed for user `2f6d0f4c6d99493191e3e0a7da7e88bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:02:20.255790 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-5ba3ed5c-f1dc-40b2-92be-5fb29289ee5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:20.294419 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:20.356945 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1351/2686] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:02:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:02:20.360939 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9056191-c457-4874-85b0-2ad31c831a80 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:02:20.364620 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-e9056191-c457-4874-85b0-2ad31c831a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:20.380028 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9056191-c457-4874-85b0-2ad31c831a80 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:02:20.387655 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c271d6d-4320-40d5-9969-c315a0115810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:02:20.388436 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c271d6d-4320-40d5-9969-c315a0115810 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:20.389079 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c271d6d-4320-40d5-9969-c315a0115810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:20.389528 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c271d6d-4320-40d5-9969-c315a0115810 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:20.390461 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c271d6d-4320-40d5-9969-c315a0115810 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:02:20.392989 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c271d6d-4320-40d5-9969-c315a0115810 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:02:20.451892 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1336/2687] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 16:02:20 2022] POST /identity/v3/projects => generated 373 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:02:20.456134 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3ed5c-f1dc-40b2-92be-5fb29289ee5f None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:02:20.469002 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3ed5c-f1dc-40b2-92be-5fb29289ee5f None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:02:20.552352 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59303d7f-e2b9-4392-9e3c-2368349a1cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:02:20.553285 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59303d7f-e2b9-4392-9e3c-2368349a1cc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:20.553572 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59303d7f-e2b9-4392-9e3c-2368349a1cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:20.553851 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59303d7f-e2b9-4392-9e3c-2368349a1cc3 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:20.554596 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59303d7f-e2b9-4392-9e3c-2368349a1cc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:02:20.557532 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59303d7f-e2b9-4392-9e3c-2368349a1cc3 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:02:20.595955 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1352/2688] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 16:02:20 2022] POST /identity/v3/users => generated 293 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:02:20.599759 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c271d6d-4320-40d5-9969-c315a0115810 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:02:20.614531 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c271d6d-4320-40d5-9969-c315a0115810 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:02:20.620719 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238db167-4fa0-4859-9b46-91b537131206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:02:20.621587 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238db167-4fa0-4859-9b46-91b537131206 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:20.622044 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238db167-4fa0-4859-9b46-91b537131206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:20.622557 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238db167-4fa0-4859-9b46-91b537131206 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:20.623495 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238db167-4fa0-4859-9b46-91b537131206 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:02:20.625410 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238db167-4fa0-4859-9b46-91b537131206 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:02:20.662214 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1337/2689] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:02:20.665554 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59303d7f-e2b9-4392-9e3c-2368349a1cc3 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:02:20.687866 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59303d7f-e2b9-4392-9e3c-2368349a1cc3 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:02:20.705600 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa4a52-5df2-4738-a400-bf05b6ad7cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:02:20.706400 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa4a52-5df2-4738-a400-bf05b6ad7cd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:20.706758 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa4a52-5df2-4738-a400-bf05b6ad7cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:20.707264 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa4a52-5df2-4738-a400-bf05b6ad7cd5 admin admin] PATH_INFO: `/v3/projects/00502c98c90940c781534f6ac1a9a891/users/ba9f12d80ee44d0da623dc9f81dd2afe/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:20.744133 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa4a52-5df2-4738-a400-bf05b6ad7cd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00502c98c90940c781534f6ac1a9a891, user_id=ba9f12d80ee44d0da623dc9f81dd2afe, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:02:20.746947 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa4a52-5df2-4738-a400-bf05b6ad7cd5 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:02:20.779414 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1353/2690] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 16:02:20 2022] PUT /identity/v3/projects/00502c98c90940c781534f6ac1a9a891/users/ba9f12d80ee44d0da623dc9f81dd2afe/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:02:20.783405 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238db167-4fa0-4859-9b46-91b537131206 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:02:20.794118 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238db167-4fa0-4859-9b46-91b537131206 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:02:20.829554 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:20.859860 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551d01d-0781-43cc-b8f1-7914dd6d58c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:02:20.860485 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551d01d-0781-43cc-b8f1-7914dd6d58c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:20.860764 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551d01d-0781-43cc-b8f1-7914dd6d58c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:20.861080 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551d01d-0781-43cc-b8f1-7914dd6d58c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:20.861725 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f551d01d-0781-43cc-b8f1-7914dd6d58c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:02:20.863610 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f551d01d-0781-43cc-b8f1-7914dd6d58c9 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:02:20.874829 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1338/2691] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:02:20.879064 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa4a52-5df2-4738-a400-bf05b6ad7cd5 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:02:20.889367 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa4a52-5df2-4738-a400-bf05b6ad7cd5 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:02:20.893935 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1329a4b-c2e3-464e-9125-5a967d7dd7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:02:20.894603 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1329a4b-c2e3-464e-9125-5a967d7dd7a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:20.894880 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1329a4b-c2e3-464e-9125-5a967d7dd7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:20.895147 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1329a4b-c2e3-464e-9125-5a967d7dd7a7 admin admin] PATH_INFO: `/v3/projects/00502c98c90940c781534f6ac1a9a891/users/ba9f12d80ee44d0da623dc9f81dd2afe/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:20.897046 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1329a4b-c2e3-464e-9125-5a967d7dd7a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00502c98c90940c781534f6ac1a9a891, user_id=ba9f12d80ee44d0da623dc9f81dd2afe, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:02:20.899736 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1329a4b-c2e3-464e-9125-5a967d7dd7a7 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:02:20.909655 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1354/2692] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 16:02:20 2022] PUT /identity/v3/projects/00502c98c90940c781534f6ac1a9a891/users/ba9f12d80ee44d0da623dc9f81dd2afe/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:02:22.315572 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ee970-80ab-4cfd-a6c4-e0dfcd73339b None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:22.316115 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ee970-80ab-4cfd-a6c4-e0dfcd73339b None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:22.316115 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ee970-80ab-4cfd-a6c4-e0dfcd73339b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:22.360904 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-7d5ee970-80ab-4cfd-a6c4-e0dfcd73339b None None] MFA Rules not processed for user `3e20e40a37df4898bfe692535e5e4f25`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:02:22.362938 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-7d5ee970-80ab-4cfd-a6c4-e0dfcd73339b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:22.465247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1339/2693] 10.222.0.16 () {58 vars in 967 bytes} [Wed Sep 7 16:02:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:02:22.487342 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1329a4b-c2e3-464e-9125-5a967d7dd7a7 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:02:22.491060 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-c1329a4b-c2e3-464e-9125-5a967d7dd7a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:22.609635 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1329a4b-c2e3-464e-9125-5a967d7dd7a7 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:02:22.618679 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21c1d0-414c-4eaf-b1c3-3c3cbe6e03c6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16c4b090a4aa4d56a90ccf090b9caba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:02:22.619461 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21c1d0-414c-4eaf-b1c3-3c3cbe6e03c6 service swift] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:22.619988 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21c1d0-414c-4eaf-b1c3-3c3cbe6e03c6 service swift] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:22.620429 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21c1d0-414c-4eaf-b1c3-3c3cbe6e03c6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:22.644615 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c21c1d0-414c-4eaf-b1c3-3c3cbe6e03c6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:02:22.646577 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c21c1d0-414c-4eaf-b1c3-3c3cbe6e03c6 service swift] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:02:22.662395 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1355/2694] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Sep 7 16:02:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 16:02:24.194578 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ee970-80ab-4cfd-a6c4-e0dfcd73339b None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:02:24.197358 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-7d5ee970-80ab-4cfd-a6c4-e0dfcd73339b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:24.353382 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ee970-80ab-4cfd-a6c4-e0dfcd73339b None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:02:24.360283 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82d7fe-d76e-4329-bf4e-5514ad5ff8e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:02:24.361251 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82d7fe-d76e-4329-bf4e-5514ad5ff8e0 service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:24.361674 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82d7fe-d76e-4329-bf4e-5514ad5ff8e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:24.362007 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82d7fe-d76e-4329-bf4e-5514ad5ff8e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:24.363964 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-0c82d7fe-d76e-4329-bf4e-5514ad5ff8e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:24.499677 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c82d7fe-d76e-4329-bf4e-5514ad5ff8e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:02:24.501406 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c82d7fe-d76e-4329-bf4e-5514ad5ff8e0 service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:02:24.518411 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1340/2695] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:02:24 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:02:27.339539 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b666d-b1ad-4896-8c2e-adbba4f74db5 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:27.340416 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b666d-b1ad-4896-8c2e-adbba4f74db5 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:27.340854 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b666d-b1ad-4896-8c2e-adbba4f74db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:27.363026 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:27.373426 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-cf5b666d-b1ad-4896-8c2e-adbba4f74db5 None None] MFA Rules not processed for user `ba9f12d80ee44d0da623dc9f81dd2afe`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:02:27.374678 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-cf5b666d-b1ad-4896-8c2e-adbba4f74db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:27.441813 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1356/2696] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:02:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:02:27.455512 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82d7fe-d76e-4329-bf4e-5514ad5ff8e0 service nova] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:02:27.468291 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82d7fe-d76e-4329-bf4e-5514ad5ff8e0 service nova] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:02:27.473953 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b0738-5a03-4377-b7e0-53d5216f3acf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:02:27.474710 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b0738-5a03-4377-b7e0-53d5216f3acf service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:27.474998 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b0738-5a03-4377-b7e0-53d5216f3acf service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:27.475280 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b0738-5a03-4377-b7e0-53d5216f3acf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:27.489925 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:27.541064 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031b0738-5a03-4377-b7e0-53d5216f3acf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:02:27.542625 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031b0738-5a03-4377-b7e0-53d5216f3acf service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:02:27.551653 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1341/2697] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:02:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:02:28.589608 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37876218-0a6e-485b-b065-53c1e996241a None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:28.590141 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37876218-0a6e-485b-b065-53c1e996241a None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:28.590296 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37876218-0a6e-485b-b065-53c1e996241a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:28.610832 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-37876218-0a6e-485b-b065-53c1e996241a None None] MFA Rules not processed for user `2f6d0f4c6d99493191e3e0a7da7e88bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:02:28.612073 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-37876218-0a6e-485b-b065-53c1e996241a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:28.619346 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1357/2698] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:02:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:02:35.033294 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca9400-2d39-431b-97ea-343b5b6e36ca None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:35.033773 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca9400-2d39-431b-97ea-343b5b6e36ca None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:35.033890 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca9400-2d39-431b-97ea-343b5b6e36ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:35.056145 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-8fca9400-2d39-431b-97ea-343b5b6e36ca None None] MFA Rules not processed for user `4ca75aa7ae6443e3a8a9a52b80181ade`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:02:35.057382 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-8fca9400-2d39-431b-97ea-343b5b6e36ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:35.113766 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1342/2699] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:02:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:02:38.605209 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=33 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:39.816178 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e1d1d-42f8-4f31-91d8-7430bfafa267 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:39.816787 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e1d1d-42f8-4f31-91d8-7430bfafa267 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:39.816787 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e1d1d-42f8-4f31-91d8-7430bfafa267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:39.837277 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-0b8e1d1d-42f8-4f31-91d8-7430bfafa267 None None] MFA Rules not processed for user `f8cff93bade24d5581dcbbe90a7bf647`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:02:39.838578 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-0b8e1d1d-42f8-4f31-91d8-7430bfafa267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:39.900726 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1358/2700] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:02:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:02:45.107141 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=46 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:49.893428 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=25 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:02:54.359928 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be93d2-13f5-4132-b301-c194e3e72453 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:54.360470 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be93d2-13f5-4132-b301-c194e3e72453 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:54.360470 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be93d2-13f5-4132-b301-c194e3e72453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:54.381271 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-66be93d2-13f5-4132-b301-c194e3e72453 None None] MFA Rules not processed for user `3e20e40a37df4898bfe692535e5e4f25`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:02:54.382879 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-66be93d2-13f5-4132-b301-c194e3e72453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:54.392531 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1343/2701] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Sep 7 16:02:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:02:54.415451 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e1d1d-42f8-4f31-91d8-7430bfafa267 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:02:54.428410 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e1d1d-42f8-4f31-91d8-7430bfafa267 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:02:54.433762 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a181d19-f664-4920-9f95-2eca2ec0ae01 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16c4b090a4aa4d56a90ccf090b9caba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:02:54.434616 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a181d19-f664-4920-9f95-2eca2ec0ae01 service swift] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:54.435229 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a181d19-f664-4920-9f95-2eca2ec0ae01 service swift] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:54.435625 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a181d19-f664-4920-9f95-2eca2ec0ae01 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:54.444478 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a181d19-f664-4920-9f95-2eca2ec0ae01 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:02:54.446071 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a181d19-f664-4920-9f95-2eca2ec0ae01 service swift] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:02:54.459035 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1359/2702] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Sep 7 16:02:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 07 16:02:55.545673 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be93d2-13f5-4132-b301-c194e3e72453 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:02:55.548334 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-66be93d2-13f5-4132-b301-c194e3e72453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:02:55.618642 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be93d2-13f5-4132-b301-c194e3e72453 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:02:55.622456 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79ac5c-4601-4720-8493-39e39ae19870 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:02:55.623325 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79ac5c-4601-4720-8493-39e39ae19870 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:02:55.623782 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79ac5c-4601-4720-8493-39e39ae19870 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:02:55.624230 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79ac5c-4601-4720-8493-39e39ae19870 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:02:55.634539 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79ac5c-4601-4720-8493-39e39ae19870 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:02:55.636132 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79ac5c-4601-4720-8493-39e39ae19870 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:02:55.648078 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1344/2703] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:02:55 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:03:04.454991 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=6 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:05.642973 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=29 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:10.580557 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a181d19-f664-4920-9f95-2eca2ec0ae01 service swift] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:10.591213 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a181d19-f664-4920-9f95-2eca2ec0ae01 service swift] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:10.594801 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875954c-f5a5-4874-baa4-c454fd427d48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:10.595425 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875954c-f5a5-4874-baa4-c454fd427d48 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:10.595702 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875954c-f5a5-4874-baa4-c454fd427d48 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:10.595971 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875954c-f5a5-4874-baa4-c454fd427d48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:10.597725 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-3875954c-f5a5-4874-baa4-c454fd427d48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:10.661083 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3875954c-f5a5-4874-baa4-c454fd427d48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:10.662644 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3875954c-f5a5-4874-baa4-c454fd427d48 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:10.672430 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1360/2704] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:03:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:03:11.177309 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a391a-2115-43ce-bcc4-a89c4467340c None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:11.177812 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a391a-2115-43ce-bcc4-a89c4467340c None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:11.177939 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a391a-2115-43ce-bcc4-a89c4467340c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:11.198529 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-a76a391a-2115-43ce-bcc4-a89c4467340c None None] MFA Rules not processed for user `3e20e40a37df4898bfe692535e5e4f25`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:03:11.199754 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-a76a391a-2115-43ce-bcc4-a89c4467340c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:11.207163 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1345/2705] 10.222.0.16 () {58 vars in 967 bytes} [Wed Sep 7 16:03:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:03:11.219891 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875954c-f5a5-4874-baa4-c454fd427d48 service neutron] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:11.232149 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875954c-f5a5-4874-baa4-c454fd427d48 service neutron] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:11.237243 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ace18-c31a-4e2d-8de8-3fce64d900cf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16c4b090a4aa4d56a90ccf090b9caba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:11.237786 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ace18-c31a-4e2d-8de8-3fce64d900cf service swift] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:11.238064 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ace18-c31a-4e2d-8de8-3fce64d900cf service swift] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:11.238370 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ace18-c31a-4e2d-8de8-3fce64d900cf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:11.247545 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39ace18-c31a-4e2d-8de8-3fce64d900cf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:11.249169 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39ace18-c31a-4e2d-8de8-3fce64d900cf service swift] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:11.257863 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1361/2706] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Sep 7 16:03:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 16:03:13.251333 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a391a-2115-43ce-bcc4-a89c4467340c None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:13.269290 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a391a-2115-43ce-bcc4-a89c4467340c None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:13.274412 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d83c5dd-3339-482e-a0f3-ea1af7235614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:13.275052 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83c5dd-3339-482e-a0f3-ea1af7235614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:13.275511 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83c5dd-3339-482e-a0f3-ea1af7235614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:13.276179 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83c5dd-3339-482e-a0f3-ea1af7235614 admin admin] PATH_INFO: `/v3/users/4ca75aa7ae6443e3a8a9a52b80181ade` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:13.278335 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d83c5dd-3339-482e-a0f3-ea1af7235614 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ca75aa7ae6443e3a8a9a52b80181ade)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:13.280551 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d83c5dd-3339-482e-a0f3-ea1af7235614 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:13.343886 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-2d83c5dd-3339-482e-a0f3-ea1af7235614 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ca75aa7ae6443e3a8a9a52b80181ade'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:13.353486 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-2d83c5dd-3339-482e-a0f3-ea1af7235614 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ca75aa7ae6443e3a8a9a52b80181ade'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:13.354497 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-2d83c5dd-3339-482e-a0f3-ea1af7235614 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ca75aa7ae6443e3a8a9a52b80181ade'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:13.366149 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-2d83c5dd-3339-482e-a0f3-ea1af7235614 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ca75aa7ae6443e3a8a9a52b80181ade'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:13.369488 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-2d83c5dd-3339-482e-a0f3-ea1af7235614 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ca75aa7ae6443e3a8a9a52b80181ade'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:13.396132 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1346/2707] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 16:03:13 2022] DELETE /identity/v3/users/4ca75aa7ae6443e3a8a9a52b80181ade => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:03:13.592067 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ace18-c31a-4e2d-8de8-3fce64d900cf service swift] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:13.606723 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ace18-c31a-4e2d-8de8-3fce64d900cf service swift] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:13.687198 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d958213-4df1-4f48-a60b-dba5dc9fa452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:13.687701 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d958213-4df1-4f48-a60b-dba5dc9fa452 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:13.688132 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d958213-4df1-4f48-a60b-dba5dc9fa452 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:13.688418 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d958213-4df1-4f48-a60b-dba5dc9fa452 admin admin] PATH_INFO: `/v3/projects/49e02d0dd4a2445fa20d11b454bd50d6` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:13.689841 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d958213-4df1-4f48-a60b-dba5dc9fa452 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49e02d0dd4a2445fa20d11b454bd50d6)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:13.691904 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d958213-4df1-4f48-a60b-dba5dc9fa452 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:13.753163 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-0d958213-4df1-4f48-a60b-dba5dc9fa452 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49e02d0dd4a2445fa20d11b454bd50d6', 'request_id': 'req-0d958213-4df1-4f48-a60b-dba5dc9fa452'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:13.760132 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-0d958213-4df1-4f48-a60b-dba5dc9fa452 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49e02d0dd4a2445fa20d11b454bd50d6', 'request_id': 'req-0d958213-4df1-4f48-a60b-dba5dc9fa452'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:13.766723 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-0d958213-4df1-4f48-a60b-dba5dc9fa452 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49e02d0dd4a2445fa20d11b454bd50d6', 'request_id': 'req-0d958213-4df1-4f48-a60b-dba5dc9fa452'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:13.779273 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-0d958213-4df1-4f48-a60b-dba5dc9fa452 admin admin] The token cache is being invalidate because project 49e02d0dd4a2445fa20d11b454bd50d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:03:13.779557 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-0d958213-4df1-4f48-a60b-dba5dc9fa452 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:13.780177 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-0d958213-4df1-4f48-a60b-dba5dc9fa452 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:13.781649 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1362/2708] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 16:03:13 2022] DELETE /identity/v3/projects/49e02d0dd4a2445fa20d11b454bd50d6 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:03:14.716185 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d83c5dd-3339-482e-a0f3-ea1af7235614 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:14.717712 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-2d83c5dd-3339-482e-a0f3-ea1af7235614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:14.731730 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d83c5dd-3339-482e-a0f3-ea1af7235614 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:14.787740 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0188c0-db24-4fe7-b3e3-263c41628c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:14.788381 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0188c0-db24-4fe7-b3e3-263c41628c11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:14.788658 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0188c0-db24-4fe7-b3e3-263c41628c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:14.788928 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0188c0-db24-4fe7-b3e3-263c41628c11 admin admin] PATH_INFO: `/v3/users/a9236158d121445a9a53bce23616cc80` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:14.790058 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0188c0-db24-4fe7-b3e3-263c41628c11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9236158d121445a9a53bce23616cc80)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:14.792012 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0188c0-db24-4fe7-b3e3-263c41628c11 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:14.836051 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-9d0188c0-db24-4fe7-b3e3-263c41628c11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9236158d121445a9a53bce23616cc80'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:14.843250 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-9d0188c0-db24-4fe7-b3e3-263c41628c11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9236158d121445a9a53bce23616cc80'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:14.843860 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-9d0188c0-db24-4fe7-b3e3-263c41628c11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9236158d121445a9a53bce23616cc80'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:14.851268 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-9d0188c0-db24-4fe7-b3e3-263c41628c11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9236158d121445a9a53bce23616cc80'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:14.851892 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-9d0188c0-db24-4fe7-b3e3-263c41628c11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9236158d121445a9a53bce23616cc80'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:14.856260 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:14.872140 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1347/2709] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 16:03:14 2022] DELETE /identity/v3/users/a9236158d121445a9a53bce23616cc80 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:03:15.042897 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d958213-4df1-4f48-a60b-dba5dc9fa452 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:15.044940 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-0d958213-4df1-4f48-a60b-dba5dc9fa452 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:15.058488 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d958213-4df1-4f48-a60b-dba5dc9fa452 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:15.067171 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:15.117961 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106aeff9-70a0-4054-89ff-e888d319051b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:15.118619 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106aeff9-70a0-4054-89ff-e888d319051b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:15.118894 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106aeff9-70a0-4054-89ff-e888d319051b admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:15.119163 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106aeff9-70a0-4054-89ff-e888d319051b admin admin] PATH_INFO: `/v3/projects/30ec200de0b6435d8bf1e94fd5d1c977` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:15.120262 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106aeff9-70a0-4054-89ff-e888d319051b admin admin] RBAC: Authorizing `identity:delete_project(project_id=30ec200de0b6435d8bf1e94fd5d1c977)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:15.122148 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106aeff9-70a0-4054-89ff-e888d319051b admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:15.166574 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-106aeff9-70a0-4054-89ff-e888d319051b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30ec200de0b6435d8bf1e94fd5d1c977', 'request_id': 'req-106aeff9-70a0-4054-89ff-e888d319051b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:15.171904 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-106aeff9-70a0-4054-89ff-e888d319051b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30ec200de0b6435d8bf1e94fd5d1c977', 'request_id': 'req-106aeff9-70a0-4054-89ff-e888d319051b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:15.178559 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-106aeff9-70a0-4054-89ff-e888d319051b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30ec200de0b6435d8bf1e94fd5d1c977', 'request_id': 'req-106aeff9-70a0-4054-89ff-e888d319051b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:15.190525 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-106aeff9-70a0-4054-89ff-e888d319051b admin admin] The token cache is being invalidate because project 30ec200de0b6435d8bf1e94fd5d1c977 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:03:15.190812 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-106aeff9-70a0-4054-89ff-e888d319051b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:15.191502 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-106aeff9-70a0-4054-89ff-e888d319051b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:15.192993 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1363/2710] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 16:03:15 2022] DELETE /identity/v3/projects/30ec200de0b6435d8bf1e94fd5d1c977 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:03:15.199144 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73e8d8-d0ae-4b4e-8d91-ccbc13d57ad3 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:15.199425 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73e8d8-d0ae-4b4e-8d91-ccbc13d57ad3 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:15.199693 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73e8d8-d0ae-4b4e-8d91-ccbc13d57ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:15.219954 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-de73e8d8-d0ae-4b4e-8d91-ccbc13d57ad3 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:03:15.221077 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-de73e8d8-d0ae-4b4e-8d91-ccbc13d57ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:15.281806 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1348/2711] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:03:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:03:15.289727 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c99ae-9100-47eb-91ec-09e4ed21c5c8 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:15.290009 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c99ae-9100-47eb-91ec-09e4ed21c5c8 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:15.290317 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c99ae-9100-47eb-91ec-09e4ed21c5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:15.310586 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-d92c99ae-9100-47eb-91ec-09e4ed21c5c8 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:03:15.311798 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-d92c99ae-9100-47eb-91ec-09e4ed21c5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:15.321222 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1364/2712] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:03:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:03:15.325398 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73e8d8-d0ae-4b4e-8d91-ccbc13d57ad3 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:15.335153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73e8d8-d0ae-4b4e-8d91-ccbc13d57ad3 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:15.339699 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230a11f-d106-46eb-85ff-3ccae9a13c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:15.340286 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230a11f-d106-46eb-85ff-3ccae9a13c16 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:15.340564 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230a11f-d106-46eb-85ff-3ccae9a13c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:15.340834 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230a11f-d106-46eb-85ff-3ccae9a13c16 admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:15.341468 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d230a11f-d106-46eb-85ff-3ccae9a13c16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:03:15.341765 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d230a11f-d106-46eb-85ff-3ccae9a13c16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:15.343369 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d230a11f-d106-46eb-85ff-3ccae9a13c16 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:15.355183 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1349/2713] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 16:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:03:15.359759 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c99ae-9100-47eb-91ec-09e4ed21c5c8 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:15.369617 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c99ae-9100-47eb-91ec-09e4ed21c5c8 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:15.374308 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc659a8-1695-4126-8231-6264348eeb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:15.374902 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc659a8-1695-4126-8231-6264348eeb17 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:15.375182 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc659a8-1695-4126-8231-6264348eeb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:15.375456 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc659a8-1695-4126-8231-6264348eeb17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:15.376073 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc659a8-1695-4126-8231-6264348eeb17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:15.378003 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc659a8-1695-4126-8231-6264348eeb17 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:15.405160 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1365/2714] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 16:03:15 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:03:15.409450 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230a11f-d106-46eb-85ff-3ccae9a13c16 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:15.419657 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230a11f-d106-46eb-85ff-3ccae9a13c16 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:15.476747 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb260e4-03e5-4a5d-979d-efce29a3db91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:15.477290 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb260e4-03e5-4a5d-979d-efce29a3db91 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:15.477577 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb260e4-03e5-4a5d-979d-efce29a3db91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:15.477849 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb260e4-03e5-4a5d-979d-efce29a3db91 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:15.478511 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb260e4-03e5-4a5d-979d-efce29a3db91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:15.480442 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb260e4-03e5-4a5d-979d-efce29a3db91 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:15.501907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1350/2715] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 16:03:15 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:03:15.506856 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc659a8-1695-4126-8231-6264348eeb17 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:15.517153 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc659a8-1695-4126-8231-6264348eeb17 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:15.521899 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b63f024-d27c-4261-815f-1ca380a27351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:15.522521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63f024-d27c-4261-815f-1ca380a27351 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:15.522797 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63f024-d27c-4261-815f-1ca380a27351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:15.523066 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63f024-d27c-4261-815f-1ca380a27351 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:15.523694 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b63f024-d27c-4261-815f-1ca380a27351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:15.525262 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b63f024-d27c-4261-815f-1ca380a27351 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:15.535143 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1366/2716] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:03:15.539886 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb260e4-03e5-4a5d-979d-efce29a3db91 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:15.550599 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb260e4-03e5-4a5d-979d-efce29a3db91 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:15.556082 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca3210-8588-427f-81e4-13cc16d826ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:15.556694 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca3210-8588-427f-81e4-13cc16d826ba admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:15.556982 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca3210-8588-427f-81e4-13cc16d826ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:15.557254 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca3210-8588-427f-81e4-13cc16d826ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:15.557892 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca3210-8588-427f-81e4-13cc16d826ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:15.559560 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca3210-8588-427f-81e4-13cc16d826ba admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:15.571024 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1351/2717] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:03:15.575208 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b63f024-d27c-4261-815f-1ca380a27351 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:15.585834 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b63f024-d27c-4261-815f-1ca380a27351 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:15.590956 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd4f40-17cb-43f9-8b46-af4fb0537da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:15.591622 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd4f40-17cb-43f9-8b46-af4fb0537da6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:15.591902 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd4f40-17cb-43f9-8b46-af4fb0537da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:15.592201 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd4f40-17cb-43f9-8b46-af4fb0537da6 admin admin] PATH_INFO: `/v3/projects/1c7d407df72546969e41477923faa914/users/bd7d577f21bd402b88d789e88a893e12/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:15.608502 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd4f40-17cb-43f9-8b46-af4fb0537da6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c7d407df72546969e41477923faa914, user_id=bd7d577f21bd402b88d789e88a893e12, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:15.611175 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd4f40-17cb-43f9-8b46-af4fb0537da6 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:15.624668 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1367/2718] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 16:03:15 2022] PUT /identity/v3/projects/1c7d407df72546969e41477923faa914/users/bd7d577f21bd402b88d789e88a893e12/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:03:15.635109 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdc879-e76e-4c3a-a9db-c708499e21a5 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:15.635392 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdc879-e76e-4c3a-a9db-c708499e21a5 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:15.635666 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdc879-e76e-4c3a-a9db-c708499e21a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:15.666789 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-c6fdc879-e76e-4c3a-a9db-c708499e21a5 None None] MFA Rules not processed for user `bd7d577f21bd402b88d789e88a893e12`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:03:15.668101 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-c6fdc879-e76e-4c3a-a9db-c708499e21a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:15.709936 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:15.739062 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1352/2719] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:03:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:03:15.743904 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd4f40-17cb-43f9-8b46-af4fb0537da6 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:15.785790 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:15.809043 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd4f40-17cb-43f9-8b46-af4fb0537da6 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:15.813683 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140d1a3-8149-486e-80e3-14c09ba41c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:15.814324 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140d1a3-8149-486e-80e3-14c09ba41c4c admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:15.814607 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140d1a3-8149-486e-80e3-14c09ba41c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:15.814881 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140d1a3-8149-486e-80e3-14c09ba41c4c admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:15.815515 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8140d1a3-8149-486e-80e3-14c09ba41c4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:15.817403 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8140d1a3-8149-486e-80e3-14c09ba41c4c admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:15.846549 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1368/2720] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 16:03:15 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:03:15.847557 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fdc879-e76e-4c3a-a9db-c708499e21a5 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:15.862100 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fdc879-e76e-4c3a-a9db-c708499e21a5 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:15.924981 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc4bda-0181-44c5-883f-bb7f8617dc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:15.925591 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc4bda-0181-44c5-883f-bb7f8617dc87 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:15.925868 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc4bda-0181-44c5-883f-bb7f8617dc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:15.926139 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc4bda-0181-44c5-883f-bb7f8617dc87 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:15.926800 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc4bda-0181-44c5-883f-bb7f8617dc87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:15.929324 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc4bda-0181-44c5-883f-bb7f8617dc87 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:15.950775 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1353/2721] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 16:03:15 2022] POST /identity/v3/users => generated 299 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:03:15.954758 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140d1a3-8149-486e-80e3-14c09ba41c4c admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:15.965515 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140d1a3-8149-486e-80e3-14c09ba41c4c admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:15.970038 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ced0b-1afa-40b3-ad45-49f9d2f0502a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:15.970669 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ced0b-1afa-40b3-ad45-49f9d2f0502a admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:15.970947 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ced0b-1afa-40b3-ad45-49f9d2f0502a admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:15.971218 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ced0b-1afa-40b3-ad45-49f9d2f0502a admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:15.971848 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ced0b-1afa-40b3-ad45-49f9d2f0502a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:15.973417 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ced0b-1afa-40b3-ad45-49f9d2f0502a admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:15.984913 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1369/2722] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:03:15.988899 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc4bda-0181-44c5-883f-bb7f8617dc87 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:15.998938 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc4bda-0181-44c5-883f-bb7f8617dc87 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:16.003528 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec351af7-e229-4692-94be-54f6d1f114f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:16.004177 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec351af7-e229-4692-94be-54f6d1f114f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:16.004458 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec351af7-e229-4692-94be-54f6d1f114f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:16.004739 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec351af7-e229-4692-94be-54f6d1f114f8 admin admin] PATH_INFO: `/v3/projects/5f3ed1899e5947dd8d29734a4ee12fcb/users/e7ef2d8eda884d37bab412b31ad21553/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:16.019651 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec351af7-e229-4692-94be-54f6d1f114f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f3ed1899e5947dd8d29734a4ee12fcb, user_id=e7ef2d8eda884d37bab412b31ad21553, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:16.022956 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec351af7-e229-4692-94be-54f6d1f114f8 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:16.040375 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1354/2723] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 16:03:15 2022] PUT /identity/v3/projects/5f3ed1899e5947dd8d29734a4ee12fcb/users/e7ef2d8eda884d37bab412b31ad21553/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:03:16.044401 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ced0b-1afa-40b3-ad45-49f9d2f0502a admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:16.054827 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ced0b-1afa-40b3-ad45-49f9d2f0502a admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:16.111079 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af2b0e-8360-499c-927b-83d6358b9dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:16.111688 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af2b0e-8360-499c-927b-83d6358b9dbc admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:16.111993 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af2b0e-8360-499c-927b-83d6358b9dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:16.112287 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af2b0e-8360-499c-927b-83d6358b9dbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:16.112911 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af2b0e-8360-499c-927b-83d6358b9dbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:16.114557 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af2b0e-8360-499c-927b-83d6358b9dbc admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:16.124275 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1370/2724] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:03:16 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:03:16.128614 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec351af7-e229-4692-94be-54f6d1f114f8 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:16.138815 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec351af7-e229-4692-94be-54f6d1f114f8 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:16.143541 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d9ed3-f7a5-4320-9500-ec32a616aaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:16.144247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d9ed3-f7a5-4320-9500-ec32a616aaae admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:16.144530 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d9ed3-f7a5-4320-9500-ec32a616aaae admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:16.144804 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d9ed3-f7a5-4320-9500-ec32a616aaae admin admin] PATH_INFO: `/v3/projects/5f3ed1899e5947dd8d29734a4ee12fcb/users/e7ef2d8eda884d37bab412b31ad21553/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:16.147412 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271d9ed3-f7a5-4320-9500-ec32a616aaae admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f3ed1899e5947dd8d29734a4ee12fcb, user_id=e7ef2d8eda884d37bab412b31ad21553, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:16.150073 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271d9ed3-f7a5-4320-9500-ec32a616aaae admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:16.161895 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1355/2725] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 16:03:16 2022] PUT /identity/v3/projects/5f3ed1899e5947dd8d29734a4ee12fcb/users/e7ef2d8eda884d37bab412b31ad21553/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:03:16.174439 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66ca42-16b2-40c6-b9f8-a052c190e602 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:16.174729 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66ca42-16b2-40c6-b9f8-a052c190e602 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:16.175004 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66ca42-16b2-40c6-b9f8-a052c190e602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:16.204957 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-ac66ca42-16b2-40c6-b9f8-a052c190e602 None None] MFA Rules not processed for user `e7ef2d8eda884d37bab412b31ad21553`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:03:16.206147 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-ac66ca42-16b2-40c6-b9f8-a052c190e602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:16.273484 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1371/2726] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:03:16 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:03:16.284182 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d9ed3-f7a5-4320-9500-ec32a616aaae admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:16.285905 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-271d9ed3-f7a5-4320-9500-ec32a616aaae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:16.343994 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d9ed3-f7a5-4320-9500-ec32a616aaae admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:16.347683 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22103b61-b1ce-4b73-86a0-2313d28a6832 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:16.348275 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22103b61-b1ce-4b73-86a0-2313d28a6832 service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:16.348555 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22103b61-b1ce-4b73-86a0-2313d28a6832 service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:16.348827 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22103b61-b1ce-4b73-86a0-2313d28a6832 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:16.358595 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22103b61-b1ce-4b73-86a0-2313d28a6832 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:16.360018 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22103b61-b1ce-4b73-86a0-2313d28a6832 service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:16.370008 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1356/2727] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:03:16 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:03:16.516448 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac66ca42-16b2-40c6-b9f8-a052c190e602 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:16.552143 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:16.580449 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac66ca42-16b2-40c6-b9f8-a052c190e602 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:16.585684 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26edcf-fb07-4e75-a054-01e5eee1ba1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:16.586340 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26edcf-fb07-4e75-a054-01e5eee1ba1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:16.586619 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26edcf-fb07-4e75-a054-01e5eee1ba1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:16.586889 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26edcf-fb07-4e75-a054-01e5eee1ba1c admin admin] PATH_INFO: `/v3/users/bd7d577f21bd402b88d789e88a893e12` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:16.587990 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc26edcf-fb07-4e75-a054-01e5eee1ba1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd7d577f21bd402b88d789e88a893e12)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:16.589882 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc26edcf-fb07-4e75-a054-01e5eee1ba1c admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:16.633213 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-fc26edcf-fb07-4e75-a054-01e5eee1ba1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd7d577f21bd402b88d789e88a893e12'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:16.640117 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-fc26edcf-fb07-4e75-a054-01e5eee1ba1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd7d577f21bd402b88d789e88a893e12'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:16.640752 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-fc26edcf-fb07-4e75-a054-01e5eee1ba1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd7d577f21bd402b88d789e88a893e12'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:16.652994 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-fc26edcf-fb07-4e75-a054-01e5eee1ba1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd7d577f21bd402b88d789e88a893e12'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:16.653623 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-fc26edcf-fb07-4e75-a054-01e5eee1ba1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd7d577f21bd402b88d789e88a893e12'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:16.665509 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1372/2728] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 16:03:16 2022] DELETE /identity/v3/users/bd7d577f21bd402b88d789e88a893e12 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:03:16.669967 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1827a-fba0-462a-abad-ddc236efda98 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:16.670292 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1827a-fba0-462a-abad-ddc236efda98 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:16.670575 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1827a-fba0-462a-abad-ddc236efda98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:16.689900 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-b1a1827a-fba0-462a-abad-ddc236efda98 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:03:16.691153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b1a1827a-fba0-462a-abad-ddc236efda98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:16.720184 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:16.751014 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1357/2729] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:03:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:03:16.761083 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26edcf-fb07-4e75-a054-01e5eee1ba1c admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:16.762490 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-fc26edcf-fb07-4e75-a054-01e5eee1ba1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:16.835681 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26edcf-fb07-4e75-a054-01e5eee1ba1c admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:16.839241 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca4568f-8c57-4f17-bc4c-753ae3b946c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:16.839846 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4568f-8c57-4f17-bc4c-753ae3b946c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:16.840120 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4568f-8c57-4f17-bc4c-753ae3b946c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:16.840387 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4568f-8c57-4f17-bc4c-753ae3b946c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:16.849240 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca4568f-8c57-4f17-bc4c-753ae3b946c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:16.850765 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca4568f-8c57-4f17-bc4c-753ae3b946c2 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:16.860223 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1373/2730] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:03:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:03:17.127632 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1827a-fba0-462a-abad-ddc236efda98 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:17.129107 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b1a1827a-fba0-462a-abad-ddc236efda98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:17.142840 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1827a-fba0-462a-abad-ddc236efda98 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:17.148386 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50fd538-db3c-4991-ad43-0a88c2bb02b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:17.149025 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50fd538-db3c-4991-ad43-0a88c2bb02b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:17.149307 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50fd538-db3c-4991-ad43-0a88c2bb02b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:17.149696 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50fd538-db3c-4991-ad43-0a88c2bb02b2 admin admin] PATH_INFO: `/v3/projects/1c7d407df72546969e41477923faa914` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:17.150950 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50fd538-db3c-4991-ad43-0a88c2bb02b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c7d407df72546969e41477923faa914)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:17.153255 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50fd538-db3c-4991-ad43-0a88c2bb02b2 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:17.201121 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-d50fd538-db3c-4991-ad43-0a88c2bb02b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c7d407df72546969e41477923faa914', 'request_id': 'req-d50fd538-db3c-4991-ad43-0a88c2bb02b2'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:17.206541 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-d50fd538-db3c-4991-ad43-0a88c2bb02b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c7d407df72546969e41477923faa914', 'request_id': 'req-d50fd538-db3c-4991-ad43-0a88c2bb02b2'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:17.213138 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-d50fd538-db3c-4991-ad43-0a88c2bb02b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c7d407df72546969e41477923faa914', 'request_id': 'req-d50fd538-db3c-4991-ad43-0a88c2bb02b2'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:17.225836 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-d50fd538-db3c-4991-ad43-0a88c2bb02b2 admin admin] The token cache is being invalidate because project 1c7d407df72546969e41477923faa914 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:03:17.226148 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-d50fd538-db3c-4991-ad43-0a88c2bb02b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:17.226796 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-d50fd538-db3c-4991-ad43-0a88c2bb02b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:17.228286 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1358/2731] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 16:03:17 2022] DELETE /identity/v3/projects/1c7d407df72546969e41477923faa914 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:03:17.232819 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca4568f-8c57-4f17-bc4c-753ae3b946c2 service neutron] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:17.243603 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca4568f-8c57-4f17-bc4c-753ae3b946c2 service neutron] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:17.292630 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:17.300450 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628bce4-293b-4b2d-bc57-81fc87b6d038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:17.301678 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628bce4-293b-4b2d-bc57-81fc87b6d038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:17.301992 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628bce4-293b-4b2d-bc57-81fc87b6d038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:17.302350 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628bce4-293b-4b2d-bc57-81fc87b6d038 admin admin] PATH_INFO: `/v3/users/e7ef2d8eda884d37bab412b31ad21553` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:17.304327 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0628bce4-293b-4b2d-bc57-81fc87b6d038 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7ef2d8eda884d37bab412b31ad21553)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:17.306493 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0628bce4-293b-4b2d-bc57-81fc87b6d038 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:17.354067 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-0628bce4-293b-4b2d-bc57-81fc87b6d038 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7ef2d8eda884d37bab412b31ad21553'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:17.361539 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-0628bce4-293b-4b2d-bc57-81fc87b6d038 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7ef2d8eda884d37bab412b31ad21553'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:17.362167 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-0628bce4-293b-4b2d-bc57-81fc87b6d038 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7ef2d8eda884d37bab412b31ad21553'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:17.374910 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-0628bce4-293b-4b2d-bc57-81fc87b6d038 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7ef2d8eda884d37bab412b31ad21553'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:17.375491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-0628bce4-293b-4b2d-bc57-81fc87b6d038 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7ef2d8eda884d37bab412b31ad21553'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:17.387743 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1374/2732] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 16:03:17 2022] DELETE /identity/v3/users/e7ef2d8eda884d37bab412b31ad21553 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:03:17.665293 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50fd538-db3c-4991-ad43-0a88c2bb02b2 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:17.666824 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-d50fd538-db3c-4991-ad43-0a88c2bb02b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:17.680690 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50fd538-db3c-4991-ad43-0a88c2bb02b2 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:17.739274 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0beb49f-4670-459e-bc10-89a53c4e82e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:17.739908 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0beb49f-4670-459e-bc10-89a53c4e82e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:17.740221 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0beb49f-4670-459e-bc10-89a53c4e82e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:17.740727 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0beb49f-4670-459e-bc10-89a53c4e82e2 admin admin] PATH_INFO: `/v3/projects/5f3ed1899e5947dd8d29734a4ee12fcb` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:17.741919 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0beb49f-4670-459e-bc10-89a53c4e82e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f3ed1899e5947dd8d29734a4ee12fcb)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:17.743939 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0beb49f-4670-459e-bc10-89a53c4e82e2 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:17.790369 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-a0beb49f-4670-459e-bc10-89a53c4e82e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f3ed1899e5947dd8d29734a4ee12fcb', 'request_id': 'req-a0beb49f-4670-459e-bc10-89a53c4e82e2'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:17.795931 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-a0beb49f-4670-459e-bc10-89a53c4e82e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f3ed1899e5947dd8d29734a4ee12fcb', 'request_id': 'req-a0beb49f-4670-459e-bc10-89a53c4e82e2'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:17.797772 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:17.802731 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-a0beb49f-4670-459e-bc10-89a53c4e82e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f3ed1899e5947dd8d29734a4ee12fcb', 'request_id': 'req-a0beb49f-4670-459e-bc10-89a53c4e82e2'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:17.814696 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-a0beb49f-4670-459e-bc10-89a53c4e82e2 admin admin] The token cache is being invalidate because project 5f3ed1899e5947dd8d29734a4ee12fcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:03:17.814995 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-a0beb49f-4670-459e-bc10-89a53c4e82e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:17.815604 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-a0beb49f-4670-459e-bc10-89a53c4e82e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:17.817059 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1359/2733] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 16:03:17 2022] DELETE /identity/v3/projects/5f3ed1899e5947dd8d29734a4ee12fcb => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:03:17.823807 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c0504-77fa-4e21-9580-0d90a37df9ce None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:17.824094 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c0504-77fa-4e21-9580-0d90a37df9ce None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:17.824366 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c0504-77fa-4e21-9580-0d90a37df9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:17.844726 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-802c0504-77fa-4e21-9580-0d90a37df9ce None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:03:17.845923 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-802c0504-77fa-4e21-9580-0d90a37df9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:17.904667 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1375/2734] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:03:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:03:17.913035 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788716a-f858-4003-b571-6de081f91c14 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:17.913258 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788716a-f858-4003-b571-6de081f91c14 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:17.913569 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788716a-f858-4003-b571-6de081f91c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:17.933521 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-e788716a-f858-4003-b571-6de081f91c14 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:03:17.934773 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-e788716a-f858-4003-b571-6de081f91c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:17.942647 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1360/2735] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:03:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:03:17.947588 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c0504-77fa-4e21-9580-0d90a37df9ce None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:17.957392 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c0504-77fa-4e21-9580-0d90a37df9ce None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:17.962823 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf247c-a295-45a4-8acf-d5697059d5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:17.963449 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf247c-a295-45a4-8acf-d5697059d5b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:17.963728 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf247c-a295-45a4-8acf-d5697059d5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:17.964001 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf247c-a295-45a4-8acf-d5697059d5b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:17.964650 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cf247c-a295-45a4-8acf-d5697059d5b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:03:17.964950 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cf247c-a295-45a4-8acf-d5697059d5b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:17.966655 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cf247c-a295-45a4-8acf-d5697059d5b9 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:17.978344 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1376/2736] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 16:03:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:03:17.982703 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788716a-f858-4003-b571-6de081f91c14 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:17.991973 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788716a-f858-4003-b571-6de081f91c14 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:17.996631 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505a05c-8bc8-4347-98e7-1bd4c37a4879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:17.997214 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505a05c-8bc8-4347-98e7-1bd4c37a4879 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:17.997495 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505a05c-8bc8-4347-98e7-1bd4c37a4879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:17.997765 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505a05c-8bc8-4347-98e7-1bd4c37a4879 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:17.998440 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2505a05c-8bc8-4347-98e7-1bd4c37a4879 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:18.000361 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2505a05c-8bc8-4347-98e7-1bd4c37a4879 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:18.027933 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1361/2737] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 16:03:17 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:03:18.032110 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf247c-a295-45a4-8acf-d5697059d5b9 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:18.045833 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf247c-a295-45a4-8acf-d5697059d5b9 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:18.102360 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54fd2b-c603-47d6-8678-53fdded37dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:18.102958 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54fd2b-c603-47d6-8678-53fdded37dea admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:18.103237 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54fd2b-c603-47d6-8678-53fdded37dea admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:18.103509 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54fd2b-c603-47d6-8678-53fdded37dea admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:18.104144 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc54fd2b-c603-47d6-8678-53fdded37dea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:18.106047 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc54fd2b-c603-47d6-8678-53fdded37dea admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:18.115075 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:18.128925 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1377/2738] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 16:03:18 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:03:18.133193 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505a05c-8bc8-4347-98e7-1bd4c37a4879 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:18.143459 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505a05c-8bc8-4347-98e7-1bd4c37a4879 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:18.148084 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e4dfd-a3ea-4e06-8fd7-f480e4179fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:18.148677 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e4dfd-a3ea-4e06-8fd7-f480e4179fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:18.148957 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e4dfd-a3ea-4e06-8fd7-f480e4179fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:18.149231 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e4dfd-a3ea-4e06-8fd7-f480e4179fa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:18.149864 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e4dfd-a3ea-4e06-8fd7-f480e4179fa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:18.151499 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e4dfd-a3ea-4e06-8fd7-f480e4179fa7 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:18.161273 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1362/2739] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:03:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:03:18.165909 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54fd2b-c603-47d6-8678-53fdded37dea admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:18.175730 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54fd2b-c603-47d6-8678-53fdded37dea admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:18.180983 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cfa33e-379f-41ca-aa83-459ae1306fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:18.181596 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfa33e-379f-41ca-aa83-459ae1306fcd admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:18.181878 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfa33e-379f-41ca-aa83-459ae1306fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:18.182147 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfa33e-379f-41ca-aa83-459ae1306fcd admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:18.182809 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cfa33e-379f-41ca-aa83-459ae1306fcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:18.184412 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cfa33e-379f-41ca-aa83-459ae1306fcd admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:18.195061 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1378/2740] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:03:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:03:18.199749 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e4dfd-a3ea-4e06-8fd7-f480e4179fa7 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:18.210342 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e4dfd-a3ea-4e06-8fd7-f480e4179fa7 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:18.215064 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f82782-39e2-4b74-8de9-95039c91eb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:18.215711 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f82782-39e2-4b74-8de9-95039c91eb19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:18.215995 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f82782-39e2-4b74-8de9-95039c91eb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:18.216271 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f82782-39e2-4b74-8de9-95039c91eb19 admin admin] PATH_INFO: `/v3/projects/4043915c69fb45b4908cb197c296d6a0/users/9652233c34894d8cabc9c1d2eb1c8be6/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:18.231818 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f82782-39e2-4b74-8de9-95039c91eb19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4043915c69fb45b4908cb197c296d6a0, user_id=9652233c34894d8cabc9c1d2eb1c8be6, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:18.234498 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f82782-39e2-4b74-8de9-95039c91eb19 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:18.247021 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1363/2741] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 16:03:18 2022] PUT /identity/v3/projects/4043915c69fb45b4908cb197c296d6a0/users/9652233c34894d8cabc9c1d2eb1c8be6/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:03:18.257369 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ff0fe-609f-4cc5-a219-09575a69a7ec None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:18.257849 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ff0fe-609f-4cc5-a219-09575a69a7ec None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:18.257956 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ff0fe-609f-4cc5-a219-09575a69a7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:18.285700 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-e00ff0fe-609f-4cc5-a219-09575a69a7ec None None] MFA Rules not processed for user `9652233c34894d8cabc9c1d2eb1c8be6`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:03:18.286987 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-e00ff0fe-609f-4cc5-a219-09575a69a7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:18.352315 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1379/2742] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:03:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:03:18.363931 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f82782-39e2-4b74-8de9-95039c91eb19 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:18.365605 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-b2f82782-39e2-4b74-8de9-95039c91eb19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:18.422094 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f82782-39e2-4b74-8de9-95039c91eb19 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:18.425676 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ddb7c-ac18-4c08-bf31-ab1bb3dce744 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:18.426308 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ddb7c-ac18-4c08-bf31-ab1bb3dce744 service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:18.426592 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ddb7c-ac18-4c08-bf31-ab1bb3dce744 service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:18.426866 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ddb7c-ac18-4c08-bf31-ab1bb3dce744 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:18.435062 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ddb7c-ac18-4c08-bf31-ab1bb3dce744 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:18.436483 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ddb7c-ac18-4c08-bf31-ab1bb3dce744 service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:18.445102 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1364/2743] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:03:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:03:18.464243 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ff0fe-609f-4cc5-a219-09575a69a7ec None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:18.527457 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ff0fe-609f-4cc5-a219-09575a69a7ec None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:18.532036 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100b870-c6fa-49cd-a8fd-26a31d5e1e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:18.532665 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100b870-c6fa-49cd-a8fd-26a31d5e1e43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:18.532947 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100b870-c6fa-49cd-a8fd-26a31d5e1e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:18.533217 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100b870-c6fa-49cd-a8fd-26a31d5e1e43 admin admin] PATH_INFO: `/v3/users/9652233c34894d8cabc9c1d2eb1c8be6` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:18.534375 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4100b870-c6fa-49cd-a8fd-26a31d5e1e43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9652233c34894d8cabc9c1d2eb1c8be6)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:18.536283 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4100b870-c6fa-49cd-a8fd-26a31d5e1e43 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:18.582171 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-4100b870-c6fa-49cd-a8fd-26a31d5e1e43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9652233c34894d8cabc9c1d2eb1c8be6'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:18.590219 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-4100b870-c6fa-49cd-a8fd-26a31d5e1e43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9652233c34894d8cabc9c1d2eb1c8be6'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:18.590911 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-4100b870-c6fa-49cd-a8fd-26a31d5e1e43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9652233c34894d8cabc9c1d2eb1c8be6'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:18.602847 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-4100b870-c6fa-49cd-a8fd-26a31d5e1e43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9652233c34894d8cabc9c1d2eb1c8be6'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:18.603491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-4100b870-c6fa-49cd-a8fd-26a31d5e1e43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9652233c34894d8cabc9c1d2eb1c8be6'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:18.604651 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:18.618651 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1380/2744] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 16:03:18 2022] DELETE /identity/v3/users/9652233c34894d8cabc9c1d2eb1c8be6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:03:18.623097 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e8d443-c0b8-42c8-b669-91c8b4316299 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:18.623414 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e8d443-c0b8-42c8-b669-91c8b4316299 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:18.623692 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e8d443-c0b8-42c8-b669-91c8b4316299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:18.642925 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-32e8d443-c0b8-42c8-b669-91c8b4316299 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:03:18.644139 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-32e8d443-c0b8-42c8-b669-91c8b4316299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:18.702583 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1365/2745] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:03:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:03:18.712784 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100b870-c6fa-49cd-a8fd-26a31d5e1e43 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:18.714203 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-4100b870-c6fa-49cd-a8fd-26a31d5e1e43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:18.770557 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100b870-c6fa-49cd-a8fd-26a31d5e1e43 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:18.774786 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6cd850-1b63-464d-8dd9-6dc022cc50b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:18.775380 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6cd850-1b63-464d-8dd9-6dc022cc50b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:18.775659 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6cd850-1b63-464d-8dd9-6dc022cc50b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:18.775931 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6cd850-1b63-464d-8dd9-6dc022cc50b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:18.784654 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6cd850-1b63-464d-8dd9-6dc022cc50b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:18.786071 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6cd850-1b63-464d-8dd9-6dc022cc50b1 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:18.795262 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1381/2746] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:03:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:03:19.059560 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e8d443-c0b8-42c8-b669-91c8b4316299 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:19.061898 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-32e8d443-c0b8-42c8-b669-91c8b4316299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:19.074927 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e8d443-c0b8-42c8-b669-91c8b4316299 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:19.080088 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad3e69a-ee6e-4a30-b09a-c98f49d70688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:19.080765 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3e69a-ee6e-4a30-b09a-c98f49d70688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:19.081046 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3e69a-ee6e-4a30-b09a-c98f49d70688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:19.081385 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3e69a-ee6e-4a30-b09a-c98f49d70688 admin admin] PATH_INFO: `/v3/projects/4043915c69fb45b4908cb197c296d6a0` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:19.082829 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad3e69a-ee6e-4a30-b09a-c98f49d70688 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4043915c69fb45b4908cb197c296d6a0)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:19.086612 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad3e69a-ee6e-4a30-b09a-c98f49d70688 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:19.116624 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:19.140181 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-0ad3e69a-ee6e-4a30-b09a-c98f49d70688 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4043915c69fb45b4908cb197c296d6a0', 'request_id': 'req-0ad3e69a-ee6e-4a30-b09a-c98f49d70688'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:19.145683 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-0ad3e69a-ee6e-4a30-b09a-c98f49d70688 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4043915c69fb45b4908cb197c296d6a0', 'request_id': 'req-0ad3e69a-ee6e-4a30-b09a-c98f49d70688'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:19.152078 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-0ad3e69a-ee6e-4a30-b09a-c98f49d70688 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4043915c69fb45b4908cb197c296d6a0', 'request_id': 'req-0ad3e69a-ee6e-4a30-b09a-c98f49d70688'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:19.164170 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-0ad3e69a-ee6e-4a30-b09a-c98f49d70688 admin admin] The token cache is being invalidate because project 4043915c69fb45b4908cb197c296d6a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:03:19.164463 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-0ad3e69a-ee6e-4a30-b09a-c98f49d70688 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:19.165087 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-0ad3e69a-ee6e-4a30-b09a-c98f49d70688 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:19.166600 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1366/2747] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 16:03:19 2022] DELETE /identity/v3/projects/4043915c69fb45b4908cb197c296d6a0 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:03:19.171397 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e52ca9-13f3-44a2-924f-cc74847ef900 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:19.171689 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e52ca9-13f3-44a2-924f-cc74847ef900 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:19.172015 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e52ca9-13f3-44a2-924f-cc74847ef900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:19.192798 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-79e52ca9-13f3-44a2-924f-cc74847ef900 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:03:19.194611 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-79e52ca9-13f3-44a2-924f-cc74847ef900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:19.252160 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1382/2748] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:03:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:03:19.261454 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df450d28-5838-4418-b401-7d6bb19256b2 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:19.261737 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df450d28-5838-4418-b401-7d6bb19256b2 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:19.262012 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df450d28-5838-4418-b401-7d6bb19256b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:19.282044 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-df450d28-5838-4418-b401-7d6bb19256b2 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:03:19.283294 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-df450d28-5838-4418-b401-7d6bb19256b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:19.291930 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1367/2749] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:03:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:03:19.296296 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e52ca9-13f3-44a2-924f-cc74847ef900 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:19.306697 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e52ca9-13f3-44a2-924f-cc74847ef900 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:19.311318 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3098d-900f-4c3b-af0b-5b3164435b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:19.311916 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3098d-900f-4c3b-af0b-5b3164435b79 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:19.312222 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3098d-900f-4c3b-af0b-5b3164435b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:19.312497 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3098d-900f-4c3b-af0b-5b3164435b79 admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:19.313138 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e3098d-900f-4c3b-af0b-5b3164435b79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:03:19.313452 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e3098d-900f-4c3b-af0b-5b3164435b79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:19.315071 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e3098d-900f-4c3b-af0b-5b3164435b79 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:19.326438 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1383/2750] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 16:03:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:03:19.330531 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df450d28-5838-4418-b401-7d6bb19256b2 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:19.339972 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df450d28-5838-4418-b401-7d6bb19256b2 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:19.344757 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d83eab7-5731-43dc-8a66-63062f9a5204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:19.345382 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83eab7-5731-43dc-8a66-63062f9a5204 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:19.345664 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83eab7-5731-43dc-8a66-63062f9a5204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:19.345939 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83eab7-5731-43dc-8a66-63062f9a5204 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:19.346611 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d83eab7-5731-43dc-8a66-63062f9a5204 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:19.348514 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d83eab7-5731-43dc-8a66-63062f9a5204 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:19.379414 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1368/2751] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 16:03:19 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:03:19.380559 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3098d-900f-4c3b-af0b-5b3164435b79 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:19.391038 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3098d-900f-4c3b-af0b-5b3164435b79 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:19.446971 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d70df0a-feae-4f67-818e-df3516ab8e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:19.447568 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d70df0a-feae-4f67-818e-df3516ab8e31 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:19.447844 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d70df0a-feae-4f67-818e-df3516ab8e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:19.448112 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d70df0a-feae-4f67-818e-df3516ab8e31 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:19.448734 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d70df0a-feae-4f67-818e-df3516ab8e31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:19.450665 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d70df0a-feae-4f67-818e-df3516ab8e31 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:19.471028 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1384/2752] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 16:03:19 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:03:19.475801 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d83eab7-5731-43dc-8a66-63062f9a5204 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:19.486291 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d83eab7-5731-43dc-8a66-63062f9a5204 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:19.491899 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851bd474-316b-47c2-aed2-0754553d607d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:19.492488 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851bd474-316b-47c2-aed2-0754553d607d admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:19.492769 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851bd474-316b-47c2-aed2-0754553d607d admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:19.493043 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851bd474-316b-47c2-aed2-0754553d607d admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:19.493677 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851bd474-316b-47c2-aed2-0754553d607d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:19.495308 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851bd474-316b-47c2-aed2-0754553d607d admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:19.505292 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1369/2753] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:03:19.509097 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d70df0a-feae-4f67-818e-df3516ab8e31 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:19.519187 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d70df0a-feae-4f67-818e-df3516ab8e31 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:19.523933 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f536ed7-bc31-4104-9402-7e875c7cf9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:19.524527 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f536ed7-bc31-4104-9402-7e875c7cf9de admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:19.524807 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f536ed7-bc31-4104-9402-7e875c7cf9de admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:19.525079 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f536ed7-bc31-4104-9402-7e875c7cf9de admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:19.525713 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f536ed7-bc31-4104-9402-7e875c7cf9de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:19.527340 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f536ed7-bc31-4104-9402-7e875c7cf9de admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:19.529417 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:19.540056 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1385/2754] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:03:19.543947 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851bd474-316b-47c2-aed2-0754553d607d admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:19.554497 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851bd474-316b-47c2-aed2-0754553d607d admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:19.559058 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b7a8a-4bd5-4045-ab94-6b156f03dba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:19.559695 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b7a8a-4bd5-4045-ab94-6b156f03dba8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:19.559973 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b7a8a-4bd5-4045-ab94-6b156f03dba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:19.560242 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b7a8a-4bd5-4045-ab94-6b156f03dba8 admin admin] PATH_INFO: `/v3/projects/b357f283feb54677bcf4409e24243033/users/9b6a9c1192b0407c897088dd0319578b/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:19.574658 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b7a8a-4bd5-4045-ab94-6b156f03dba8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b357f283feb54677bcf4409e24243033, user_id=9b6a9c1192b0407c897088dd0319578b, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:19.577277 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b7a8a-4bd5-4045-ab94-6b156f03dba8 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:19.589864 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1370/2755] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 16:03:19 2022] PUT /identity/v3/projects/b357f283feb54677bcf4409e24243033/users/9b6a9c1192b0407c897088dd0319578b/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:03:19.600593 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa646ab-c4b2-4cbc-b66c-a54ab7a7232c None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:19.600877 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa646ab-c4b2-4cbc-b66c-a54ab7a7232c None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:19.601153 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa646ab-c4b2-4cbc-b66c-a54ab7a7232c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:19.629018 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-0aa646ab-c4b2-4cbc-b66c-a54ab7a7232c None None] MFA Rules not processed for user `9b6a9c1192b0407c897088dd0319578b`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:03:19.630371 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-0aa646ab-c4b2-4cbc-b66c-a54ab7a7232c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:19.692889 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1386/2756] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:03:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:03:19.703658 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b7a8a-4bd5-4045-ab94-6b156f03dba8 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:19.705329 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-409b7a8a-4bd5-4045-ab94-6b156f03dba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:19.761682 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b7a8a-4bd5-4045-ab94-6b156f03dba8 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:19.765157 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e7c65-682e-4a47-ad7b-8df1d013d0a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:19.765750 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e7c65-682e-4a47-ad7b-8df1d013d0a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:19.766027 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e7c65-682e-4a47-ad7b-8df1d013d0a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:19.766330 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e7c65-682e-4a47-ad7b-8df1d013d0a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:19.774950 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e7c65-682e-4a47-ad7b-8df1d013d0a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:19.776364 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e7c65-682e-4a47-ad7b-8df1d013d0a6 service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:19.784930 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1371/2757] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:03:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:03:22.786917 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa646ab-c4b2-4cbc-b66c-a54ab7a7232c None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:22.850414 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa646ab-c4b2-4cbc-b66c-a54ab7a7232c None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:22.854912 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dead53d-75aa-4f3e-93b9-f9a1280159dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:22.855533 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dead53d-75aa-4f3e-93b9-f9a1280159dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:22.855812 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dead53d-75aa-4f3e-93b9-f9a1280159dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:22.856084 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dead53d-75aa-4f3e-93b9-f9a1280159dc admin admin] PATH_INFO: `/v3/users/9b6a9c1192b0407c897088dd0319578b` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:22.857544 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dead53d-75aa-4f3e-93b9-f9a1280159dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b6a9c1192b0407c897088dd0319578b)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:22.859561 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dead53d-75aa-4f3e-93b9-f9a1280159dc admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:22.905906 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-3dead53d-75aa-4f3e-93b9-f9a1280159dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b6a9c1192b0407c897088dd0319578b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:22.913900 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-3dead53d-75aa-4f3e-93b9-f9a1280159dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b6a9c1192b0407c897088dd0319578b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:22.914528 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-3dead53d-75aa-4f3e-93b9-f9a1280159dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b6a9c1192b0407c897088dd0319578b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:22.926354 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-3dead53d-75aa-4f3e-93b9-f9a1280159dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b6a9c1192b0407c897088dd0319578b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:22.926981 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-3dead53d-75aa-4f3e-93b9-f9a1280159dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b6a9c1192b0407c897088dd0319578b'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:22.939363 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1387/2758] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 16:03:22 2022] DELETE /identity/v3/users/9b6a9c1192b0407c897088dd0319578b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:03:22.944521 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88eb5f-0af3-4b0d-a605-69177a37bc7a None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:22.945001 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88eb5f-0af3-4b0d-a605-69177a37bc7a None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:22.945102 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88eb5f-0af3-4b0d-a605-69177a37bc7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:22.963879 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-5e88eb5f-0af3-4b0d-a605-69177a37bc7a None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:03:22.965068 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-5e88eb5f-0af3-4b0d-a605-69177a37bc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:23.009800 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:23.024962 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1372/2759] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:03:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:03:23.036565 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dead53d-75aa-4f3e-93b9-f9a1280159dc admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:23.038630 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-3dead53d-75aa-4f3e-93b9-f9a1280159dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:23.048642 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:23.099940 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dead53d-75aa-4f3e-93b9-f9a1280159dc admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:23.104133 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6293f2b-9e79-46c4-bd60-f15336e12f9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:23.104744 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6293f2b-9e79-46c4-bd60-f15336e12f9a service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:23.105066 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6293f2b-9e79-46c4-bd60-f15336e12f9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:23.105343 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6293f2b-9e79-46c4-bd60-f15336e12f9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:23.117598 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6293f2b-9e79-46c4-bd60-f15336e12f9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:23.119073 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6293f2b-9e79-46c4-bd60-f15336e12f9a service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:23.128700 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1388/2760] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:03:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:03:23.391662 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88eb5f-0af3-4b0d-a605-69177a37bc7a None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:23.393728 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-5e88eb5f-0af3-4b0d-a605-69177a37bc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:23.408867 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88eb5f-0af3-4b0d-a605-69177a37bc7a None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:23.414719 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f835da-2593-4b5a-bbaa-5700ed746c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:23.415416 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f835da-2593-4b5a-bbaa-5700ed746c62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:23.415702 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f835da-2593-4b5a-bbaa-5700ed746c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:23.415978 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f835da-2593-4b5a-bbaa-5700ed746c62 admin admin] PATH_INFO: `/v3/projects/b357f283feb54677bcf4409e24243033` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:23.417201 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f835da-2593-4b5a-bbaa-5700ed746c62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b357f283feb54677bcf4409e24243033)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:23.419259 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f835da-2593-4b5a-bbaa-5700ed746c62 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:23.466635 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-d3f835da-2593-4b5a-bbaa-5700ed746c62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b357f283feb54677bcf4409e24243033', 'request_id': 'req-d3f835da-2593-4b5a-bbaa-5700ed746c62'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:23.472208 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-d3f835da-2593-4b5a-bbaa-5700ed746c62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b357f283feb54677bcf4409e24243033', 'request_id': 'req-d3f835da-2593-4b5a-bbaa-5700ed746c62'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:23.479073 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-d3f835da-2593-4b5a-bbaa-5700ed746c62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b357f283feb54677bcf4409e24243033', 'request_id': 'req-d3f835da-2593-4b5a-bbaa-5700ed746c62'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:23.492275 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-d3f835da-2593-4b5a-bbaa-5700ed746c62 admin admin] The token cache is being invalidate because project b357f283feb54677bcf4409e24243033 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:03:23.492657 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-d3f835da-2593-4b5a-bbaa-5700ed746c62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:23.493285 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-d3f835da-2593-4b5a-bbaa-5700ed746c62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:23.494835 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1373/2761] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 16:03:23 2022] DELETE /identity/v3/projects/b357f283feb54677bcf4409e24243033 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:03:23.499699 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3badf-586b-4ab4-b7ce-34be550ab5c4 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:23.499982 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3badf-586b-4ab4-b7ce-34be550ab5c4 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:23.500278 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3badf-586b-4ab4-b7ce-34be550ab5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:23.519926 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-7dc3badf-586b-4ab4-b7ce-34be550ab5c4 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:03:23.521053 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-7dc3badf-586b-4ab4-b7ce-34be550ab5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:23.578990 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1389/2762] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:03:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:03:23.587392 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc091b-a291-418c-8d82-3c1d2047819d None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:23.587680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc091b-a291-418c-8d82-3c1d2047819d None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:23.587982 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc091b-a291-418c-8d82-3c1d2047819d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:23.608510 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-52bc091b-a291-418c-8d82-3c1d2047819d None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:03:23.609712 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-52bc091b-a291-418c-8d82-3c1d2047819d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:23.617648 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1374/2763] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:03:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:03:23.621707 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3badf-586b-4ab4-b7ce-34be550ab5c4 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:23.631404 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3badf-586b-4ab4-b7ce-34be550ab5c4 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:23.635954 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70206b9b-55c6-4283-95a4-90d63464c69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:23.636545 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70206b9b-55c6-4283-95a4-90d63464c69d admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:23.636825 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70206b9b-55c6-4283-95a4-90d63464c69d admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:23.637096 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70206b9b-55c6-4283-95a4-90d63464c69d admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:23.637740 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70206b9b-55c6-4283-95a4-90d63464c69d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:03:23.638043 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70206b9b-55c6-4283-95a4-90d63464c69d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:23.639662 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70206b9b-55c6-4283-95a4-90d63464c69d admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:23.651630 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1390/2764] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 16:03:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:03:23.657285 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc091b-a291-418c-8d82-3c1d2047819d None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:23.667315 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc091b-a291-418c-8d82-3c1d2047819d None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:23.672064 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ca1ef-7cce-46ba-9f2d-4847aeabbf24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:23.672665 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ca1ef-7cce-46ba-9f2d-4847aeabbf24 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:23.672948 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ca1ef-7cce-46ba-9f2d-4847aeabbf24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:23.673224 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ca1ef-7cce-46ba-9f2d-4847aeabbf24 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:23.673848 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ca1ef-7cce-46ba-9f2d-4847aeabbf24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:23.675797 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ca1ef-7cce-46ba-9f2d-4847aeabbf24 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:23.705079 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1375/2765] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 16:03:23 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:03:23.706384 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70206b9b-55c6-4283-95a4-90d63464c69d admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:23.716819 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70206b9b-55c6-4283-95a4-90d63464c69d admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:23.772321 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc3c97e-e048-43e6-90f7-3681161c2e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:23.772850 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3c97e-e048-43e6-90f7-3681161c2e27 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:23.773131 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3c97e-e048-43e6-90f7-3681161c2e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:23.773402 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3c97e-e048-43e6-90f7-3681161c2e27 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:23.774020 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc3c97e-e048-43e6-90f7-3681161c2e27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:23.776000 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc3c97e-e048-43e6-90f7-3681161c2e27 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:23.797424 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1391/2766] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 16:03:23 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:03:23.801595 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ca1ef-7cce-46ba-9f2d-4847aeabbf24 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:23.811985 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ca1ef-7cce-46ba-9f2d-4847aeabbf24 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:23.816862 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10caa84d-88a9-432d-8f61-8933cdde20bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:23.817532 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10caa84d-88a9-432d-8f61-8933cdde20bd admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:23.817850 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10caa84d-88a9-432d-8f61-8933cdde20bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:23.818889 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10caa84d-88a9-432d-8f61-8933cdde20bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:23.819539 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10caa84d-88a9-432d-8f61-8933cdde20bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:23.821349 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10caa84d-88a9-432d-8f61-8933cdde20bd admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:23.831176 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1376/2767] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:03:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:03:23.835663 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc3c97e-e048-43e6-90f7-3681161c2e27 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:23.846251 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc3c97e-e048-43e6-90f7-3681161c2e27 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:23.850881 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b0424-6e3c-4a6f-9afb-3e5a29a45420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:23.851498 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b0424-6e3c-4a6f-9afb-3e5a29a45420 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:23.851779 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b0424-6e3c-4a6f-9afb-3e5a29a45420 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:23.852047 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b0424-6e3c-4a6f-9afb-3e5a29a45420 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:23.852681 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b0424-6e3c-4a6f-9afb-3e5a29a45420 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:23.854300 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b0424-6e3c-4a6f-9afb-3e5a29a45420 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:23.864915 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1392/2768] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:03:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:03:23.868960 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10caa84d-88a9-432d-8f61-8933cdde20bd admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:23.878785 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10caa84d-88a9-432d-8f61-8933cdde20bd admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:23.884100 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e2c5da-d16e-48b6-9cb3-829db890ca05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:23.884741 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2c5da-d16e-48b6-9cb3-829db890ca05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:23.885024 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2c5da-d16e-48b6-9cb3-829db890ca05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:23.885303 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2c5da-d16e-48b6-9cb3-829db890ca05 admin admin] PATH_INFO: `/v3/projects/74e5efd7fcf04ac6925cf1cdaf048d18/users/4bebfbc8f92c4d5588c44ae7cd5d3a75/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:23.900589 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e2c5da-d16e-48b6-9cb3-829db890ca05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74e5efd7fcf04ac6925cf1cdaf048d18, user_id=4bebfbc8f92c4d5588c44ae7cd5d3a75, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:23.903279 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e2c5da-d16e-48b6-9cb3-829db890ca05 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:23.915476 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1377/2769] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 16:03:23 2022] PUT /identity/v3/projects/74e5efd7fcf04ac6925cf1cdaf048d18/users/4bebfbc8f92c4d5588c44ae7cd5d3a75/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:03:23.925526 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee9b28-6cf4-4791-8109-00f8f9de3f3e None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:23.925813 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee9b28-6cf4-4791-8109-00f8f9de3f3e None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:23.926088 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee9b28-6cf4-4791-8109-00f8f9de3f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:23.953571 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-08ee9b28-6cf4-4791-8109-00f8f9de3f3e None None] MFA Rules not processed for user `4bebfbc8f92c4d5588c44ae7cd5d3a75`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:03:23.954799 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-08ee9b28-6cf4-4791-8109-00f8f9de3f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:23.958714 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:24.019065 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1393/2770] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:03:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:03:24.024377 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e2c5da-d16e-48b6-9cb3-829db890ca05 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:24.094569 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e2c5da-d16e-48b6-9cb3-829db890ca05 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:24.099260 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d26a1-f01a-428c-9596-48e42433584e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:24.100601 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d26a1-f01a-428c-9596-48e42433584e admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:24.100886 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d26a1-f01a-428c-9596-48e42433584e admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:24.101163 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d26a1-f01a-428c-9596-48e42433584e admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:24.101795 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986d26a1-f01a-428c-9596-48e42433584e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:24.103745 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986d26a1-f01a-428c-9596-48e42433584e admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:24.119550 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:24.132442 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1378/2771] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 16:03:24 2022] POST /identity/v3/projects => generated 371 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:03:24.136516 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee9b28-6cf4-4791-8109-00f8f9de3f3e None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:24.147080 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee9b28-6cf4-4791-8109-00f8f9de3f3e None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:24.203681 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b721b7c-f332-48f6-a39a-53a13c7b7b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:24.204281 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b721b7c-f332-48f6-a39a-53a13c7b7b38 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:24.204557 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b721b7c-f332-48f6-a39a-53a13c7b7b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:24.204827 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b721b7c-f332-48f6-a39a-53a13c7b7b38 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:24.205444 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b721b7c-f332-48f6-a39a-53a13c7b7b38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:24.207409 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b721b7c-f332-48f6-a39a-53a13c7b7b38 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:24.229053 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1394/2772] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 16:03:24 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:03:24.233339 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d26a1-f01a-428c-9596-48e42433584e admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:24.243640 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d26a1-f01a-428c-9596-48e42433584e admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:24.248325 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c5d9ce-9ebc-4a73-8b2c-2db95f7337c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:24.248931 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5d9ce-9ebc-4a73-8b2c-2db95f7337c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:24.249194 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5d9ce-9ebc-4a73-8b2c-2db95f7337c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:24.249464 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5d9ce-9ebc-4a73-8b2c-2db95f7337c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:24.250091 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c5d9ce-9ebc-4a73-8b2c-2db95f7337c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:24.251733 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c5d9ce-9ebc-4a73-8b2c-2db95f7337c3 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:24.264620 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1379/2773] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:03:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:03:24.268714 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b721b7c-f332-48f6-a39a-53a13c7b7b38 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:24.279626 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b721b7c-f332-48f6-a39a-53a13c7b7b38 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:24.284213 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bbb9cb-2a55-45be-b744-835e6d6de6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:24.284806 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbb9cb-2a55-45be-b744-835e6d6de6dd admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:24.285089 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbb9cb-2a55-45be-b744-835e6d6de6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:24.285366 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbb9cb-2a55-45be-b744-835e6d6de6dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:24.286000 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bbb9cb-2a55-45be-b744-835e6d6de6dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:24.288544 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bbb9cb-2a55-45be-b744-835e6d6de6dd admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:24.298349 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1395/2774] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:03:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:03:24.302456 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c5d9ce-9ebc-4a73-8b2c-2db95f7337c3 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:24.312449 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c5d9ce-9ebc-4a73-8b2c-2db95f7337c3 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:24.317110 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ffd4b6-f565-41b6-b309-d0e48ee0355f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:24.317743 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffd4b6-f565-41b6-b309-d0e48ee0355f admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:24.318057 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffd4b6-f565-41b6-b309-d0e48ee0355f admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:24.318385 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffd4b6-f565-41b6-b309-d0e48ee0355f admin admin] PATH_INFO: `/v3/projects/dfc6339e43d4405fbced7dbf16436692/users/f1d3527ee1384a5b86517de5c0546d0d/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:24.332716 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ffd4b6-f565-41b6-b309-d0e48ee0355f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfc6339e43d4405fbced7dbf16436692, user_id=f1d3527ee1384a5b86517de5c0546d0d, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:24.335985 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ffd4b6-f565-41b6-b309-d0e48ee0355f admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:24.348818 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1380/2775] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 16:03:24 2022] PUT /identity/v3/projects/dfc6339e43d4405fbced7dbf16436692/users/f1d3527ee1384a5b86517de5c0546d0d/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:03:24.360220 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a930a-17d6-4154-b6e0-5491b510f1f2 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:24.360512 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a930a-17d6-4154-b6e0-5491b510f1f2 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:24.360879 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a930a-17d6-4154-b6e0-5491b510f1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:24.388680 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-e04a930a-17d6-4154-b6e0-5491b510f1f2 None None] MFA Rules not processed for user `f1d3527ee1384a5b86517de5c0546d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:03:24.389902 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-e04a930a-17d6-4154-b6e0-5491b510f1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:24.458355 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1396/2776] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:03:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:03:24.463558 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ffd4b6-f565-41b6-b309-d0e48ee0355f admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:24.527838 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ffd4b6-f565-41b6-b309-d0e48ee0355f admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:24.534674 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76162b-4361-4489-aa7b-2eb631291358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:24.535230 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76162b-4361-4489-aa7b-2eb631291358 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:24.535510 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76162b-4361-4489-aa7b-2eb631291358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:24.535780 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76162b-4361-4489-aa7b-2eb631291358 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:24.536419 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db76162b-4361-4489-aa7b-2eb631291358 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:24.539640 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db76162b-4361-4489-aa7b-2eb631291358 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:24.570595 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1381/2777] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 16:03:24 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:03:24.574622 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a930a-17d6-4154-b6e0-5491b510f1f2 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:24.585875 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a930a-17d6-4154-b6e0-5491b510f1f2 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:24.594446 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:24.642597 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e434831-4f00-4b60-8b42-8888fe2a3a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:24.643217 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e434831-4f00-4b60-8b42-8888fe2a3a64 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:24.643493 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e434831-4f00-4b60-8b42-8888fe2a3a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:24.643762 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e434831-4f00-4b60-8b42-8888fe2a3a64 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:24.644372 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e434831-4f00-4b60-8b42-8888fe2a3a64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:24.646942 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e434831-4f00-4b60-8b42-8888fe2a3a64 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:24.668549 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1397/2778] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 16:03:24 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:03:24.672522 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76162b-4361-4489-aa7b-2eb631291358 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:24.682665 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76162b-4361-4489-aa7b-2eb631291358 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:24.687263 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636855e6-fb99-45ad-ae59-372dc76ebc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:24.687854 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636855e6-fb99-45ad-ae59-372dc76ebc88 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:24.688133 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636855e6-fb99-45ad-ae59-372dc76ebc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:24.688403 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636855e6-fb99-45ad-ae59-372dc76ebc88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:24.689031 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636855e6-fb99-45ad-ae59-372dc76ebc88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:24.690632 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636855e6-fb99-45ad-ae59-372dc76ebc88 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:24.702218 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1382/2779] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:03:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:03:24.706127 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e434831-4f00-4b60-8b42-8888fe2a3a64 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:24.716823 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e434831-4f00-4b60-8b42-8888fe2a3a64 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:24.721345 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ff9c9-a5fc-40db-a86d-0870482a34d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:24.721983 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ff9c9-a5fc-40db-a86d-0870482a34d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:24.722298 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ff9c9-a5fc-40db-a86d-0870482a34d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:24.722573 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ff9c9-a5fc-40db-a86d-0870482a34d3 admin admin] PATH_INFO: `/v3/projects/6964b26dfa3f464a96174db68dd5ba1c/users/7544d12fbd4d4709a9f34975a5c78f9f/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:24.737277 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ff9c9-a5fc-40db-a86d-0870482a34d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6964b26dfa3f464a96174db68dd5ba1c, user_id=7544d12fbd4d4709a9f34975a5c78f9f, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:24.740019 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ff9c9-a5fc-40db-a86d-0870482a34d3 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:24.752349 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1398/2780] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 16:03:24 2022] PUT /identity/v3/projects/6964b26dfa3f464a96174db68dd5ba1c/users/7544d12fbd4d4709a9f34975a5c78f9f/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:03:24.756797 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636855e6-fb99-45ad-ae59-372dc76ebc88 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:24.766727 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636855e6-fb99-45ad-ae59-372dc76ebc88 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:24.822046 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb295ff-9bcc-444b-9b4a-2315273728ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:24.822610 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb295ff-9bcc-444b-9b4a-2315273728ea admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:24.822876 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb295ff-9bcc-444b-9b4a-2315273728ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:24.823150 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb295ff-9bcc-444b-9b4a-2315273728ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:24.823773 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb295ff-9bcc-444b-9b4a-2315273728ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:24.825347 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb295ff-9bcc-444b-9b4a-2315273728ea admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:24.835427 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1383/2781] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:03:24 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:03:24.839653 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ff9c9-a5fc-40db-a86d-0870482a34d3 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:24.849845 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ff9c9-a5fc-40db-a86d-0870482a34d3 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:24.854444 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f6493-c09c-4a80-8717-e5fd7af61dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:24.855084 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f6493-c09c-4a80-8717-e5fd7af61dcc admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:24.855360 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f6493-c09c-4a80-8717-e5fd7af61dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:24.855631 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f6493-c09c-4a80-8717-e5fd7af61dcc admin admin] PATH_INFO: `/v3/projects/6964b26dfa3f464a96174db68dd5ba1c/users/7544d12fbd4d4709a9f34975a5c78f9f/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:24.857793 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f6493-c09c-4a80-8717-e5fd7af61dcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6964b26dfa3f464a96174db68dd5ba1c, user_id=7544d12fbd4d4709a9f34975a5c78f9f, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:24.860434 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f6493-c09c-4a80-8717-e5fd7af61dcc admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:24.870450 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1399/2782] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 16:03:24 2022] PUT /identity/v3/projects/6964b26dfa3f464a96174db68dd5ba1c/users/7544d12fbd4d4709a9f34975a5c78f9f/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:03:24.881941 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79488e98-ebee-42d6-b9f9-7b958cecc370 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:24.882260 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79488e98-ebee-42d6-b9f9-7b958cecc370 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:24.882541 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79488e98-ebee-42d6-b9f9-7b958cecc370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:24.910880 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-79488e98-ebee-42d6-b9f9-7b958cecc370 None None] MFA Rules not processed for user `7544d12fbd4d4709a9f34975a5c78f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:03:24.912350 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-79488e98-ebee-42d6-b9f9-7b958cecc370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:24.930741 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:24.982104 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1384/2783] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:03:24 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:03:24.993866 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f6493-c09c-4a80-8717-e5fd7af61dcc admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:24.995673 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-ca0f6493-c09c-4a80-8717-e5fd7af61dcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:25.055014 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f6493-c09c-4a80-8717-e5fd7af61dcc admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:25.058737 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a28ead5-b64d-44af-8a1c-c3379376cde6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:25.059336 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28ead5-b64d-44af-8a1c-c3379376cde6 service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:25.059619 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28ead5-b64d-44af-8a1c-c3379376cde6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:25.059893 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28ead5-b64d-44af-8a1c-c3379376cde6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:25.116092 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a28ead5-b64d-44af-8a1c-c3379376cde6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:25.117450 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a28ead5-b64d-44af-8a1c-c3379376cde6 service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:25.126555 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1400/2784] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:03:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:03:26.622203 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79488e98-ebee-42d6-b9f9-7b958cecc370 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:26.623665 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-79488e98-ebee-42d6-b9f9-7b958cecc370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:26.636015 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79488e98-ebee-42d6-b9f9-7b958cecc370 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:26.639807 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2efc26-cd30-44d8-aebd-49ecdac4f928 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:26.640393 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2efc26-cd30-44d8-aebd-49ecdac4f928 service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:26.640670 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2efc26-cd30-44d8-aebd-49ecdac4f928 service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:26.640941 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2efc26-cd30-44d8-aebd-49ecdac4f928 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:26.696350 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2efc26-cd30-44d8-aebd-49ecdac4f928 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:26.697822 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2efc26-cd30-44d8-aebd-49ecdac4f928 service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:26.706448 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1385/2785] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:03:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:03:27.227197 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a28ead5-b64d-44af-8a1c-c3379376cde6 service cinder] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:27.236017 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a28ead5-b64d-44af-8a1c-c3379376cde6 service cinder] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:27.239656 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787000ea-eeb7-4082-9e28-206cb6594088 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:27.240637 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787000ea-eeb7-4082-9e28-206cb6594088 service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:27.241078 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787000ea-eeb7-4082-9e28-206cb6594088 service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:27.241530 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787000ea-eeb7-4082-9e28-206cb6594088 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:27.251638 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787000ea-eeb7-4082-9e28-206cb6594088 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:27.253046 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787000ea-eeb7-4082-9e28-206cb6594088 service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:27.262745 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1401/2786] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:03:27 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:03:31.117804 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2efc26-cd30-44d8-aebd-49ecdac4f928 service cinder] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:31.186917 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2efc26-cd30-44d8-aebd-49ecdac4f928 service cinder] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:31.192614 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141bdc6-41c4-47f5-949c-d09e2e527df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:31.193516 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141bdc6-41c4-47f5-949c-d09e2e527df5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:31.193835 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141bdc6-41c4-47f5-949c-d09e2e527df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:31.194334 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141bdc6-41c4-47f5-949c-d09e2e527df5 admin admin] PATH_INFO: `/v3/users/4bebfbc8f92c4d5588c44ae7cd5d3a75` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:31.195577 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3141bdc6-41c4-47f5-949c-d09e2e527df5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bebfbc8f92c4d5588c44ae7cd5d3a75)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:31.197579 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3141bdc6-41c4-47f5-949c-d09e2e527df5 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:31.251517 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-3141bdc6-41c4-47f5-949c-d09e2e527df5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bebfbc8f92c4d5588c44ae7cd5d3a75'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:31.259397 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-3141bdc6-41c4-47f5-949c-d09e2e527df5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bebfbc8f92c4d5588c44ae7cd5d3a75'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:31.260091 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-3141bdc6-41c4-47f5-949c-d09e2e527df5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bebfbc8f92c4d5588c44ae7cd5d3a75'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:31.262164 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:31.268861 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-3141bdc6-41c4-47f5-949c-d09e2e527df5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bebfbc8f92c4d5588c44ae7cd5d3a75'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:31.270048 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-3141bdc6-41c4-47f5-949c-d09e2e527df5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bebfbc8f92c4d5588c44ae7cd5d3a75'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:31.290292 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1386/2787] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 16:03:31 2022] DELETE /identity/v3/users/4bebfbc8f92c4d5588c44ae7cd5d3a75 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:03:31.294538 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c68901-b28e-4804-8a68-aebc4faf4d06 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:31.295002 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c68901-b28e-4804-8a68-aebc4faf4d06 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:31.295114 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c68901-b28e-4804-8a68-aebc4faf4d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:31.308494 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:31.315324 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-08c68901-b28e-4804-8a68-aebc4faf4d06 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:03:31.316541 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-08c68901-b28e-4804-8a68-aebc4faf4d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:31.380026 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1402/2788] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:03:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:03:31.387105 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141bdc6-41c4-47f5-949c-d09e2e527df5 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:31.388638 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-3141bdc6-41c4-47f5-949c-d09e2e527df5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:31.448514 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141bdc6-41c4-47f5-949c-d09e2e527df5 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:31.452503 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b74f3-3f1c-4a11-863e-1c788993ff05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:31.453114 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b74f3-3f1c-4a11-863e-1c788993ff05 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:31.453404 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b74f3-3f1c-4a11-863e-1c788993ff05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:31.453679 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b74f3-3f1c-4a11-863e-1c788993ff05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:31.463924 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b74f3-3f1c-4a11-863e-1c788993ff05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:31.465386 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b74f3-3f1c-4a11-863e-1c788993ff05 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:31.475441 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1387/2789] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:03:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:03:31.767347 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c68901-b28e-4804-8a68-aebc4faf4d06 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:31.768824 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-08c68901-b28e-4804-8a68-aebc4faf4d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:31.782030 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c68901-b28e-4804-8a68-aebc4faf4d06 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:31.787857 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62ac86-1a76-4359-9a30-4f6827bdfb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:31.788508 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62ac86-1a76-4359-9a30-4f6827bdfb29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:31.788788 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62ac86-1a76-4359-9a30-4f6827bdfb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:31.789204 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62ac86-1a76-4359-9a30-4f6827bdfb29 admin admin] PATH_INFO: `/v3/projects/74e5efd7fcf04ac6925cf1cdaf048d18` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:31.790387 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee62ac86-1a76-4359-9a30-4f6827bdfb29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74e5efd7fcf04ac6925cf1cdaf048d18)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:31.792396 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee62ac86-1a76-4359-9a30-4f6827bdfb29 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:31.860939 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-ee62ac86-1a76-4359-9a30-4f6827bdfb29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74e5efd7fcf04ac6925cf1cdaf048d18', 'request_id': 'req-ee62ac86-1a76-4359-9a30-4f6827bdfb29'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:31.869351 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-ee62ac86-1a76-4359-9a30-4f6827bdfb29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74e5efd7fcf04ac6925cf1cdaf048d18', 'request_id': 'req-ee62ac86-1a76-4359-9a30-4f6827bdfb29'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:31.877499 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-ee62ac86-1a76-4359-9a30-4f6827bdfb29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74e5efd7fcf04ac6925cf1cdaf048d18', 'request_id': 'req-ee62ac86-1a76-4359-9a30-4f6827bdfb29'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:31.897621 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-ee62ac86-1a76-4359-9a30-4f6827bdfb29 admin admin] The token cache is being invalidate because project 74e5efd7fcf04ac6925cf1cdaf048d18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:03:31.898272 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-ee62ac86-1a76-4359-9a30-4f6827bdfb29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:31.898878 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-ee62ac86-1a76-4359-9a30-4f6827bdfb29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:31.900995 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1403/2790] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 16:03:31 2022] DELETE /identity/v3/projects/74e5efd7fcf04ac6925cf1cdaf048d18 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:03:31.905237 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b74f3-3f1c-4a11-863e-1c788993ff05 service neutron] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:31.916253 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b74f3-3f1c-4a11-863e-1c788993ff05 service neutron] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:32.036108 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2820d195-88b4-4c57-b0e7-f57bcceb63e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:32.037612 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820d195-88b4-4c57-b0e7-f57bcceb63e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:32.037970 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820d195-88b4-4c57-b0e7-f57bcceb63e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:32.038351 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820d195-88b4-4c57-b0e7-f57bcceb63e1 admin admin] PATH_INFO: `/v3/users/f1d3527ee1384a5b86517de5c0546d0d` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:32.039622 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2820d195-88b4-4c57-b0e7-f57bcceb63e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1d3527ee1384a5b86517de5c0546d0d)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:32.041646 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2820d195-88b4-4c57-b0e7-f57bcceb63e1 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:32.113133 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-2820d195-88b4-4c57-b0e7-f57bcceb63e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1d3527ee1384a5b86517de5c0546d0d'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:32.122432 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-2820d195-88b4-4c57-b0e7-f57bcceb63e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1d3527ee1384a5b86517de5c0546d0d'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:32.123922 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-2820d195-88b4-4c57-b0e7-f57bcceb63e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1d3527ee1384a5b86517de5c0546d0d'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:32.132860 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-2820d195-88b4-4c57-b0e7-f57bcceb63e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1d3527ee1384a5b86517de5c0546d0d'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:32.133701 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-2820d195-88b4-4c57-b0e7-f57bcceb63e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1d3527ee1384a5b86517de5c0546d0d'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:32.147855 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:32.160144 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1388/2791] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 16:03:31 2022] DELETE /identity/v3/users/f1d3527ee1384a5b86517de5c0546d0d => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:03:32.451695 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62ac86-1a76-4359-9a30-4f6827bdfb29 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:32.453526 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-ee62ac86-1a76-4359-9a30-4f6827bdfb29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:32.467143 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62ac86-1a76-4359-9a30-4f6827bdfb29 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:32.536513 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce79b05-e591-45c1-ab07-c9824c8d79a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:32.537122 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce79b05-e591-45c1-ab07-c9824c8d79a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:32.537399 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce79b05-e591-45c1-ab07-c9824c8d79a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:32.537671 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce79b05-e591-45c1-ab07-c9824c8d79a0 admin admin] PATH_INFO: `/v3/projects/dfc6339e43d4405fbced7dbf16436692` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:32.538797 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce79b05-e591-45c1-ab07-c9824c8d79a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfc6339e43d4405fbced7dbf16436692)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:32.540709 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce79b05-e591-45c1-ab07-c9824c8d79a0 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:32.584882 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:32.603406 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-8ce79b05-e591-45c1-ab07-c9824c8d79a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfc6339e43d4405fbced7dbf16436692', 'request_id': 'req-8ce79b05-e591-45c1-ab07-c9824c8d79a0'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:32.610603 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-8ce79b05-e591-45c1-ab07-c9824c8d79a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfc6339e43d4405fbced7dbf16436692', 'request_id': 'req-8ce79b05-e591-45c1-ab07-c9824c8d79a0'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:32.618664 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-8ce79b05-e591-45c1-ab07-c9824c8d79a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfc6339e43d4405fbced7dbf16436692', 'request_id': 'req-8ce79b05-e591-45c1-ab07-c9824c8d79a0'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:32.636011 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-8ce79b05-e591-45c1-ab07-c9824c8d79a0 admin admin] The token cache is being invalidate because project dfc6339e43d4405fbced7dbf16436692 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:03:32.636549 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-8ce79b05-e591-45c1-ab07-c9824c8d79a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:32.638220 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-8ce79b05-e591-45c1-ab07-c9824c8d79a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:32.639940 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1404/2792] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 16:03:32 2022] DELETE /identity/v3/projects/dfc6339e43d4405fbced7dbf16436692 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:03:32.644160 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2820d195-88b4-4c57-b0e7-f57bcceb63e1 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:32.645650 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-2820d195-88b4-4c57-b0e7-f57bcceb63e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:32.658382 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2820d195-88b4-4c57-b0e7-f57bcceb63e1 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:32.716907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a5f090-54a1-4006-9b95-206881a1e054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:32.717701 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5f090-54a1-4006-9b95-206881a1e054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:32.717982 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5f090-54a1-4006-9b95-206881a1e054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:32.718301 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5f090-54a1-4006-9b95-206881a1e054 admin admin] PATH_INFO: `/v3/users/7544d12fbd4d4709a9f34975a5c78f9f` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:32.719417 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a5f090-54a1-4006-9b95-206881a1e054 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7544d12fbd4d4709a9f34975a5c78f9f)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:32.721320 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a5f090-54a1-4006-9b95-206881a1e054 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:32.769489 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-92a5f090-54a1-4006-9b95-206881a1e054 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7544d12fbd4d4709a9f34975a5c78f9f'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:32.777966 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-92a5f090-54a1-4006-9b95-206881a1e054 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7544d12fbd4d4709a9f34975a5c78f9f'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:32.778758 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-92a5f090-54a1-4006-9b95-206881a1e054 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7544d12fbd4d4709a9f34975a5c78f9f'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:32.786044 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-92a5f090-54a1-4006-9b95-206881a1e054 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7544d12fbd4d4709a9f34975a5c78f9f'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:32.787308 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-92a5f090-54a1-4006-9b95-206881a1e054 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7544d12fbd4d4709a9f34975a5c78f9f'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:32.805709 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1389/2793] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 16:03:32 2022] DELETE /identity/v3/users/7544d12fbd4d4709a9f34975a5c78f9f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:03:33.139053 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce79b05-e591-45c1-ab07-c9824c8d79a0 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:33.141171 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-8ce79b05-e591-45c1-ab07-c9824c8d79a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:33.155267 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce79b05-e591-45c1-ab07-c9824c8d79a0 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:33.236559 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567589ba-5c1e-4bea-917c-51ae48ae78de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:33.237678 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567589ba-5c1e-4bea-917c-51ae48ae78de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:33.238063 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567589ba-5c1e-4bea-917c-51ae48ae78de admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:33.238616 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567589ba-5c1e-4bea-917c-51ae48ae78de admin admin] PATH_INFO: `/v3/projects/6964b26dfa3f464a96174db68dd5ba1c` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:33.240866 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567589ba-5c1e-4bea-917c-51ae48ae78de admin admin] RBAC: Authorizing `identity:delete_project(project_id=6964b26dfa3f464a96174db68dd5ba1c)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:33.245279 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567589ba-5c1e-4bea-917c-51ae48ae78de admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:33.310308 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-567589ba-5c1e-4bea-917c-51ae48ae78de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6964b26dfa3f464a96174db68dd5ba1c', 'request_id': 'req-567589ba-5c1e-4bea-917c-51ae48ae78de'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:33.317261 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-567589ba-5c1e-4bea-917c-51ae48ae78de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6964b26dfa3f464a96174db68dd5ba1c', 'request_id': 'req-567589ba-5c1e-4bea-917c-51ae48ae78de'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:33.324419 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-567589ba-5c1e-4bea-917c-51ae48ae78de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6964b26dfa3f464a96174db68dd5ba1c', 'request_id': 'req-567589ba-5c1e-4bea-917c-51ae48ae78de'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:33.337984 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-567589ba-5c1e-4bea-917c-51ae48ae78de admin admin] The token cache is being invalidate because project 6964b26dfa3f464a96174db68dd5ba1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:03:33.338311 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-567589ba-5c1e-4bea-917c-51ae48ae78de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:33.338973 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-567589ba-5c1e-4bea-917c-51ae48ae78de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:33.340464 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1405/2794] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 16:03:33 2022] DELETE /identity/v3/projects/6964b26dfa3f464a96174db68dd5ba1c => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:03:33.345433 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062c90d-0adb-4523-b2ae-5466a4fa2747 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:33.346332 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062c90d-0adb-4523-b2ae-5466a4fa2747 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:33.346800 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062c90d-0adb-4523-b2ae-5466a4fa2747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:33.368640 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-8062c90d-0adb-4523-b2ae-5466a4fa2747 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:03:33.369799 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-8062c90d-0adb-4523-b2ae-5466a4fa2747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:33.435485 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1390/2795] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:03:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:03:33.444115 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f5860-502b-4f48-810c-c3ccdb2474e3 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:33.444395 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f5860-502b-4f48-810c-c3ccdb2474e3 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:33.444673 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f5860-502b-4f48-810c-c3ccdb2474e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:33.465840 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-5a8f5860-502b-4f48-810c-c3ccdb2474e3 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:03:33.467227 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-5a8f5860-502b-4f48-810c-c3ccdb2474e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:33.475312 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1406/2796] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:03:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:03:33.479485 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062c90d-0adb-4523-b2ae-5466a4fa2747 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:33.491747 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062c90d-0adb-4523-b2ae-5466a4fa2747 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:33.496910 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91768c-d45c-44fa-8fbd-afbb3ca99630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:33.497613 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91768c-d45c-44fa-8fbd-afbb3ca99630 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:33.497980 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91768c-d45c-44fa-8fbd-afbb3ca99630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:33.498342 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91768c-d45c-44fa-8fbd-afbb3ca99630 admin admin] PATH_INFO: `/v3/domains` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:33.499067 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a91768c-d45c-44fa-8fbd-afbb3ca99630 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:03:33.499443 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a91768c-d45c-44fa-8fbd-afbb3ca99630 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:33.501212 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a91768c-d45c-44fa-8fbd-afbb3ca99630 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:33.518128 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1391/2797] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 16:03:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:03:33.519565 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f5860-502b-4f48-810c-c3ccdb2474e3 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:33.529998 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f5860-502b-4f48-810c-c3ccdb2474e3 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:33.534834 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9949ae-48af-4701-afe2-f190744725f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:33.535466 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9949ae-48af-4701-afe2-f190744725f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:33.535931 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9949ae-48af-4701-afe2-f190744725f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:33.536391 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9949ae-48af-4701-afe2-f190744725f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:33.538259 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9949ae-48af-4701-afe2-f190744725f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:33.539763 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9949ae-48af-4701-afe2-f190744725f6 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:33.571352 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1407/2798] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 16:03:33 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:03:33.572511 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91768c-d45c-44fa-8fbd-afbb3ca99630 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:33.578080 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:33.584436 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91768c-d45c-44fa-8fbd-afbb3ca99630 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:33.645606 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa37580-95fe-4188-b48d-9e1a47a4d958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:33.646330 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa37580-95fe-4188-b48d-9e1a47a4d958 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:33.646614 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa37580-95fe-4188-b48d-9e1a47a4d958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:33.646889 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa37580-95fe-4188-b48d-9e1a47a4d958 admin admin] PATH_INFO: `/v3/users` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:33.647520 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa37580-95fe-4188-b48d-9e1a47a4d958 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:33.649534 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa37580-95fe-4188-b48d-9e1a47a4d958 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:33.674277 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1392/2799] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 16:03:33 2022] POST /identity/v3/users => generated 291 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:03:33.678545 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9949ae-48af-4701-afe2-f190744725f6 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:33.689375 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9949ae-48af-4701-afe2-f190744725f6 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:33.694595 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85dd0b-5a82-47f7-a6b9-c0a1ac70ea34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:33.695280 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85dd0b-5a82-47f7-a6b9-c0a1ac70ea34 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:33.695634 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85dd0b-5a82-47f7-a6b9-c0a1ac70ea34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:33.695981 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85dd0b-5a82-47f7-a6b9-c0a1ac70ea34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:33.696696 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd85dd0b-5a82-47f7-a6b9-c0a1ac70ea34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:33.698397 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd85dd0b-5a82-47f7-a6b9-c0a1ac70ea34 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:33.711273 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1408/2800] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:03:33.715166 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa37580-95fe-4188-b48d-9e1a47a4d958 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:33.726083 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa37580-95fe-4188-b48d-9e1a47a4d958 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:33.731203 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94edc75-0d30-4ecb-89da-619dbf95e71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:33.732067 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94edc75-0d30-4ecb-89da-619dbf95e71d admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:33.732352 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94edc75-0d30-4ecb-89da-619dbf95e71d admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:33.732640 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94edc75-0d30-4ecb-89da-619dbf95e71d admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:33.733537 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94edc75-0d30-4ecb-89da-619dbf95e71d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:33.735447 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94edc75-0d30-4ecb-89da-619dbf95e71d admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:33.749584 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1393/2801] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:03:33.751712 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85dd0b-5a82-47f7-a6b9-c0a1ac70ea34 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:33.761765 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85dd0b-5a82-47f7-a6b9-c0a1ac70ea34 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:33.766546 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f280dad9-1089-40fe-bf49-3f474ce27871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:33.767095 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280dad9-1089-40fe-bf49-3f474ce27871 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:33.767376 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280dad9-1089-40fe-bf49-3f474ce27871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:33.767650 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280dad9-1089-40fe-bf49-3f474ce27871 admin admin] PATH_INFO: `/v3/projects/d62f2e84313141afac498bf6746d3255/users/96238c1d15eb473a83b9020f9dc36fca/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:33.778389 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:33.784517 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f280dad9-1089-40fe-bf49-3f474ce27871 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d62f2e84313141afac498bf6746d3255, user_id=96238c1d15eb473a83b9020f9dc36fca, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:33.788052 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f280dad9-1089-40fe-bf49-3f474ce27871 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:33.803490 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1409/2802] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 16:03:33 2022] PUT /identity/v3/projects/d62f2e84313141afac498bf6746d3255/users/96238c1d15eb473a83b9020f9dc36fca/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:03:33.814038 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe594a-f4c7-421b-bf79-bab613112b9b None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:33.814438 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe594a-f4c7-421b-bf79-bab613112b9b None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:33.814717 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe594a-f4c7-421b-bf79-bab613112b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:33.843072 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-55fe594a-f4c7-421b-bf79-bab613112b9b None None] MFA Rules not processed for user `96238c1d15eb473a83b9020f9dc36fca`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:03:33.844440 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-55fe594a-f4c7-421b-bf79-bab613112b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:33.915883 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1394/2803] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:03:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:03:33.927747 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f280dad9-1089-40fe-bf49-3f474ce27871 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:33.929893 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-f280dad9-1089-40fe-bf49-3f474ce27871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:33.996785 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f280dad9-1089-40fe-bf49-3f474ce27871 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:34.001675 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad237400-e9c0-481d-8152-f50864169a88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:34.002359 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad237400-e9c0-481d-8152-f50864169a88 service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:34.002643 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad237400-e9c0-481d-8152-f50864169a88 service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:34.002921 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad237400-e9c0-481d-8152-f50864169a88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:34.016553 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad237400-e9c0-481d-8152-f50864169a88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:34.018201 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad237400-e9c0-481d-8152-f50864169a88 service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:34.029301 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1410/2804] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:03:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:03:36.607039 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe594a-f4c7-421b-bf79-bab613112b9b None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:36.669822 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe594a-f4c7-421b-bf79-bab613112b9b None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:36.674265 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c4ade-36ef-4283-a384-d32fedca5b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:36.674884 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c4ade-36ef-4283-a384-d32fedca5b87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:36.675160 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c4ade-36ef-4283-a384-d32fedca5b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:36.675430 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c4ade-36ef-4283-a384-d32fedca5b87 admin admin] PATH_INFO: `/v3/users/96238c1d15eb473a83b9020f9dc36fca` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:36.676525 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987c4ade-36ef-4283-a384-d32fedca5b87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96238c1d15eb473a83b9020f9dc36fca)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:36.678577 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987c4ade-36ef-4283-a384-d32fedca5b87 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:36.690639 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:36.728784 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-987c4ade-36ef-4283-a384-d32fedca5b87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96238c1d15eb473a83b9020f9dc36fca'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:36.736105 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-987c4ade-36ef-4283-a384-d32fedca5b87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96238c1d15eb473a83b9020f9dc36fca'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:36.736742 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-987c4ade-36ef-4283-a384-d32fedca5b87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96238c1d15eb473a83b9020f9dc36fca'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:36.743722 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-987c4ade-36ef-4283-a384-d32fedca5b87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96238c1d15eb473a83b9020f9dc36fca'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:36.744339 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-987c4ade-36ef-4283-a384-d32fedca5b87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96238c1d15eb473a83b9020f9dc36fca'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:36.762053 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1395/2805] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 16:03:36 2022] DELETE /identity/v3/users/96238c1d15eb473a83b9020f9dc36fca => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:03:36.766669 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463e791-a714-42e7-8013-d9ed8065a050 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:36.767130 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463e791-a714-42e7-8013-d9ed8065a050 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:36.767228 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463e791-a714-42e7-8013-d9ed8065a050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:36.787269 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-6463e791-a714-42e7-8013-d9ed8065a050 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:03:36.788520 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-6463e791-a714-42e7-8013-d9ed8065a050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:36.847073 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1411/2806] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:03:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:03:36.857518 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c4ade-36ef-4283-a384-d32fedca5b87 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:36.858918 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-987c4ade-36ef-4283-a384-d32fedca5b87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:36.920800 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c4ade-36ef-4283-a384-d32fedca5b87 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:36.924516 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e9c31-2390-47f2-899e-8b581d3716f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:36.925122 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e9c31-2390-47f2-899e-8b581d3716f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:36.925565 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e9c31-2390-47f2-899e-8b581d3716f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:36.925839 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e9c31-2390-47f2-899e-8b581d3716f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:36.935817 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e9c31-2390-47f2-899e-8b581d3716f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:36.937247 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e9c31-2390-47f2-899e-8b581d3716f3 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:36.946951 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1396/2807] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:03:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:03:37.225363 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6463e791-a714-42e7-8013-d9ed8065a050 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:03:37.227022 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-6463e791-a714-42e7-8013-d9ed8065a050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:37.247759 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6463e791-a714-42e7-8013-d9ed8065a050 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:03:37.257275 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823834f8-a28b-457f-a206-dcbf1ef15a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:03:37.258678 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823834f8-a28b-457f-a206-dcbf1ef15a33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:37.259246 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823834f8-a28b-457f-a206-dcbf1ef15a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:37.259711 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823834f8-a28b-457f-a206-dcbf1ef15a33 admin admin] PATH_INFO: `/v3/projects/d62f2e84313141afac498bf6746d3255` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:37.261647 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823834f8-a28b-457f-a206-dcbf1ef15a33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d62f2e84313141afac498bf6746d3255)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:03:37.267723 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823834f8-a28b-457f-a206-dcbf1ef15a33 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:03:37.326023 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-823834f8-a28b-457f-a206-dcbf1ef15a33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd62f2e84313141afac498bf6746d3255', 'request_id': 'req-823834f8-a28b-457f-a206-dcbf1ef15a33'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:37.331724 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-823834f8-a28b-457f-a206-dcbf1ef15a33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd62f2e84313141afac498bf6746d3255', 'request_id': 'req-823834f8-a28b-457f-a206-dcbf1ef15a33'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:37.338330 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-823834f8-a28b-457f-a206-dcbf1ef15a33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd62f2e84313141afac498bf6746d3255', 'request_id': 'req-823834f8-a28b-457f-a206-dcbf1ef15a33'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:37.357035 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-823834f8-a28b-457f-a206-dcbf1ef15a33 admin admin] The token cache is being invalidate because project d62f2e84313141afac498bf6746d3255 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:03:37.357322 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-823834f8-a28b-457f-a206-dcbf1ef15a33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:37.357946 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-823834f8-a28b-457f-a206-dcbf1ef15a33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:03:37.359881 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1412/2808] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 16:03:37 2022] DELETE /identity/v3/projects/d62f2e84313141afac498bf6746d3255 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:03:40.846464 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e8da2-3a56-4596-ab61-f1c6d99505b6 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:03:40.846967 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e8da2-3a56-4596-ab61-f1c6d99505b6 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:03:40.847070 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e8da2-3a56-4596-ab61-f1c6d99505b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:03:40.866952 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-776e8da2-3a56-4596-ab61-f1c6d99505b6 None None] MFA Rules not processed for user `f8cff93bade24d5581dcbbe90a7bf647`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:03:40.868105 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-776e8da2-3a56-4596-ab61-f1c6d99505b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:03:40.921633 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1397/2809] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:03:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:03:47.353859 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:03:50.915238 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=73,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:18.279442 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823834f8-a28b-457f-a206-dcbf1ef15a33 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:04:18.280917 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-823834f8-a28b-457f-a206-dcbf1ef15a33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:18.422487 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823834f8-a28b-457f-a206-dcbf1ef15a33 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:04:18.427590 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e6e4a-c87d-4646-bc8d-76f729b7bcd1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c270b488024605af84e52d874474e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:04:18.428200 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e6e4a-c87d-4646-bc8d-76f729b7bcd1 service placement] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:18.428480 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e6e4a-c87d-4646-bc8d-76f729b7bcd1 service placement] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:18.428756 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e6e4a-c87d-4646-bc8d-76f729b7bcd1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:18.430807 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-794e6e4a-c87d-4646-bc8d-76f729b7bcd1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:18.442161 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794e6e4a-c87d-4646-bc8d-76f729b7bcd1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:04:18.443797 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794e6e4a-c87d-4646-bc8d-76f729b7bcd1 service placement] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:04:18.454640 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1413/2810] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:04:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:04:28.450335 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=63 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:04:36.589556 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1c213-c5ff-4569-8946-dd0912d4fd29 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:04:36.590072 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1c213-c5ff-4569-8946-dd0912d4fd29 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:04:36.590072 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1c213-c5ff-4569-8946-dd0912d4fd29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:04:36.611473 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-d5e1c213-c5ff-4569-8946-dd0912d4fd29 None None] MFA Rules not processed for user `f8cff93bade24d5581dcbbe90a7bf647`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:04:36.612699 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-d5e1c213-c5ff-4569-8946-dd0912d4fd29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:04:36.620705 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1398/2811] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:04:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:04:46.606427 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:05:08.699632 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d9aa9-826d-4af0-bfaa-3c49a5a533df None None] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:08.700256 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d9aa9-826d-4af0-bfaa-3c49a5a533df None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:08.700256 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d9aa9-826d-4af0-bfaa-3c49a5a533df None None] PATH_INFO: `/` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:08.701890 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1414/2812] 10.222.0.16 () {54 vars in 921 bytes} [Wed Sep 7 16:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:05:08.708090 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12fb8e3-d28d-48b2-94ea-58a104f3c44c None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:08.708592 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12fb8e3-d28d-48b2-94ea-58a104f3c44c None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:08.708712 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12fb8e3-d28d-48b2-94ea-58a104f3c44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:08.762287 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-a12fb8e3-d28d-48b2-94ea-58a104f3c44c None None] MFA Rules not processed for user `3195fa62961c4d64972b88449d013380`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:05:08.763488 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-a12fb8e3-d28d-48b2-94ea-58a104f3c44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:05:08.828060 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1399/2813] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Sep 7 16:05:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 16:05:08.840003 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4d9aa9-826d-4af0-bfaa-3c49a5a533df None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:05:08.841730 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-5b4d9aa9-826d-4af0-bfaa-3c49a5a533df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:05:08.855544 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4d9aa9-826d-4af0-bfaa-3c49a5a533df None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:05:08.859401 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12921c9-1ba4-4478-b727-967544e19d3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:05:08.859993 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12921c9-1ba4-4478-b727-967544e19d3e service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:08.860274 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12921c9-1ba4-4478-b727-967544e19d3e service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:08.860547 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12921c9-1ba4-4478-b727-967544e19d3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:08.868221 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12921c9-1ba4-4478-b727-967544e19d3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:05:08.869662 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12921c9-1ba4-4478-b727-967544e19d3e service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:05:08.877509 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1415/2814] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:05:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:05:08.959055 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a0102-9cba-4c96-87fc-f4f3867d9846 None None] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:08.959346 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a0102-9cba-4c96-87fc-f4f3867d9846 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:08.959619 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a0102-9cba-4c96-87fc-f4f3867d9846 None None] PATH_INFO: `/` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:08.960997 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1400/2815] 10.222.0.16 () {54 vars in 921 bytes} [Wed Sep 7 16:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 16:05:08.966306 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d263af0-cb41-45f4-9012-827b58ac79f6 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:08.966595 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d263af0-cb41-45f4-9012-827b58ac79f6 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:08.966877 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d263af0-cb41-45f4-9012-827b58ac79f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:08.999132 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-7d263af0-cb41-45f4-9012-827b58ac79f6 None None] MFA Rules not processed for user `f9b13331a5fd48f5a2521ed1600f9f35`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:05:09.000341 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-7d263af0-cb41-45f4-9012-827b58ac79f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:05:09.082987 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1416/2816] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Sep 7 16:05:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:05:09.093846 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37a0102-9cba-4c96-87fc-f4f3867d9846 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:05:09.105763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37a0102-9cba-4c96-87fc-f4f3867d9846 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:05:09.109591 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f1288-1971-4288-9e58-72f36600ea3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:05:09.110228 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f1288-1971-4288-9e58-72f36600ea3c service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:09.110531 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f1288-1971-4288-9e58-72f36600ea3c service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:09.110808 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f1288-1971-4288-9e58-72f36600ea3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:09.121698 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f1288-1971-4288-9e58-72f36600ea3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:05:09.123193 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f1288-1971-4288-9e58-72f36600ea3c service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:05:09.135563 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1401/2817] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:05:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:05:19.080057 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=49 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:05:19.129785 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=46 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:05:41.649539 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d263af0-cb41-45f4-9012-827b58ac79f6 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:05:41.651194 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-7d263af0-cb41-45f4-9012-827b58ac79f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:05:41.746156 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d263af0-cb41-45f4-9012-827b58ac79f6 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:05:41.750707 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7707507-9bff-4808-ab8a-d42aea927df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:05:41.751329 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7707507-9bff-4808-ab8a-d42aea927df4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:41.751606 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7707507-9bff-4808-ab8a-d42aea927df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:41.751879 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7707507-9bff-4808-ab8a-d42aea927df4 admin admin] PATH_INFO: `/v3/users/f8cff93bade24d5581dcbbe90a7bf647` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:41.752992 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7707507-9bff-4808-ab8a-d42aea927df4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8cff93bade24d5581dcbbe90a7bf647)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:05:41.754950 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7707507-9bff-4808-ab8a-d42aea927df4 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:05:41.800151 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-f7707507-9bff-4808-ab8a-d42aea927df4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8cff93bade24d5581dcbbe90a7bf647'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:05:41.813209 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-f7707507-9bff-4808-ab8a-d42aea927df4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8cff93bade24d5581dcbbe90a7bf647'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:05:41.814072 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-f7707507-9bff-4808-ab8a-d42aea927df4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8cff93bade24d5581dcbbe90a7bf647'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:05:41.829498 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-f7707507-9bff-4808-ab8a-d42aea927df4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8cff93bade24d5581dcbbe90a7bf647'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:05:41.830149 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-f7707507-9bff-4808-ab8a-d42aea927df4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8cff93bade24d5581dcbbe90a7bf647'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:05:41.843516 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1417/2818] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 16:05:41 2022] DELETE /identity/v3/users/f8cff93bade24d5581dcbbe90a7bf647 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:05:42.022034 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f1288-1971-4288-9e58-72f36600ea3c service neutron] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:05:42.035294 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f1288-1971-4288-9e58-72f36600ea3c service neutron] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:05:42.095436 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ecd8d0-1dd2-4a3c-8c82-c1320c8c0bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:05:42.096066 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecd8d0-1dd2-4a3c-8c82-c1320c8c0bbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:42.096347 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecd8d0-1dd2-4a3c-8c82-c1320c8c0bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:42.096623 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecd8d0-1dd2-4a3c-8c82-c1320c8c0bbf admin admin] PATH_INFO: `/v3/projects/e445b17dd7744832a480fd3bbab438ce` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:42.097726 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ecd8d0-1dd2-4a3c-8c82-c1320c8c0bbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=e445b17dd7744832a480fd3bbab438ce)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:05:42.099661 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ecd8d0-1dd2-4a3c-8c82-c1320c8c0bbf admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:05:42.145778 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-01ecd8d0-1dd2-4a3c-8c82-c1320c8c0bbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e445b17dd7744832a480fd3bbab438ce', 'request_id': 'req-01ecd8d0-1dd2-4a3c-8c82-c1320c8c0bbf'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:05:42.151237 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-01ecd8d0-1dd2-4a3c-8c82-c1320c8c0bbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e445b17dd7744832a480fd3bbab438ce', 'request_id': 'req-01ecd8d0-1dd2-4a3c-8c82-c1320c8c0bbf'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:05:42.157344 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-01ecd8d0-1dd2-4a3c-8c82-c1320c8c0bbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e445b17dd7744832a480fd3bbab438ce', 'request_id': 'req-01ecd8d0-1dd2-4a3c-8c82-c1320c8c0bbf'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:05:42.169601 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-01ecd8d0-1dd2-4a3c-8c82-c1320c8c0bbf admin admin] The token cache is being invalidate because project e445b17dd7744832a480fd3bbab438ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:05:42.169888 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-01ecd8d0-1dd2-4a3c-8c82-c1320c8c0bbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:05:42.170531 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-01ecd8d0-1dd2-4a3c-8c82-c1320c8c0bbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:05:42.171986 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1402/2819] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 16:05:42 2022] DELETE /identity/v3/projects/e445b17dd7744832a480fd3bbab438ce => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:05:42.176883 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cb3c2-9a85-4da0-a7a4-90c449c2d66e None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:42.177167 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cb3c2-9a85-4da0-a7a4-90c449c2d66e None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:42.177440 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cb3c2-9a85-4da0-a7a4-90c449c2d66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:42.225059 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-0f0cb3c2-9a85-4da0-a7a4-90c449c2d66e None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:05:42.226531 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-0f0cb3c2-9a85-4da0-a7a4-90c449c2d66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:05:42.259720 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:05:42.294552 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1418/2820] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:05:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:05:42.302220 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397dbe66-88ce-49c3-bee0-47e617a2dfee None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:42.302517 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397dbe66-88ce-49c3-bee0-47e617a2dfee None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:42.302798 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397dbe66-88ce-49c3-bee0-47e617a2dfee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:42.323522 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-397dbe66-88ce-49c3-bee0-47e617a2dfee None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:05:42.324731 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-397dbe66-88ce-49c3-bee0-47e617a2dfee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:05:42.332582 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1403/2821] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:05:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:05:42.337020 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0cb3c2-9a85-4da0-a7a4-90c449c2d66e None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:05:42.346680 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0cb3c2-9a85-4da0-a7a4-90c449c2d66e None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:05:42.351490 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1dc61-dfdb-49c9-8ce9-260db59e1a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:05:42.352118 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1dc61-dfdb-49c9-8ce9-260db59e1a46 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:42.352400 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1dc61-dfdb-49c9-8ce9-260db59e1a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:42.352678 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1dc61-dfdb-49c9-8ce9-260db59e1a46 admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:42.353320 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe1dc61-dfdb-49c9-8ce9-260db59e1a46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:05:42.353621 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe1dc61-dfdb-49c9-8ce9-260db59e1a46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:05:42.355245 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe1dc61-dfdb-49c9-8ce9-260db59e1a46 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:05:42.367596 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1419/2822] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 16:05:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:05:42.372058 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397dbe66-88ce-49c3-bee0-47e617a2dfee None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:05:42.381373 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397dbe66-88ce-49c3-bee0-47e617a2dfee None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:05:42.387097 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a3512-08b0-4127-b07f-fb83b8843901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:05:42.387690 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a3512-08b0-4127-b07f-fb83b8843901 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:42.387973 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a3512-08b0-4127-b07f-fb83b8843901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:42.388251 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a3512-08b0-4127-b07f-fb83b8843901 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:42.388876 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812a3512-08b0-4127-b07f-fb83b8843901 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:05:42.390836 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812a3512-08b0-4127-b07f-fb83b8843901 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:05:42.418496 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1404/2823] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 16:05:42 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:05:42.422380 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1dc61-dfdb-49c9-8ce9-260db59e1a46 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:05:42.432812 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1dc61-dfdb-49c9-8ce9-260db59e1a46 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:05:42.489249 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa8458-61f0-4061-9979-8595fa2403ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:05:42.489848 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa8458-61f0-4061-9979-8595fa2403ed admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:42.490136 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa8458-61f0-4061-9979-8595fa2403ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:42.490447 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa8458-61f0-4061-9979-8595fa2403ed admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:42.491066 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa8458-61f0-4061-9979-8595fa2403ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:05:42.493932 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa8458-61f0-4061-9979-8595fa2403ed admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:05:42.514582 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1420/2824] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 16:05:42 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:05:42.518680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a3512-08b0-4127-b07f-fb83b8843901 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:05:42.529099 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a3512-08b0-4127-b07f-fb83b8843901 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:05:42.533657 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d0986b-bd50-4d3f-b73c-cc433cc02925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:05:42.534295 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0986b-bd50-4d3f-b73c-cc433cc02925 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:42.534574 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0986b-bd50-4d3f-b73c-cc433cc02925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:42.534843 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0986b-bd50-4d3f-b73c-cc433cc02925 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:42.535475 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d0986b-bd50-4d3f-b73c-cc433cc02925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:05:42.537054 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d0986b-bd50-4d3f-b73c-cc433cc02925 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:05:42.547416 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1405/2825] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:05:42.551330 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa8458-61f0-4061-9979-8595fa2403ed admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:05:42.561747 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa8458-61f0-4061-9979-8595fa2403ed admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:05:42.566641 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8a87e-f026-4caf-a424-96bd32dc6acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:05:42.567240 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8a87e-f026-4caf-a424-96bd32dc6acc admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:42.567524 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8a87e-f026-4caf-a424-96bd32dc6acc admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:42.567800 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8a87e-f026-4caf-a424-96bd32dc6acc admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:42.568557 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc8a87e-f026-4caf-a424-96bd32dc6acc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:05:42.570200 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc8a87e-f026-4caf-a424-96bd32dc6acc admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:05:42.580978 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1421/2826] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:05:42.584987 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d0986b-bd50-4d3f-b73c-cc433cc02925 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:05:42.594943 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d0986b-bd50-4d3f-b73c-cc433cc02925 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:05:42.599587 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c700f8-73d8-4a61-ba0d-1de42d7b9390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:05:42.600231 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c700f8-73d8-4a61-ba0d-1de42d7b9390 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:42.600514 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c700f8-73d8-4a61-ba0d-1de42d7b9390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:42.600793 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c700f8-73d8-4a61-ba0d-1de42d7b9390 admin admin] PATH_INFO: `/v3/projects/00ff9610b3e04ac8a1af3695025a8d1d/users/f64129ddf4304f339e275bafa8c45fa7/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:42.616565 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c700f8-73d8-4a61-ba0d-1de42d7b9390 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00ff9610b3e04ac8a1af3695025a8d1d, user_id=f64129ddf4304f339e275bafa8c45fa7, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:05:42.619894 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c700f8-73d8-4a61-ba0d-1de42d7b9390 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:05:42.632520 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1406/2827] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 16:05:42 2022] PUT /identity/v3/projects/00ff9610b3e04ac8a1af3695025a8d1d/users/f64129ddf4304f339e275bafa8c45fa7/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:05:42.643590 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965b4b6-565f-4a6f-9dfd-c99f884ee20a None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:42.643895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965b4b6-565f-4a6f-9dfd-c99f884ee20a None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:42.644183 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965b4b6-565f-4a6f-9dfd-c99f884ee20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:42.671688 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-2965b4b6-565f-4a6f-9dfd-c99f884ee20a None None] MFA Rules not processed for user `f64129ddf4304f339e275bafa8c45fa7`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:05:42.672862 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-2965b4b6-565f-4a6f-9dfd-c99f884ee20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:05:42.736449 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1422/2828] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:05:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:05:42.748259 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c700f8-73d8-4a61-ba0d-1de42d7b9390 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:05:42.750006 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-32c700f8-73d8-4a61-ba0d-1de42d7b9390 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:05:42.782256 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:05:42.825742 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c700f8-73d8-4a61-ba0d-1de42d7b9390 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:05:42.831251 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9dc23f-9296-454f-becb-c2a88492311f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b13331a5fd48f5a2521ed1600f9f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:05:42.831874 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dc23f-9296-454f-becb-c2a88492311f service nova] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:42.832151 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dc23f-9296-454f-becb-c2a88492311f service nova] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:42.832422 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dc23f-9296-454f-becb-c2a88492311f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:42.840490 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9dc23f-9296-454f-becb-c2a88492311f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:05:42.842045 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9dc23f-9296-454f-becb-c2a88492311f service nova] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:05:42.850608 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1407/2829] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:05:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:05:48.025157 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965b4b6-565f-4a6f-9dfd-c99f884ee20a None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:05:48.051433 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:05:48.088726 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965b4b6-565f-4a6f-9dfd-c99f884ee20a None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:05:48.093196 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f1fc0-fb3d-414b-8244-1c4296eff4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:05:48.093819 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f1fc0-fb3d-414b-8244-1c4296eff4e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:48.094123 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f1fc0-fb3d-414b-8244-1c4296eff4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:48.094424 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f1fc0-fb3d-414b-8244-1c4296eff4e4 admin admin] PATH_INFO: `/v3/users/f64129ddf4304f339e275bafa8c45fa7` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:48.095547 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f1fc0-fb3d-414b-8244-1c4296eff4e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f64129ddf4304f339e275bafa8c45fa7)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:05:48.097449 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f1fc0-fb3d-414b-8244-1c4296eff4e4 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:05:48.145282 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-178f1fc0-fb3d-414b-8244-1c4296eff4e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f64129ddf4304f339e275bafa8c45fa7'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:05:48.151985 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-178f1fc0-fb3d-414b-8244-1c4296eff4e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f64129ddf4304f339e275bafa8c45fa7'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:05:48.152786 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-178f1fc0-fb3d-414b-8244-1c4296eff4e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f64129ddf4304f339e275bafa8c45fa7'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:05:48.164668 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-178f1fc0-fb3d-414b-8244-1c4296eff4e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f64129ddf4304f339e275bafa8c45fa7'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:05:48.165302 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-178f1fc0-fb3d-414b-8244-1c4296eff4e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f64129ddf4304f339e275bafa8c45fa7'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:05:48.177272 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1423/2830] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 16:05:48 2022] DELETE /identity/v3/users/f64129ddf4304f339e275bafa8c45fa7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:05:48.182457 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e060b-c38b-4273-9361-0ac2c2a052b1 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:48.182916 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e060b-c38b-4273-9361-0ac2c2a052b1 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:48.183033 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e060b-c38b-4273-9361-0ac2c2a052b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:48.202172 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-ca9e060b-c38b-4273-9361-0ac2c2a052b1 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:05:48.203418 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-ca9e060b-c38b-4273-9361-0ac2c2a052b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:05:48.261969 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1408/2831] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:05:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:05:48.271719 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f1fc0-fb3d-414b-8244-1c4296eff4e4 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:05:48.273562 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-178f1fc0-fb3d-414b-8244-1c4296eff4e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:05:48.331486 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f1fc0-fb3d-414b-8244-1c4296eff4e4 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:05:48.335312 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01669ff-ec03-4ec0-ae09-7011cf3832d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:05:48.336066 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01669ff-ec03-4ec0-ae09-7011cf3832d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:48.336350 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01669ff-ec03-4ec0-ae09-7011cf3832d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:48.336628 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01669ff-ec03-4ec0-ae09-7011cf3832d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:48.345592 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01669ff-ec03-4ec0-ae09-7011cf3832d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:05:48.347048 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01669ff-ec03-4ec0-ae09-7011cf3832d5 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:05:48.357102 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1424/2832] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:05:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:05:48.632473 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e060b-c38b-4273-9361-0ac2c2a052b1 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:05:48.633907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-ca9e060b-c38b-4273-9361-0ac2c2a052b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:05:48.646716 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e060b-c38b-4273-9361-0ac2c2a052b1 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:05:48.651633 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2604d9a2-fe3c-4b85-8a3b-02495f01d09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:05:48.652274 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604d9a2-fe3c-4b85-8a3b-02495f01d09d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:48.652551 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604d9a2-fe3c-4b85-8a3b-02495f01d09d admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:48.652826 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604d9a2-fe3c-4b85-8a3b-02495f01d09d admin admin] PATH_INFO: `/v3/projects/00ff9610b3e04ac8a1af3695025a8d1d` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:48.653983 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2604d9a2-fe3c-4b85-8a3b-02495f01d09d admin admin] RBAC: Authorizing `identity:delete_project(project_id=00ff9610b3e04ac8a1af3695025a8d1d)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:05:48.655875 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2604d9a2-fe3c-4b85-8a3b-02495f01d09d admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:05:48.703713 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-2604d9a2-fe3c-4b85-8a3b-02495f01d09d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00ff9610b3e04ac8a1af3695025a8d1d', 'request_id': 'req-2604d9a2-fe3c-4b85-8a3b-02495f01d09d'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:05:48.709127 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-2604d9a2-fe3c-4b85-8a3b-02495f01d09d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00ff9610b3e04ac8a1af3695025a8d1d', 'request_id': 'req-2604d9a2-fe3c-4b85-8a3b-02495f01d09d'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:05:48.715284 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-2604d9a2-fe3c-4b85-8a3b-02495f01d09d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00ff9610b3e04ac8a1af3695025a8d1d', 'request_id': 'req-2604d9a2-fe3c-4b85-8a3b-02495f01d09d'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:05:48.727934 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-2604d9a2-fe3c-4b85-8a3b-02495f01d09d admin admin] The token cache is being invalidate because project 00ff9610b3e04ac8a1af3695025a8d1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:05:48.728222 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-2604d9a2-fe3c-4b85-8a3b-02495f01d09d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:05:48.728849 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-2604d9a2-fe3c-4b85-8a3b-02495f01d09d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:05:48.730395 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1409/2833] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 16:05:48 2022] DELETE /identity/v3/projects/00ff9610b3e04ac8a1af3695025a8d1d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:05:48.735572 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9160c47-fbbb-499a-bf3c-e870f1eed935 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:48.735858 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9160c47-fbbb-499a-bf3c-e870f1eed935 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:48.736132 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9160c47-fbbb-499a-bf3c-e870f1eed935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:48.756748 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-c9160c47-fbbb-499a-bf3c-e870f1eed935 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:05:48.758081 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-c9160c47-fbbb-499a-bf3c-e870f1eed935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:05:48.799781 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:05:48.818790 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1425/2834] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:05:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:05:48.826728 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7cf914-90c9-4a25-be04-8b30f489efa0 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:48.827020 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7cf914-90c9-4a25-be04-8b30f489efa0 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:48.827302 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7cf914-90c9-4a25-be04-8b30f489efa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:48.847347 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-eb7cf914-90c9-4a25-be04-8b30f489efa0 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:05:48.848554 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-eb7cf914-90c9-4a25-be04-8b30f489efa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:05:48.857270 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1410/2835] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:05:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:05:48.861322 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9160c47-fbbb-499a-bf3c-e870f1eed935 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:05:48.871306 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9160c47-fbbb-499a-bf3c-e870f1eed935 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:05:48.875787 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b46528-c8d3-4188-994e-6bc884acdaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:05:48.876372 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b46528-c8d3-4188-994e-6bc884acdaa3 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:48.876651 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b46528-c8d3-4188-994e-6bc884acdaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:48.876923 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b46528-c8d3-4188-994e-6bc884acdaa3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:48.877558 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b46528-c8d3-4188-994e-6bc884acdaa3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:05:48.877858 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b46528-c8d3-4188-994e-6bc884acdaa3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:05:48.879490 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b46528-c8d3-4188-994e-6bc884acdaa3 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:05:48.890988 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1426/2836] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 16:05:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 16:05:48.895127 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7cf914-90c9-4a25-be04-8b30f489efa0 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:05:48.905016 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7cf914-90c9-4a25-be04-8b30f489efa0 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:05:48.909618 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a31fc1-cb9a-495b-bb19-1047779ad3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:05:48.910227 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a31fc1-cb9a-495b-bb19-1047779ad3cf admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:48.910513 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a31fc1-cb9a-495b-bb19-1047779ad3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:48.910788 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a31fc1-cb9a-495b-bb19-1047779ad3cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:48.911421 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a31fc1-cb9a-495b-bb19-1047779ad3cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:05:48.913927 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a31fc1-cb9a-495b-bb19-1047779ad3cf admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:05:48.940762 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1411/2837] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 16:05:48 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:05:48.945132 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b46528-c8d3-4188-994e-6bc884acdaa3 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:05:48.955098 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b46528-c8d3-4188-994e-6bc884acdaa3 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:05:49.011287 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b06223-e2dc-49a0-92ac-cb86e79724dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:05:49.011879 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b06223-e2dc-49a0-92ac-cb86e79724dc admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:49.012157 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b06223-e2dc-49a0-92ac-cb86e79724dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:49.012427 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b06223-e2dc-49a0-92ac-cb86e79724dc admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:49.013037 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b06223-e2dc-49a0-92ac-cb86e79724dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:05:49.015000 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b06223-e2dc-49a0-92ac-cb86e79724dc admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:05:49.039743 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1427/2838] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 16:05:48 2022] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:05:49.040790 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a31fc1-cb9a-495b-bb19-1047779ad3cf admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:05:49.051129 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a31fc1-cb9a-495b-bb19-1047779ad3cf admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:05:49.056574 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735fc1c0-01cf-4ccc-8cef-24f86b2d4451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:05:49.057169 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fc1c0-01cf-4ccc-8cef-24f86b2d4451 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:49.057476 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fc1c0-01cf-4ccc-8cef-24f86b2d4451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:49.057747 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fc1c0-01cf-4ccc-8cef-24f86b2d4451 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:49.058431 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735fc1c0-01cf-4ccc-8cef-24f86b2d4451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:05:49.060040 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735fc1c0-01cf-4ccc-8cef-24f86b2d4451 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:05:49.061346 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:05:49.072307 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1412/2839] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:05:49.076648 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b06223-e2dc-49a0-92ac-cb86e79724dc admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:05:49.086738 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b06223-e2dc-49a0-92ac-cb86e79724dc admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:05:49.091346 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096fa663-9f43-4047-ab3b-b17f1d424898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:05:49.091935 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fa663-9f43-4047-ab3b-b17f1d424898 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:49.092214 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fa663-9f43-4047-ab3b-b17f1d424898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:49.092488 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fa663-9f43-4047-ab3b-b17f1d424898 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:49.093117 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096fa663-9f43-4047-ab3b-b17f1d424898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:05:49.094718 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096fa663-9f43-4047-ab3b-b17f1d424898 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:05:49.105221 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1428/2840] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:05:49.109709 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735fc1c0-01cf-4ccc-8cef-24f86b2d4451 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:05:49.128749 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735fc1c0-01cf-4ccc-8cef-24f86b2d4451 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:05:49.134343 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08033eb5-b5b9-42e0-82c1-9d7894b83d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:05:49.135013 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08033eb5-b5b9-42e0-82c1-9d7894b83d50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:49.135303 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08033eb5-b5b9-42e0-82c1-9d7894b83d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:49.135577 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08033eb5-b5b9-42e0-82c1-9d7894b83d50 admin admin] PATH_INFO: `/v3/projects/e121827f984a4abd897c3edb83cd1728/users/21035da573e544e29dec982c2e0896a1/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:49.151066 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08033eb5-b5b9-42e0-82c1-9d7894b83d50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e121827f984a4abd897c3edb83cd1728, user_id=21035da573e544e29dec982c2e0896a1, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:05:49.153705 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08033eb5-b5b9-42e0-82c1-9d7894b83d50 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:05:49.168242 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1413/2841] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 16:05:49 2022] PUT /identity/v3/projects/e121827f984a4abd897c3edb83cd1728/users/21035da573e544e29dec982c2e0896a1/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:05:49.178541 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c0d67-23ae-4ef6-938d-29802c608973 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:49.178889 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c0d67-23ae-4ef6-938d-29802c608973 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:49.179665 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c0d67-23ae-4ef6-938d-29802c608973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:49.206712 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-d36c0d67-23ae-4ef6-938d-29802c608973 None None] MFA Rules not processed for user `21035da573e544e29dec982c2e0896a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:05:49.207840 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-d36c0d67-23ae-4ef6-938d-29802c608973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:05:49.270966 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1429/2842] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:05:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:05:49.275645 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08033eb5-b5b9-42e0-82c1-9d7894b83d50 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:05:49.335315 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08033eb5-b5b9-42e0-82c1-9d7894b83d50 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:05:49.339935 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc30417-aeb9-4873-b19d-6ee43475a842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:05:49.340528 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc30417-aeb9-4873-b19d-6ee43475a842 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:49.340805 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc30417-aeb9-4873-b19d-6ee43475a842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:49.341082 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc30417-aeb9-4873-b19d-6ee43475a842 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:49.341692 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc30417-aeb9-4873-b19d-6ee43475a842 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:05:49.343607 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc30417-aeb9-4873-b19d-6ee43475a842 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:05:49.370233 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1414/2843] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 16:05:49 2022] POST /identity/v3/projects => generated 365 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:05:49.374349 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c0d67-23ae-4ef6-938d-29802c608973 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:05:49.385119 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c0d67-23ae-4ef6-938d-29802c608973 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:05:49.424929 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:05:49.442281 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e3ff1-11a0-40a1-b453-8b9ab4dbacd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:05:49.442887 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e3ff1-11a0-40a1-b453-8b9ab4dbacd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:49.443192 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e3ff1-11a0-40a1-b453-8b9ab4dbacd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:49.443469 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e3ff1-11a0-40a1-b453-8b9ab4dbacd9 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:49.444088 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e3ff1-11a0-40a1-b453-8b9ab4dbacd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:05:49.446229 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e3ff1-11a0-40a1-b453-8b9ab4dbacd9 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:05:49.465921 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1430/2844] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 16:05:49 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:05:49.469906 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc30417-aeb9-4873-b19d-6ee43475a842 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:05:49.480809 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc30417-aeb9-4873-b19d-6ee43475a842 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:05:49.485892 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b28a4-271e-476f-8d6d-859e82ba3d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:05:49.486520 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b28a4-271e-476f-8d6d-859e82ba3d3b admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:49.486799 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b28a4-271e-476f-8d6d-859e82ba3d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:49.487072 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b28a4-271e-476f-8d6d-859e82ba3d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:49.487703 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b28a4-271e-476f-8d6d-859e82ba3d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:05:49.489293 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b28a4-271e-476f-8d6d-859e82ba3d3b admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:05:49.500396 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1415/2845] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:05:49.504406 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e3ff1-11a0-40a1-b453-8b9ab4dbacd9 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:05:49.514366 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e3ff1-11a0-40a1-b453-8b9ab4dbacd9 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:05:49.519003 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e38602-242c-4f60-ab26-6ac3c47e6d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:05:49.519646 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e38602-242c-4f60-ab26-6ac3c47e6d3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:49.519931 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e38602-242c-4f60-ab26-6ac3c47e6d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:49.520208 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e38602-242c-4f60-ab26-6ac3c47e6d3d admin admin] PATH_INFO: `/v3/projects/24dcc0d14e2e40e1bc852dddadc56265/users/d762a3cfa6f349e79961ec0557224652/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:49.536491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e38602-242c-4f60-ab26-6ac3c47e6d3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=24dcc0d14e2e40e1bc852dddadc56265, user_id=d762a3cfa6f349e79961ec0557224652, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:05:49.539897 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e38602-242c-4f60-ab26-6ac3c47e6d3d admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:05:49.552693 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1431/2846] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 16:05:49 2022] PUT /identity/v3/projects/24dcc0d14e2e40e1bc852dddadc56265/users/d762a3cfa6f349e79961ec0557224652/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:05:49.556747 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b28a4-271e-476f-8d6d-859e82ba3d3b admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:05:49.566854 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b28a4-271e-476f-8d6d-859e82ba3d3b admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:05:49.624070 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ec1eb-edb5-4015-a982-638df1ef38d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:05:49.624680 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ec1eb-edb5-4015-a982-638df1ef38d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:49.624963 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ec1eb-edb5-4015-a982-638df1ef38d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:49.625242 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ec1eb-edb5-4015-a982-638df1ef38d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:49.625881 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6ec1eb-edb5-4015-a982-638df1ef38d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:05:49.627518 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6ec1eb-edb5-4015-a982-638df1ef38d5 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:05:49.637546 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1416/2847] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:05:49.641735 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e38602-242c-4f60-ab26-6ac3c47e6d3d admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:05:49.652817 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e38602-242c-4f60-ab26-6ac3c47e6d3d admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:05:49.657516 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f4c56-e7f4-4b54-9d3b-95e6061523ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:05:49.658164 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f4c56-e7f4-4b54-9d3b-95e6061523ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:49.658473 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f4c56-e7f4-4b54-9d3b-95e6061523ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:49.658749 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f4c56-e7f4-4b54-9d3b-95e6061523ca admin admin] PATH_INFO: `/v3/projects/24dcc0d14e2e40e1bc852dddadc56265/users/d762a3cfa6f349e79961ec0557224652/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:49.660718 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f4c56-e7f4-4b54-9d3b-95e6061523ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=24dcc0d14e2e40e1bc852dddadc56265, user_id=d762a3cfa6f349e79961ec0557224652, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:05:49.664210 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f4c56-e7f4-4b54-9d3b-95e6061523ca admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:05:49.674735 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1432/2848] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 16:05:49 2022] PUT /identity/v3/projects/24dcc0d14e2e40e1bc852dddadc56265/users/d762a3cfa6f349e79961ec0557224652/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:05:49.686342 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a066c603-7284-4c4d-aa8d-a403590c7f35 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:49.686642 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a066c603-7284-4c4d-aa8d-a403590c7f35 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:49.686920 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a066c603-7284-4c4d-aa8d-a403590c7f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:49.715171 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-a066c603-7284-4c4d-aa8d-a403590c7f35 None None] MFA Rules not processed for user `d762a3cfa6f349e79961ec0557224652`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:05:49.716448 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-a066c603-7284-4c4d-aa8d-a403590c7f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:05:49.748033 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:05:49.786757 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1417/2849] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:05:49 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:05:49.798630 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f4c56-e7f4-4b54-9d3b-95e6061523ca admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:05:49.800352 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-318f4c56-e7f4-4b54-9d3b-95e6061523ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:05:49.883587 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f4c56-e7f4-4b54-9d3b-95e6061523ca admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:05:49.900315 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f8dc52-afe7-4da1-8a86-040891eaacd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:05:49.900913 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8dc52-afe7-4da1-8a86-040891eaacd8 service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:49.901188 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8dc52-afe7-4da1-8a86-040891eaacd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:49.901458 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8dc52-afe7-4da1-8a86-040891eaacd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:49.910916 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f8dc52-afe7-4da1-8a86-040891eaacd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:05:49.912368 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f8dc52-afe7-4da1-8a86-040891eaacd8 service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:05:49.923336 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1433/2850] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:05:49 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:05:50.000511 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a066c603-7284-4c4d-aa8d-a403590c7f35 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:05:50.014403 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a066c603-7284-4c4d-aa8d-a403590c7f35 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:05:50.017966 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502e6930-1897-4e9d-bac0-11bcda84c3e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:05:50.018594 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e6930-1897-4e9d-bac0-11bcda84c3e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:50.018892 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e6930-1897-4e9d-bac0-11bcda84c3e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:50.019142 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e6930-1897-4e9d-bac0-11bcda84c3e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:50.079964 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502e6930-1897-4e9d-bac0-11bcda84c3e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:05:50.081405 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502e6930-1897-4e9d-bac0-11bcda84c3e4 service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:05:50.091257 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1418/2851] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:05:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:05:56.020418 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f8dc52-afe7-4da1-8a86-040891eaacd8 service cinder] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:05:56.083041 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f8dc52-afe7-4da1-8a86-040891eaacd8 service cinder] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:05:56.088394 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef314ea2-b705-47e2-b5d0-055b696e9857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:05:56.089014 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef314ea2-b705-47e2-b5d0-055b696e9857 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:56.089289 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef314ea2-b705-47e2-b5d0-055b696e9857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:56.089560 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef314ea2-b705-47e2-b5d0-055b696e9857 admin admin] PATH_INFO: `/v3/users/21035da573e544e29dec982c2e0896a1` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:56.090691 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef314ea2-b705-47e2-b5d0-055b696e9857 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21035da573e544e29dec982c2e0896a1)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:05:56.092583 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef314ea2-b705-47e2-b5d0-055b696e9857 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:05:56.112970 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:05:56.140253 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-ef314ea2-b705-47e2-b5d0-055b696e9857 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21035da573e544e29dec982c2e0896a1'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:05:56.147303 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-ef314ea2-b705-47e2-b5d0-055b696e9857 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21035da573e544e29dec982c2e0896a1'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:05:56.148558 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-ef314ea2-b705-47e2-b5d0-055b696e9857 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21035da573e544e29dec982c2e0896a1'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:05:56.160618 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-ef314ea2-b705-47e2-b5d0-055b696e9857 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21035da573e544e29dec982c2e0896a1'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:05:56.161251 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-ef314ea2-b705-47e2-b5d0-055b696e9857 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21035da573e544e29dec982c2e0896a1'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:05:56.173901 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1434/2852] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 16:05:56 2022] DELETE /identity/v3/users/21035da573e544e29dec982c2e0896a1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:05:56.178405 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184adf5-65d6-4d6c-9945-fe08b7db4c67 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:56.179414 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184adf5-65d6-4d6c-9945-fe08b7db4c67 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:56.179571 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184adf5-65d6-4d6c-9945-fe08b7db4c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:56.198214 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-e184adf5-65d6-4d6c-9945-fe08b7db4c67 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:05:56.199419 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-e184adf5-65d6-4d6c-9945-fe08b7db4c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:05:56.261262 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1419/2853] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:05:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:05:56.271071 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef314ea2-b705-47e2-b5d0-055b696e9857 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:05:56.272508 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-ef314ea2-b705-47e2-b5d0-055b696e9857 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:05:56.329834 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef314ea2-b705-47e2-b5d0-055b696e9857 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:05:56.333512 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14eab8-f105-4817-a57f-49e186ba38a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:05:56.334109 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14eab8-f105-4817-a57f-49e186ba38a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:56.334423 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14eab8-f105-4817-a57f-49e186ba38a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:56.334701 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14eab8-f105-4817-a57f-49e186ba38a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:56.343874 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e14eab8-f105-4817-a57f-49e186ba38a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:05:56.345298 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e14eab8-f105-4817-a57f-49e186ba38a0 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:05:56.355256 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1435/2854] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:05:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:05:56.616507 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184adf5-65d6-4d6c-9945-fe08b7db4c67 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:05:56.618567 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-e184adf5-65d6-4d6c-9945-fe08b7db4c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:05:56.632015 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184adf5-65d6-4d6c-9945-fe08b7db4c67 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:05:56.636885 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20485c0-f4f1-41f8-b701-88488a0dd3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:05:56.637540 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20485c0-f4f1-41f8-b701-88488a0dd3dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:56.637810 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20485c0-f4f1-41f8-b701-88488a0dd3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:56.638087 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20485c0-f4f1-41f8-b701-88488a0dd3dc admin admin] PATH_INFO: `/v3/projects/e121827f984a4abd897c3edb83cd1728` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:56.639499 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20485c0-f4f1-41f8-b701-88488a0dd3dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e121827f984a4abd897c3edb83cd1728)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:05:56.641407 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20485c0-f4f1-41f8-b701-88488a0dd3dc admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:05:56.691588 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-d20485c0-f4f1-41f8-b701-88488a0dd3dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e121827f984a4abd897c3edb83cd1728', 'request_id': 'req-d20485c0-f4f1-41f8-b701-88488a0dd3dc'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:05:56.697230 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-d20485c0-f4f1-41f8-b701-88488a0dd3dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e121827f984a4abd897c3edb83cd1728', 'request_id': 'req-d20485c0-f4f1-41f8-b701-88488a0dd3dc'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:05:56.699160 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:05:56.703764 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-d20485c0-f4f1-41f8-b701-88488a0dd3dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e121827f984a4abd897c3edb83cd1728', 'request_id': 'req-d20485c0-f4f1-41f8-b701-88488a0dd3dc'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:05:56.717087 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-d20485c0-f4f1-41f8-b701-88488a0dd3dc admin admin] The token cache is being invalidate because project e121827f984a4abd897c3edb83cd1728 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:05:56.717375 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-d20485c0-f4f1-41f8-b701-88488a0dd3dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:05:56.717993 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-d20485c0-f4f1-41f8-b701-88488a0dd3dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:05:56.719528 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1420/2855] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 16:05:56 2022] DELETE /identity/v3/projects/e121827f984a4abd897c3edb83cd1728 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:05:56.723542 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14eab8-f105-4817-a57f-49e186ba38a0 service neutron] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:05:56.734002 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14eab8-f105-4817-a57f-49e186ba38a0 service neutron] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:05:56.788989 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dbfd52-13cb-47ba-b69b-af0d6af2b132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:05:56.790287 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dbfd52-13cb-47ba-b69b-af0d6af2b132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:56.790570 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dbfd52-13cb-47ba-b69b-af0d6af2b132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:56.790846 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dbfd52-13cb-47ba-b69b-af0d6af2b132 admin admin] PATH_INFO: `/v3/users/d762a3cfa6f349e79961ec0557224652` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:56.791967 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dbfd52-13cb-47ba-b69b-af0d6af2b132 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d762a3cfa6f349e79961ec0557224652)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:05:56.793883 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dbfd52-13cb-47ba-b69b-af0d6af2b132 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:05:56.833895 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:05:56.840388 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-30dbfd52-13cb-47ba-b69b-af0d6af2b132 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd762a3cfa6f349e79961ec0557224652'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:05:56.847906 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-30dbfd52-13cb-47ba-b69b-af0d6af2b132 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd762a3cfa6f349e79961ec0557224652'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:05:56.848573 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-30dbfd52-13cb-47ba-b69b-af0d6af2b132 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd762a3cfa6f349e79961ec0557224652'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:05:56.861368 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-30dbfd52-13cb-47ba-b69b-af0d6af2b132 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd762a3cfa6f349e79961ec0557224652'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:05:56.861996 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-30dbfd52-13cb-47ba-b69b-af0d6af2b132 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd762a3cfa6f349e79961ec0557224652'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:05:56.873851 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1436/2856] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 16:05:56 2022] DELETE /identity/v3/users/d762a3cfa6f349e79961ec0557224652 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:05:57.138109 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20485c0-f4f1-41f8-b701-88488a0dd3dc admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:05:57.139619 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-d20485c0-f4f1-41f8-b701-88488a0dd3dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:05:57.152856 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20485c0-f4f1-41f8-b701-88488a0dd3dc admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:05:57.210920 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec6bdf-ecba-4f0f-a46a-d0cb86508d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:05:57.211616 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec6bdf-ecba-4f0f-a46a-d0cb86508d1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:57.211879 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec6bdf-ecba-4f0f-a46a-d0cb86508d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:57.212153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec6bdf-ecba-4f0f-a46a-d0cb86508d1d admin admin] PATH_INFO: `/v3/projects/24dcc0d14e2e40e1bc852dddadc56265` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:57.213265 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eec6bdf-ecba-4f0f-a46a-d0cb86508d1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=24dcc0d14e2e40e1bc852dddadc56265)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:05:57.215194 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eec6bdf-ecba-4f0f-a46a-d0cb86508d1d admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:05:57.260920 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-2eec6bdf-ecba-4f0f-a46a-d0cb86508d1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24dcc0d14e2e40e1bc852dddadc56265', 'request_id': 'req-2eec6bdf-ecba-4f0f-a46a-d0cb86508d1d'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:05:57.266639 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-2eec6bdf-ecba-4f0f-a46a-d0cb86508d1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24dcc0d14e2e40e1bc852dddadc56265', 'request_id': 'req-2eec6bdf-ecba-4f0f-a46a-d0cb86508d1d'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:05:57.272842 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-2eec6bdf-ecba-4f0f-a46a-d0cb86508d1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24dcc0d14e2e40e1bc852dddadc56265', 'request_id': 'req-2eec6bdf-ecba-4f0f-a46a-d0cb86508d1d'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:05:57.285365 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-2eec6bdf-ecba-4f0f-a46a-d0cb86508d1d admin admin] The token cache is being invalidate because project 24dcc0d14e2e40e1bc852dddadc56265 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:05:57.286278 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-2eec6bdf-ecba-4f0f-a46a-d0cb86508d1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:05:57.286899 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-2eec6bdf-ecba-4f0f-a46a-d0cb86508d1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:05:57.288476 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1421/2857] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 16:05:57 2022] DELETE /identity/v3/projects/24dcc0d14e2e40e1bc852dddadc56265 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:05:57.293882 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7d3c8-b75d-41dd-9844-2f9b3629dea9 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:57.294400 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7d3c8-b75d-41dd-9844-2f9b3629dea9 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:57.294514 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7d3c8-b75d-41dd-9844-2f9b3629dea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:57.314512 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-34a7d3c8-b75d-41dd-9844-2f9b3629dea9 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:05:57.315704 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-34a7d3c8-b75d-41dd-9844-2f9b3629dea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:05:57.378019 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1437/2858] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:05:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:05:57.386088 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef7473-f03f-4c8e-9265-ba6933877a97 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:57.386412 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef7473-f03f-4c8e-9265-ba6933877a97 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:57.386720 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef7473-f03f-4c8e-9265-ba6933877a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:57.407360 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-21ef7473-f03f-4c8e-9265-ba6933877a97 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:05:57.408582 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-21ef7473-f03f-4c8e-9265-ba6933877a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:05:57.417366 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1422/2859] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:05:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:05:57.421726 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7d3c8-b75d-41dd-9844-2f9b3629dea9 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:05:57.431685 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7d3c8-b75d-41dd-9844-2f9b3629dea9 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:05:57.436263 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de36148-8a52-421a-9935-74bb1c4222f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:05:57.436858 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de36148-8a52-421a-9935-74bb1c4222f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:57.437138 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de36148-8a52-421a-9935-74bb1c4222f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:57.437410 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de36148-8a52-421a-9935-74bb1c4222f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:57.438045 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de36148-8a52-421a-9935-74bb1c4222f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:05:57.438388 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de36148-8a52-421a-9935-74bb1c4222f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:05:57.439980 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de36148-8a52-421a-9935-74bb1c4222f9 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:05:57.451752 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1438/2860] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 16:05:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:05:57.455920 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef7473-f03f-4c8e-9265-ba6933877a97 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:05:57.465635 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef7473-f03f-4c8e-9265-ba6933877a97 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:05:57.470376 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b90dc-9fce-477f-b37b-3a68b22aee52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:05:57.470968 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b90dc-9fce-477f-b37b-3a68b22aee52 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:57.471251 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b90dc-9fce-477f-b37b-3a68b22aee52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:57.471526 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b90dc-9fce-477f-b37b-3a68b22aee52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:57.472151 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08b90dc-9fce-477f-b37b-3a68b22aee52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:05:57.474055 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08b90dc-9fce-477f-b37b-3a68b22aee52 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:05:57.503990 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1423/2861] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 16:05:57 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:05:57.505122 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de36148-8a52-421a-9935-74bb1c4222f9 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:05:57.515217 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de36148-8a52-421a-9935-74bb1c4222f9 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:05:57.571628 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571cdc8-8ca4-4217-831f-836325efd122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:05:57.572230 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571cdc8-8ca4-4217-831f-836325efd122 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:57.572517 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571cdc8-8ca4-4217-831f-836325efd122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:57.572788 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571cdc8-8ca4-4217-831f-836325efd122 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:57.573411 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571cdc8-8ca4-4217-831f-836325efd122 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:05:57.575342 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571cdc8-8ca4-4217-831f-836325efd122 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:05:57.597298 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1439/2862] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 16:05:57 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:05:57.601604 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b90dc-9fce-477f-b37b-3a68b22aee52 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:05:57.612816 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b90dc-9fce-477f-b37b-3a68b22aee52 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:05:57.617503 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9feea4d-68a6-41e2-b3f6-d8b9b51200f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:05:57.618259 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9feea4d-68a6-41e2-b3f6-d8b9b51200f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:57.618544 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9feea4d-68a6-41e2-b3f6-d8b9b51200f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:57.618818 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9feea4d-68a6-41e2-b3f6-d8b9b51200f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:57.619483 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9feea4d-68a6-41e2-b3f6-d8b9b51200f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:05:57.621084 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9feea4d-68a6-41e2-b3f6-d8b9b51200f2 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:05:57.630963 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1424/2863] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:05:57.634915 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571cdc8-8ca4-4217-831f-836325efd122 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:05:57.644821 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571cdc8-8ca4-4217-831f-836325efd122 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:05:57.649952 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73450b38-312c-4af7-a28c-7c9539a8300b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:05:57.650578 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73450b38-312c-4af7-a28c-7c9539a8300b admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:57.650859 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73450b38-312c-4af7-a28c-7c9539a8300b admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:57.651132 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73450b38-312c-4af7-a28c-7c9539a8300b admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:57.651762 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73450b38-312c-4af7-a28c-7c9539a8300b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:05:57.653340 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73450b38-312c-4af7-a28c-7c9539a8300b admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:05:57.663792 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1440/2864] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 16:05:57.668616 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9feea4d-68a6-41e2-b3f6-d8b9b51200f2 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:05:57.679129 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9feea4d-68a6-41e2-b3f6-d8b9b51200f2 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:05:57.684133 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd61b73-8bc2-4919-901d-52f5b9f4fcbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:05:57.684782 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd61b73-8bc2-4919-901d-52f5b9f4fcbf admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:57.685062 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd61b73-8bc2-4919-901d-52f5b9f4fcbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:57.685337 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd61b73-8bc2-4919-901d-52f5b9f4fcbf admin admin] PATH_INFO: `/v3/projects/046a0010ecd246e58cb417454aad4d0b/users/2726840087e8438aaba016fd7a462229/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:57.700438 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd61b73-8bc2-4919-901d-52f5b9f4fcbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=046a0010ecd246e58cb417454aad4d0b, user_id=2726840087e8438aaba016fd7a462229, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:05:57.703102 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd61b73-8bc2-4919-901d-52f5b9f4fcbf admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:05:57.715831 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1425/2865] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 16:05:57 2022] PUT /identity/v3/projects/046a0010ecd246e58cb417454aad4d0b/users/2726840087e8438aaba016fd7a462229/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:05:57.728345 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba39588-381a-442f-96e4-4fff2c3ef13d None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:57.728620 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba39588-381a-442f-96e4-4fff2c3ef13d None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:57.728894 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba39588-381a-442f-96e4-4fff2c3ef13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:57.756582 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-3ba39588-381a-442f-96e4-4fff2c3ef13d None None] MFA Rules not processed for user `2726840087e8438aaba016fd7a462229`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:05:57.757795 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-3ba39588-381a-442f-96e4-4fff2c3ef13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:05:57.770726 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:05:57.826074 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1441/2866] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:05:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:05:57.830615 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd61b73-8bc2-4919-901d-52f5b9f4fcbf admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:05:57.848625 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:05:57.894791 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd61b73-8bc2-4919-901d-52f5b9f4fcbf admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:05:57.900610 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4e064-c02f-4687-9c47-29640136fb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:05:57.901153 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4e064-c02f-4687-9c47-29640136fb23 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:57.901438 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4e064-c02f-4687-9c47-29640136fb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:57.901717 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4e064-c02f-4687-9c47-29640136fb23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:57.902376 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4e064-c02f-4687-9c47-29640136fb23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:05:57.904288 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4e064-c02f-4687-9c47-29640136fb23 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:05:57.931148 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1426/2867] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 16:05:57 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:05:57.935218 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba39588-381a-442f-96e4-4fff2c3ef13d None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:05:57.946510 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba39588-381a-442f-96e4-4fff2c3ef13d None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:05:58.003925 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f138ba0-191c-4b9d-b87b-ff0f36dff219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:05:58.004536 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f138ba0-191c-4b9d-b87b-ff0f36dff219 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:58.004818 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f138ba0-191c-4b9d-b87b-ff0f36dff219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:58.005095 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f138ba0-191c-4b9d-b87b-ff0f36dff219 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:58.005756 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f138ba0-191c-4b9d-b87b-ff0f36dff219 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:05:58.007732 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f138ba0-191c-4b9d-b87b-ff0f36dff219 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:05:58.029434 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1442/2868] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 16:05:57 2022] POST /identity/v3/users => generated 296 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:05:58.033553 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4e064-c02f-4687-9c47-29640136fb23 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:05:58.044304 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4e064-c02f-4687-9c47-29640136fb23 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:05:58.048975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef30658-f166-4bad-ab53-3e53bf845211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:05:58.049583 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef30658-f166-4bad-ab53-3e53bf845211 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:58.049865 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef30658-f166-4bad-ab53-3e53bf845211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:58.050140 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef30658-f166-4bad-ab53-3e53bf845211 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:58.050832 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef30658-f166-4bad-ab53-3e53bf845211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:05:58.052439 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef30658-f166-4bad-ab53-3e53bf845211 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:05:58.063164 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1427/2869] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:05:58.067378 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f138ba0-191c-4b9d-b87b-ff0f36dff219 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:05:58.078235 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f138ba0-191c-4b9d-b87b-ff0f36dff219 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:05:58.082979 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcce9dc-0532-4540-96e3-a844d2d83339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:05:58.083636 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcce9dc-0532-4540-96e3-a844d2d83339 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:58.083919 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcce9dc-0532-4540-96e3-a844d2d83339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:58.084201 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcce9dc-0532-4540-96e3-a844d2d83339 admin admin] PATH_INFO: `/v3/projects/d4c7412c006a47cd97ea6d13a986b4ac/users/c18fc7eb222f430489463d4e32293b70/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:58.099318 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcce9dc-0532-4540-96e3-a844d2d83339 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4c7412c006a47cd97ea6d13a986b4ac, user_id=c18fc7eb222f430489463d4e32293b70, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:05:58.102032 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcce9dc-0532-4540-96e3-a844d2d83339 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:05:58.114734 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1443/2870] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 16:05:58 2022] PUT /identity/v3/projects/d4c7412c006a47cd97ea6d13a986b4ac/users/c18fc7eb222f430489463d4e32293b70/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:05:58.119211 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef30658-f166-4bad-ab53-3e53bf845211 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:05:58.129107 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef30658-f166-4bad-ab53-3e53bf845211 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:05:58.185960 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb7d5c-2582-4132-b70c-797092f98f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:05:58.186592 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb7d5c-2582-4132-b70c-797092f98f98 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:58.186875 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb7d5c-2582-4132-b70c-797092f98f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:58.187147 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb7d5c-2582-4132-b70c-797092f98f98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:58.187775 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bb7d5c-2582-4132-b70c-797092f98f98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:05:58.189372 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bb7d5c-2582-4132-b70c-797092f98f98 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:05:58.200912 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1428/2871] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:05:58.205007 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcce9dc-0532-4540-96e3-a844d2d83339 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:05:58.215261 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcce9dc-0532-4540-96e3-a844d2d83339 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:05:58.219945 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ddb278-b555-43a3-a5c5-426762f58ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:05:58.220571 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddb278-b555-43a3-a5c5-426762f58ac7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:58.220858 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddb278-b555-43a3-a5c5-426762f58ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:58.221132 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddb278-b555-43a3-a5c5-426762f58ac7 admin admin] PATH_INFO: `/v3/projects/d4c7412c006a47cd97ea6d13a986b4ac/users/c18fc7eb222f430489463d4e32293b70/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:58.223190 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ddb278-b555-43a3-a5c5-426762f58ac7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4c7412c006a47cd97ea6d13a986b4ac, user_id=c18fc7eb222f430489463d4e32293b70, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:05:58.225806 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ddb278-b555-43a3-a5c5-426762f58ac7 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:05:58.236274 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1444/2872] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 16:05:58 2022] PUT /identity/v3/projects/d4c7412c006a47cd97ea6d13a986b4ac/users/c18fc7eb222f430489463d4e32293b70/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:05:58.246798 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b877c-9151-46d3-8c87-34f5784c0be2 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:58.247264 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b877c-9151-46d3-8c87-34f5784c0be2 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:58.247378 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b877c-9151-46d3-8c87-34f5784c0be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:58.276181 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-141b877c-9151-46d3-8c87-34f5784c0be2 None None] MFA Rules not processed for user `c18fc7eb222f430489463d4e32293b70`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:05:58.277386 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-141b877c-9151-46d3-8c87-34f5784c0be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:05:58.343707 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1429/2873] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:05:58 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:05:58.355000 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ddb278-b555-43a3-a5c5-426762f58ac7 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:05:58.357018 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-a7ddb278-b555-43a3-a5c5-426762f58ac7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:05:58.414947 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ddb278-b555-43a3-a5c5-426762f58ac7 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:05:58.418630 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b7430e-a4a7-4309-bc40-c0d6b0d372e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:05:58.419229 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7430e-a4a7-4309-bc40-c0d6b0d372e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:58.419511 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7430e-a4a7-4309-bc40-c0d6b0d372e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:58.419785 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7430e-a4a7-4309-bc40-c0d6b0d372e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:58.438145 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:05:58.476318 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b7430e-a4a7-4309-bc40-c0d6b0d372e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:05:58.478418 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b7430e-a4a7-4309-bc40-c0d6b0d372e4 service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:05:58.487487 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1445/2874] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:05:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:05:59.844106 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b877c-9151-46d3-8c87-34f5784c0be2 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:05:59.845496 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-141b877c-9151-46d3-8c87-34f5784c0be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:05:59.857625 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b877c-9151-46d3-8c87-34f5784c0be2 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:05:59.861123 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584534bc-71ad-4f82-b2ed-dff8a321ccf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:05:59.861709 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584534bc-71ad-4f82-b2ed-dff8a321ccf5 service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:05:59.861984 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584534bc-71ad-4f82-b2ed-dff8a321ccf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:05:59.862285 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584534bc-71ad-4f82-b2ed-dff8a321ccf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:05:59.871775 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584534bc-71ad-4f82-b2ed-dff8a321ccf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:05:59.873181 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584534bc-71ad-4f82-b2ed-dff8a321ccf5 service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:05:59.876987 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:05:59.885755 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1430/2875] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:05:59 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:06:03.654926 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b7430e-a4a7-4309-bc40-c0d6b0d372e4 service cinder] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:03.719427 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b7430e-a4a7-4309-bc40-c0d6b0d372e4 service cinder] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:03.724042 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ede29-6f2b-45a0-85a5-93168fd13615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:03.724667 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ede29-6f2b-45a0-85a5-93168fd13615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:03.724949 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ede29-6f2b-45a0-85a5-93168fd13615 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:03.725226 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ede29-6f2b-45a0-85a5-93168fd13615 admin admin] PATH_INFO: `/v3/users/2726840087e8438aaba016fd7a462229` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:03.726380 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ede29-6f2b-45a0-85a5-93168fd13615 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2726840087e8438aaba016fd7a462229)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:03.729284 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ede29-6f2b-45a0-85a5-93168fd13615 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:03.777133 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-6f8ede29-6f2b-45a0-85a5-93168fd13615 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2726840087e8438aaba016fd7a462229'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:03.784046 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-6f8ede29-6f2b-45a0-85a5-93168fd13615 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2726840087e8438aaba016fd7a462229'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:03.784666 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-6f8ede29-6f2b-45a0-85a5-93168fd13615 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2726840087e8438aaba016fd7a462229'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:03.796410 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-6f8ede29-6f2b-45a0-85a5-93168fd13615 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2726840087e8438aaba016fd7a462229'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:03.797031 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-6f8ede29-6f2b-45a0-85a5-93168fd13615 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2726840087e8438aaba016fd7a462229'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:03.809049 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1446/2876] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 16:06:03 2022] DELETE /identity/v3/users/2726840087e8438aaba016fd7a462229 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:06:03.813616 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaaec3b-26a7-4b6c-b4f2-2b78bf863224 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:03.814072 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaaec3b-26a7-4b6c-b4f2-2b78bf863224 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:03.814170 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaaec3b-26a7-4b6c-b4f2-2b78bf863224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:03.833630 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-acaaec3b-26a7-4b6c-b4f2-2b78bf863224 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:06:03.834855 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-acaaec3b-26a7-4b6c-b4f2-2b78bf863224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:06:03.894818 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1431/2877] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:06:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:06:03.906350 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ede29-6f2b-45a0-85a5-93168fd13615 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:03.907770 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-6f8ede29-6f2b-45a0-85a5-93168fd13615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:06:03.950980 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:06:03.966383 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ede29-6f2b-45a0-85a5-93168fd13615 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:03.970033 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba918721-da68-4342-96a0-e1473e05f2ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:03.970664 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba918721-da68-4342-96a0-e1473e05f2ef service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:03.970942 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba918721-da68-4342-96a0-e1473e05f2ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:03.971303 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba918721-da68-4342-96a0-e1473e05f2ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:03.980382 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba918721-da68-4342-96a0-e1473e05f2ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:03.982033 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba918721-da68-4342-96a0-e1473e05f2ef service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:03.991428 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1447/2878] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:06:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:06:04.255321 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaaec3b-26a7-4b6c-b4f2-2b78bf863224 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:04.256756 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-acaaec3b-26a7-4b6c-b4f2-2b78bf863224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:06:04.269834 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaaec3b-26a7-4b6c-b4f2-2b78bf863224 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:04.279385 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71374648-da82-4029-86e2-cfd779a8a460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:04.280039 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71374648-da82-4029-86e2-cfd779a8a460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:04.280350 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71374648-da82-4029-86e2-cfd779a8a460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:04.280625 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71374648-da82-4029-86e2-cfd779a8a460 admin admin] PATH_INFO: `/v3/projects/046a0010ecd246e58cb417454aad4d0b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:04.281891 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71374648-da82-4029-86e2-cfd779a8a460 admin admin] RBAC: Authorizing `identity:delete_project(project_id=046a0010ecd246e58cb417454aad4d0b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:04.283900 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71374648-da82-4029-86e2-cfd779a8a460 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:04.330547 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-71374648-da82-4029-86e2-cfd779a8a460 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '046a0010ecd246e58cb417454aad4d0b', 'request_id': 'req-71374648-da82-4029-86e2-cfd779a8a460'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:04.336189 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-71374648-da82-4029-86e2-cfd779a8a460 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '046a0010ecd246e58cb417454aad4d0b', 'request_id': 'req-71374648-da82-4029-86e2-cfd779a8a460'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:04.342425 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-71374648-da82-4029-86e2-cfd779a8a460 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '046a0010ecd246e58cb417454aad4d0b', 'request_id': 'req-71374648-da82-4029-86e2-cfd779a8a460'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:04.354577 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-71374648-da82-4029-86e2-cfd779a8a460 admin admin] The token cache is being invalidate because project 046a0010ecd246e58cb417454aad4d0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:06:04.354864 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-71374648-da82-4029-86e2-cfd779a8a460 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:04.355482 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-71374648-da82-4029-86e2-cfd779a8a460 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:04.357331 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1432/2879] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 16:06:04 2022] DELETE /identity/v3/projects/046a0010ecd246e58cb417454aad4d0b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:06:04.361512 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba918721-da68-4342-96a0-e1473e05f2ef service neutron] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:04.371943 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba918721-da68-4342-96a0-e1473e05f2ef service neutron] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:04.427366 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c2849-1970-4db7-8450-1b6b7cff6c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:04.427988 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c2849-1970-4db7-8450-1b6b7cff6c60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:04.428269 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c2849-1970-4db7-8450-1b6b7cff6c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:04.428545 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c2849-1970-4db7-8450-1b6b7cff6c60 admin admin] PATH_INFO: `/v3/users/c18fc7eb222f430489463d4e32293b70` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:04.429654 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c2849-1970-4db7-8450-1b6b7cff6c60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c18fc7eb222f430489463d4e32293b70)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:04.432212 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c2849-1970-4db7-8450-1b6b7cff6c60 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:04.477488 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-4d9c2849-1970-4db7-8450-1b6b7cff6c60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c18fc7eb222f430489463d4e32293b70'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:04.485442 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-4d9c2849-1970-4db7-8450-1b6b7cff6c60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c18fc7eb222f430489463d4e32293b70'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:04.486057 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-4d9c2849-1970-4db7-8450-1b6b7cff6c60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c18fc7eb222f430489463d4e32293b70'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:04.498881 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-4d9c2849-1970-4db7-8450-1b6b7cff6c60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c18fc7eb222f430489463d4e32293b70'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:04.499527 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-4d9c2849-1970-4db7-8450-1b6b7cff6c60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c18fc7eb222f430489463d4e32293b70'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:04.511547 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1448/2880] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 16:06:04 2022] DELETE /identity/v3/users/c18fc7eb222f430489463d4e32293b70 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:06:04.784858 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71374648-da82-4029-86e2-cfd779a8a460 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:04.786328 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-71374648-da82-4029-86e2-cfd779a8a460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:06:04.799866 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71374648-da82-4029-86e2-cfd779a8a460 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:04.858514 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea526ea6-0e7f-4a4c-a0fa-0ba67373be41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:04.859169 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea526ea6-0e7f-4a4c-a0fa-0ba67373be41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:04.859441 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea526ea6-0e7f-4a4c-a0fa-0ba67373be41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:04.859715 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea526ea6-0e7f-4a4c-a0fa-0ba67373be41 admin admin] PATH_INFO: `/v3/projects/d4c7412c006a47cd97ea6d13a986b4ac` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:04.860825 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea526ea6-0e7f-4a4c-a0fa-0ba67373be41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4c7412c006a47cd97ea6d13a986b4ac)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:04.862763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea526ea6-0e7f-4a4c-a0fa-0ba67373be41 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:04.887525 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:06:04.910606 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-ea526ea6-0e7f-4a4c-a0fa-0ba67373be41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4c7412c006a47cd97ea6d13a986b4ac', 'request_id': 'req-ea526ea6-0e7f-4a4c-a0fa-0ba67373be41'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:04.916763 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-ea526ea6-0e7f-4a4c-a0fa-0ba67373be41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4c7412c006a47cd97ea6d13a986b4ac', 'request_id': 'req-ea526ea6-0e7f-4a4c-a0fa-0ba67373be41'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:04.925780 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-ea526ea6-0e7f-4a4c-a0fa-0ba67373be41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4c7412c006a47cd97ea6d13a986b4ac', 'request_id': 'req-ea526ea6-0e7f-4a4c-a0fa-0ba67373be41'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:04.939952 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-ea526ea6-0e7f-4a4c-a0fa-0ba67373be41 admin admin] The token cache is being invalidate because project d4c7412c006a47cd97ea6d13a986b4ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:06:04.940240 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-ea526ea6-0e7f-4a4c-a0fa-0ba67373be41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:04.940862 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-ea526ea6-0e7f-4a4c-a0fa-0ba67373be41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:04.942423 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1433/2881] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 16:06:04 2022] DELETE /identity/v3/projects/d4c7412c006a47cd97ea6d13a986b4ac => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:06:04.947500 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdd191-a7bc-4e55-89dd-61bbba9cf0b3 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:04.947983 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdd191-a7bc-4e55-89dd-61bbba9cf0b3 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:04.948105 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdd191-a7bc-4e55-89dd-61bbba9cf0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:04.968830 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-80fdd191-a7bc-4e55-89dd-61bbba9cf0b3 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:06:04.970059 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-80fdd191-a7bc-4e55-89dd-61bbba9cf0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:06:05.028377 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1449/2882] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:06:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:06:05.036356 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c93566-42d3-4b40-8c7b-dd6fc09d266d None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:05.036651 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c93566-42d3-4b40-8c7b-dd6fc09d266d None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:05.036933 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c93566-42d3-4b40-8c7b-dd6fc09d266d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:05.057303 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-d4c93566-42d3-4b40-8c7b-dd6fc09d266d None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:06:05.058563 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-d4c93566-42d3-4b40-8c7b-dd6fc09d266d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:06:05.066487 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1434/2883] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:06:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:06:05.070860 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fdd191-a7bc-4e55-89dd-61bbba9cf0b3 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:05.075726 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:06:05.081760 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fdd191-a7bc-4e55-89dd-61bbba9cf0b3 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:05.088010 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ffb27b-c353-4b55-8a24-a73eac505394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:05.088679 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffb27b-c353-4b55-8a24-a73eac505394 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:05.088982 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffb27b-c353-4b55-8a24-a73eac505394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:05.089243 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffb27b-c353-4b55-8a24-a73eac505394 admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:05.089887 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ffb27b-c353-4b55-8a24-a73eac505394 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:06:05.090220 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ffb27b-c353-4b55-8a24-a73eac505394 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:05.091872 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ffb27b-c353-4b55-8a24-a73eac505394 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:05.104444 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1450/2884] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 16:06:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:06:05.108948 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c93566-42d3-4b40-8c7b-dd6fc09d266d None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:05.118108 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c93566-42d3-4b40-8c7b-dd6fc09d266d None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:05.122834 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567eed1-577d-40bc-9350-3a1ae62789e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:05.123422 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567eed1-577d-40bc-9350-3a1ae62789e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:05.123702 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567eed1-577d-40bc-9350-3a1ae62789e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:05.123975 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567eed1-577d-40bc-9350-3a1ae62789e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:05.124604 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3567eed1-577d-40bc-9350-3a1ae62789e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:05.126577 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3567eed1-577d-40bc-9350-3a1ae62789e6 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:05.162728 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1435/2885] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 16:06:05 2022] POST /identity/v3/projects => generated 367 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:06:05.167809 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ffb27b-c353-4b55-8a24-a73eac505394 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:05.177661 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ffb27b-c353-4b55-8a24-a73eac505394 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:05.233382 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b0e16f-51e7-49f1-97d3-500b32a155fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:05.233983 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0e16f-51e7-49f1-97d3-500b32a155fe admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:05.234292 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0e16f-51e7-49f1-97d3-500b32a155fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:05.234572 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0e16f-51e7-49f1-97d3-500b32a155fe admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:05.235203 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b0e16f-51e7-49f1-97d3-500b32a155fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:05.237104 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b0e16f-51e7-49f1-97d3-500b32a155fe admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:05.261482 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1451/2886] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 16:06:05 2022] POST /identity/v3/users => generated 284 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:06:05.263216 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567eed1-577d-40bc-9350-3a1ae62789e6 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:05.273622 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567eed1-577d-40bc-9350-3a1ae62789e6 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:05.279031 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4172cf-40df-4062-91f9-fb2ae1a89f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:05.279572 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4172cf-40df-4062-91f9-fb2ae1a89f75 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:05.279856 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4172cf-40df-4062-91f9-fb2ae1a89f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:05.280134 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4172cf-40df-4062-91f9-fb2ae1a89f75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:05.280771 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4172cf-40df-4062-91f9-fb2ae1a89f75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:05.282422 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4172cf-40df-4062-91f9-fb2ae1a89f75 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:05.292561 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1436/2887] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:06:05.296458 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b0e16f-51e7-49f1-97d3-500b32a155fe admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:05.306537 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b0e16f-51e7-49f1-97d3-500b32a155fe admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:05.311170 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5b662-e37a-4fbe-ad9b-c4ac5cb7c9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:05.311760 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5b662-e37a-4fbe-ad9b-c4ac5cb7c9fb admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:05.312038 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5b662-e37a-4fbe-ad9b-c4ac5cb7c9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:05.312311 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5b662-e37a-4fbe-ad9b-c4ac5cb7c9fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:05.312935 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c5b662-e37a-4fbe-ad9b-c4ac5cb7c9fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:05.314567 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c5b662-e37a-4fbe-ad9b-c4ac5cb7c9fb admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:05.326109 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1452/2888] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:06:05.330034 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4172cf-40df-4062-91f9-fb2ae1a89f75 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:05.340709 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4172cf-40df-4062-91f9-fb2ae1a89f75 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:05.345336 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453a57a-d231-40ab-9453-c0d1b83012f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:05.345971 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453a57a-d231-40ab-9453-c0d1b83012f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:05.346288 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453a57a-d231-40ab-9453-c0d1b83012f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:05.346568 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453a57a-d231-40ab-9453-c0d1b83012f2 admin admin] PATH_INFO: `/v3/projects/55b50e76493d4d2589563d584845c5e6/users/b382acef7ad14a3889a1399453e5a7a0/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:05.361670 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7453a57a-d231-40ab-9453-c0d1b83012f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55b50e76493d4d2589563d584845c5e6, user_id=b382acef7ad14a3889a1399453e5a7a0, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:05.364970 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7453a57a-d231-40ab-9453-c0d1b83012f2 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:05.377574 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1437/2889] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 16:06:05 2022] PUT /identity/v3/projects/55b50e76493d4d2589563d584845c5e6/users/b382acef7ad14a3889a1399453e5a7a0/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:06:05.441180 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84ea2d-115c-4d28-addd-e0fe79e1e2ca None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:05.441466 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84ea2d-115c-4d28-addd-e0fe79e1e2ca None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:05.441776 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84ea2d-115c-4d28-addd-e0fe79e1e2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:05.471292 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-4a84ea2d-115c-4d28-addd-e0fe79e1e2ca None None] MFA Rules not processed for user `b382acef7ad14a3889a1399453e5a7a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:06:05.472497 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-4a84ea2d-115c-4d28-addd-e0fe79e1e2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:06:05.536424 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1453/2890] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:06:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:06:05.541036 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453a57a-d231-40ab-9453-c0d1b83012f2 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:05.604309 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453a57a-d231-40ab-9453-c0d1b83012f2 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:05.609140 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ab9dd-d349-454e-8d78-01fbdca2ebd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:05.609753 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ab9dd-d349-454e-8d78-01fbdca2ebd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:05.610031 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ab9dd-d349-454e-8d78-01fbdca2ebd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:05.610337 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ab9dd-d349-454e-8d78-01fbdca2ebd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:05.610965 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1ab9dd-d349-454e-8d78-01fbdca2ebd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:05.612847 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1ab9dd-d349-454e-8d78-01fbdca2ebd5 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:05.639446 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1438/2891] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 16:06:05 2022] POST /identity/v3/projects => generated 365 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:06:05.643659 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84ea2d-115c-4d28-addd-e0fe79e1e2ca None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:05.654337 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84ea2d-115c-4d28-addd-e0fe79e1e2ca None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:05.704038 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:06:05.710850 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6294c867-47ea-4e6e-a691-bc7bb97eb610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:05.711745 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294c867-47ea-4e6e-a691-bc7bb97eb610 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:05.712027 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294c867-47ea-4e6e-a691-bc7bb97eb610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:05.712320 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294c867-47ea-4e6e-a691-bc7bb97eb610 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:05.712934 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6294c867-47ea-4e6e-a691-bc7bb97eb610 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:05.714880 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6294c867-47ea-4e6e-a691-bc7bb97eb610 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:05.735873 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1454/2892] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 16:06:05 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:06:05.739833 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ab9dd-d349-454e-8d78-01fbdca2ebd5 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:05.750616 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ab9dd-d349-454e-8d78-01fbdca2ebd5 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:05.755424 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b74cc-4f79-497c-929b-ce6ada33bb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:05.756036 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b74cc-4f79-497c-929b-ce6ada33bb6f admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:05.756317 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b74cc-4f79-497c-929b-ce6ada33bb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:05.756587 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b74cc-4f79-497c-929b-ce6ada33bb6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:05.757220 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267b74cc-4f79-497c-929b-ce6ada33bb6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:05.758863 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267b74cc-4f79-497c-929b-ce6ada33bb6f admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:05.770204 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1439/2893] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:06:05.774256 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6294c867-47ea-4e6e-a691-bc7bb97eb610 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:05.784455 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6294c867-47ea-4e6e-a691-bc7bb97eb610 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:05.789303 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44202655-fc68-4d22-842e-5f8109880d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:05.789893 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44202655-fc68-4d22-842e-5f8109880d57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:05.790284 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44202655-fc68-4d22-842e-5f8109880d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:05.790595 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44202655-fc68-4d22-842e-5f8109880d57 admin admin] PATH_INFO: `/v3/projects/1bba332c1fe24b15beaab7c1a5dbd8aa/users/58e2da42cba3495fa603b71819e0c970/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:05.807363 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44202655-fc68-4d22-842e-5f8109880d57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bba332c1fe24b15beaab7c1a5dbd8aa, user_id=58e2da42cba3495fa603b71819e0c970, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:05.810002 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44202655-fc68-4d22-842e-5f8109880d57 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:05.823412 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1455/2894] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 16:06:05 2022] PUT /identity/v3/projects/1bba332c1fe24b15beaab7c1a5dbd8aa/users/58e2da42cba3495fa603b71819e0c970/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:06:05.827476 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b74cc-4f79-497c-929b-ce6ada33bb6f admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:05.837692 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b74cc-4f79-497c-929b-ce6ada33bb6f admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:05.846833 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:06:05.901181 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccd69a1-31e1-4f9a-a1a7-df1c23aa9cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:05.901852 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd69a1-31e1-4f9a-a1a7-df1c23aa9cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:05.902056 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd69a1-31e1-4f9a-a1a7-df1c23aa9cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:05.902364 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd69a1-31e1-4f9a-a1a7-df1c23aa9cd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:05.903003 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccd69a1-31e1-4f9a-a1a7-df1c23aa9cd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:05.904601 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccd69a1-31e1-4f9a-a1a7-df1c23aa9cd1 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:05.914502 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1440/2895] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:06:05.918782 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44202655-fc68-4d22-842e-5f8109880d57 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:05.928989 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44202655-fc68-4d22-842e-5f8109880d57 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:05.934400 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5726758a-2462-4b4e-aa02-8aeaecef3176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:05.935052 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726758a-2462-4b4e-aa02-8aeaecef3176 admin admin] REQUEST_METHOD: `PUT` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:05.935334 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726758a-2462-4b4e-aa02-8aeaecef3176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:05.935610 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726758a-2462-4b4e-aa02-8aeaecef3176 admin admin] PATH_INFO: `/v3/projects/1bba332c1fe24b15beaab7c1a5dbd8aa/users/58e2da42cba3495fa603b71819e0c970/roles/61605ebf17e643258730e55bf6db15ad` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:05.937520 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5726758a-2462-4b4e-aa02-8aeaecef3176 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bba332c1fe24b15beaab7c1a5dbd8aa, user_id=58e2da42cba3495fa603b71819e0c970, role_id=61605ebf17e643258730e55bf6db15ad)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:05.940175 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5726758a-2462-4b4e-aa02-8aeaecef3176 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:05.951014 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1456/2896] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 16:06:05 2022] PUT /identity/v3/projects/1bba332c1fe24b15beaab7c1a5dbd8aa/users/58e2da42cba3495fa603b71819e0c970/roles/61605ebf17e643258730e55bf6db15ad => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:06:05.960753 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89183a12-0c7d-4902-bbe7-c75edcf5c8e6 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:05.961042 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89183a12-0c7d-4902-bbe7-c75edcf5c8e6 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:05.961314 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89183a12-0c7d-4902-bbe7-c75edcf5c8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:05.989393 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-89183a12-0c7d-4902-bbe7-c75edcf5c8e6 None None] MFA Rules not processed for user `58e2da42cba3495fa603b71819e0c970`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:06:05.990664 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-89183a12-0c7d-4902-bbe7-c75edcf5c8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:06:06.058879 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1441/2897] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:06:05 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:06:06.069880 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5726758a-2462-4b4e-aa02-8aeaecef3176 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:06.071625 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-5726758a-2462-4b4e-aa02-8aeaecef3176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:06:06.129347 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5726758a-2462-4b4e-aa02-8aeaecef3176 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:06.133083 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2a87d-75fa-4916-ba19-89007c138efc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:06.133712 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2a87d-75fa-4916-ba19-89007c138efc service cinder] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:06.134072 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2a87d-75fa-4916-ba19-89007c138efc service cinder] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:06.134545 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2a87d-75fa-4916-ba19-89007c138efc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:06.143557 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2a87d-75fa-4916-ba19-89007c138efc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:06.144979 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2a87d-75fa-4916-ba19-89007c138efc service cinder] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:06.154540 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1457/2898] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:06:06 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:06:06.245022 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89183a12-0c7d-4902-bbe7-c75edcf5c8e6 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:06.255457 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89183a12-0c7d-4902-bbe7-c75edcf5c8e6 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:06.259969 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d4d4ed-9176-46f4-831c-a2247178cc4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:06.260581 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4d4ed-9176-46f4-831c-a2247178cc4f service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:06.260867 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4d4ed-9176-46f4-831c-a2247178cc4f service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:06.261128 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4d4ed-9176-46f4-831c-a2247178cc4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:06.319895 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d4d4ed-9176-46f4-831c-a2247178cc4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:06.321256 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d4d4ed-9176-46f4-831c-a2247178cc4f service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:06.330544 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1442/2899] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:06:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:06:11.049948 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2a87d-75fa-4916-ba19-89007c138efc service cinder] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:11.113413 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2a87d-75fa-4916-ba19-89007c138efc service cinder] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:11.118028 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903e582-ef10-4902-b20e-c3ae2f3ce42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:11.118927 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903e582-ef10-4902-b20e-c3ae2f3ce42c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:11.119214 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903e582-ef10-4902-b20e-c3ae2f3ce42c admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:11.119490 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903e582-ef10-4902-b20e-c3ae2f3ce42c admin admin] PATH_INFO: `/v3/users/b382acef7ad14a3889a1399453e5a7a0` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:11.120708 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a903e582-ef10-4902-b20e-c3ae2f3ce42c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b382acef7ad14a3889a1399453e5a7a0)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:11.122656 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a903e582-ef10-4902-b20e-c3ae2f3ce42c admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:11.168892 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-a903e582-ef10-4902-b20e-c3ae2f3ce42c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b382acef7ad14a3889a1399453e5a7a0'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:11.175763 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-a903e582-ef10-4902-b20e-c3ae2f3ce42c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b382acef7ad14a3889a1399453e5a7a0'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:11.176431 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-a903e582-ef10-4902-b20e-c3ae2f3ce42c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b382acef7ad14a3889a1399453e5a7a0'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:11.177578 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=86,keystone:INSERT=6,keystone:DELETE=8 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:06:11.191509 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-a903e582-ef10-4902-b20e-c3ae2f3ce42c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b382acef7ad14a3889a1399453e5a7a0'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:11.192164 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-a903e582-ef10-4902-b20e-c3ae2f3ce42c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b382acef7ad14a3889a1399453e5a7a0'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:11.204358 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1458/2900] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 16:06:11 2022] DELETE /identity/v3/users/b382acef7ad14a3889a1399453e5a7a0 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:06:11.209037 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de698bd2-0f51-4ac4-a5b5-f54eb6b608fa None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:11.209507 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de698bd2-0f51-4ac4-a5b5-f54eb6b608fa None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:11.209634 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de698bd2-0f51-4ac4-a5b5-f54eb6b608fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:11.229679 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-de698bd2-0f51-4ac4-a5b5-f54eb6b608fa None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:06:11.231218 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-de698bd2-0f51-4ac4-a5b5-f54eb6b608fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:06:11.261314 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:06:11.299468 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1443/2901] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:06:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:06:11.309226 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903e582-ef10-4902-b20e-c3ae2f3ce42c admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:11.310661 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-a903e582-ef10-4902-b20e-c3ae2f3ce42c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:06:11.369220 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903e582-ef10-4902-b20e-c3ae2f3ce42c admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:11.372897 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b4b61-c92a-423b-b437-32bf633314e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:11.373496 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b4b61-c92a-423b-b437-32bf633314e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:11.373777 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b4b61-c92a-423b-b437-32bf633314e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:11.374051 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b4b61-c92a-423b-b437-32bf633314e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:11.383004 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b4b61-c92a-423b-b437-32bf633314e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:11.385099 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b4b61-c92a-423b-b437-32bf633314e3 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:11.394416 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1459/2902] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:06:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:06:11.678581 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de698bd2-0f51-4ac4-a5b5-f54eb6b608fa None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:11.680031 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-de698bd2-0f51-4ac4-a5b5-f54eb6b608fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:06:11.694993 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de698bd2-0f51-4ac4-a5b5-f54eb6b608fa None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:11.700919 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c05c6-5bd3-428a-afbc-46dd5b992195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:11.701696 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c05c6-5bd3-428a-afbc-46dd5b992195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:11.702068 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c05c6-5bd3-428a-afbc-46dd5b992195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:11.702999 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c05c6-5bd3-428a-afbc-46dd5b992195 admin admin] PATH_INFO: `/v3/projects/55b50e76493d4d2589563d584845c5e6` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:11.704444 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c05c6-5bd3-428a-afbc-46dd5b992195 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55b50e76493d4d2589563d584845c5e6)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:11.706869 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c05c6-5bd3-428a-afbc-46dd5b992195 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:11.753494 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-c74c05c6-5bd3-428a-afbc-46dd5b992195 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55b50e76493d4d2589563d584845c5e6', 'request_id': 'req-c74c05c6-5bd3-428a-afbc-46dd5b992195'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:11.759709 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-c74c05c6-5bd3-428a-afbc-46dd5b992195 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55b50e76493d4d2589563d584845c5e6', 'request_id': 'req-c74c05c6-5bd3-428a-afbc-46dd5b992195'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:11.765906 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-c74c05c6-5bd3-428a-afbc-46dd5b992195 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55b50e76493d4d2589563d584845c5e6', 'request_id': 'req-c74c05c6-5bd3-428a-afbc-46dd5b992195'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:11.778501 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-c74c05c6-5bd3-428a-afbc-46dd5b992195 admin admin] The token cache is being invalidate because project 55b50e76493d4d2589563d584845c5e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:06:11.778794 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-c74c05c6-5bd3-428a-afbc-46dd5b992195 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:11.779438 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-c74c05c6-5bd3-428a-afbc-46dd5b992195 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:11.780935 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1444/2903] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 16:06:11 2022] DELETE /identity/v3/projects/55b50e76493d4d2589563d584845c5e6 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:06:11.784841 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b4b61-c92a-423b-b437-32bf633314e3 service neutron] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:11.794542 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b4b61-c92a-423b-b437-32bf633314e3 service neutron] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:11.852302 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7e677-48a4-4d95-954b-f1071ccd9c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:11.852926 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7e677-48a4-4d95-954b-f1071ccd9c80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:11.853206 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7e677-48a4-4d95-954b-f1071ccd9c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:11.853471 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7e677-48a4-4d95-954b-f1071ccd9c80 admin admin] PATH_INFO: `/v3/users/58e2da42cba3495fa603b71819e0c970` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:11.854609 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7e677-48a4-4d95-954b-f1071ccd9c80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58e2da42cba3495fa603b71819e0c970)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:11.856763 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7e677-48a4-4d95-954b-f1071ccd9c80 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:11.903259 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-b8a7e677-48a4-4d95-954b-f1071ccd9c80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58e2da42cba3495fa603b71819e0c970'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:11.915429 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-b8a7e677-48a4-4d95-954b-f1071ccd9c80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58e2da42cba3495fa603b71819e0c970'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:11.916079 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-b8a7e677-48a4-4d95-954b-f1071ccd9c80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58e2da42cba3495fa603b71819e0c970'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:11.928076 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-b8a7e677-48a4-4d95-954b-f1071ccd9c80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58e2da42cba3495fa603b71819e0c970'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:11.928730 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-b8a7e677-48a4-4d95-954b-f1071ccd9c80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58e2da42cba3495fa603b71819e0c970'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:11.934976 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:06:11.945446 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1460/2904] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 16:06:11 2022] DELETE /identity/v3/users/58e2da42cba3495fa603b71819e0c970 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:06:12.214374 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c05c6-5bd3-428a-afbc-46dd5b992195 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:12.215849 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-c74c05c6-5bd3-428a-afbc-46dd5b992195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:06:12.231450 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c05c6-5bd3-428a-afbc-46dd5b992195 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:12.289571 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb11063-6e20-42a2-b160-bdddd17fcfa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:12.290733 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb11063-6e20-42a2-b160-bdddd17fcfa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:12.291012 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb11063-6e20-42a2-b160-bdddd17fcfa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:12.291288 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb11063-6e20-42a2-b160-bdddd17fcfa6 admin admin] PATH_INFO: `/v3/projects/1bba332c1fe24b15beaab7c1a5dbd8aa` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:12.292413 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb11063-6e20-42a2-b160-bdddd17fcfa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bba332c1fe24b15beaab7c1a5dbd8aa)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:12.294361 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb11063-6e20-42a2-b160-bdddd17fcfa6 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:12.341666 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-5eb11063-6e20-42a2-b160-bdddd17fcfa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bba332c1fe24b15beaab7c1a5dbd8aa', 'request_id': 'req-5eb11063-6e20-42a2-b160-bdddd17fcfa6'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:12.347104 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-5eb11063-6e20-42a2-b160-bdddd17fcfa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bba332c1fe24b15beaab7c1a5dbd8aa', 'request_id': 'req-5eb11063-6e20-42a2-b160-bdddd17fcfa6'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:12.348225 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:06:12.355240 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-5eb11063-6e20-42a2-b160-bdddd17fcfa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bba332c1fe24b15beaab7c1a5dbd8aa', 'request_id': 'req-5eb11063-6e20-42a2-b160-bdddd17fcfa6'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:12.367889 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-5eb11063-6e20-42a2-b160-bdddd17fcfa6 admin admin] The token cache is being invalidate because project 1bba332c1fe24b15beaab7c1a5dbd8aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:06:12.368209 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-5eb11063-6e20-42a2-b160-bdddd17fcfa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:12.369011 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-5eb11063-6e20-42a2-b160-bdddd17fcfa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:12.370529 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1445/2905] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 16:06:12 2022] DELETE /identity/v3/projects/1bba332c1fe24b15beaab7c1a5dbd8aa => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:06:12.375548 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c1a79-ceee-4b04-99df-5f53b6657bf0 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:12.376025 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c1a79-ceee-4b04-99df-5f53b6657bf0 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:12.376155 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c1a79-ceee-4b04-99df-5f53b6657bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:12.395327 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-1c5c1a79-ceee-4b04-99df-5f53b6657bf0 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:06:12.396532 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-1c5c1a79-ceee-4b04-99df-5f53b6657bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:06:12.453584 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1461/2906] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:06:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:06:12.461467 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d4568-c573-4033-b58f-1e2c0f28c66a None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:12.461692 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d4568-c573-4033-b58f-1e2c0f28c66a None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:12.462608 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d4568-c573-4033-b58f-1e2c0f28c66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:12.482946 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-929d4568-c573-4033-b58f-1e2c0f28c66a None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:06:12.484124 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-929d4568-c573-4033-b58f-1e2c0f28c66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:06:12.491876 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1446/2907] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:06:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:06:12.495981 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c1a79-ceee-4b04-99df-5f53b6657bf0 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:12.505536 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c1a79-ceee-4b04-99df-5f53b6657bf0 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:12.510190 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4419d8-7aae-4ccf-ab84-c390a8650f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:12.510790 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4419d8-7aae-4ccf-ab84-c390a8650f5f admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:12.511071 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4419d8-7aae-4ccf-ab84-c390a8650f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:12.511341 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4419d8-7aae-4ccf-ab84-c390a8650f5f admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:12.513046 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4419d8-7aae-4ccf-ab84-c390a8650f5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:06:12.513362 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4419d8-7aae-4ccf-ab84-c390a8650f5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:12.515030 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4419d8-7aae-4ccf-ab84-c390a8650f5f admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:12.527405 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1462/2908] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 16:06:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:06:12.531861 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d4568-c573-4033-b58f-1e2c0f28c66a None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:12.542406 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d4568-c573-4033-b58f-1e2c0f28c66a None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:12.547049 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f64ab8-8333-46dc-9d41-0bd86698482e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:12.547633 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f64ab8-8333-46dc-9d41-0bd86698482e admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:12.547911 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f64ab8-8333-46dc-9d41-0bd86698482e admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:12.548182 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f64ab8-8333-46dc-9d41-0bd86698482e admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:12.548808 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f64ab8-8333-46dc-9d41-0bd86698482e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:12.550737 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f64ab8-8333-46dc-9d41-0bd86698482e admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:12.577956 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1447/2909] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 16:06:12 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:06:12.582168 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4419d8-7aae-4ccf-ab84-c390a8650f5f admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:12.592743 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4419d8-7aae-4ccf-ab84-c390a8650f5f admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:12.647858 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da3a79-be5f-428f-8c17-a23991e1c8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:12.648456 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da3a79-be5f-428f-8c17-a23991e1c8df admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:12.648738 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da3a79-be5f-428f-8c17-a23991e1c8df admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:12.649012 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da3a79-be5f-428f-8c17-a23991e1c8df admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:12.650171 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0da3a79-be5f-428f-8c17-a23991e1c8df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:12.652122 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0da3a79-be5f-428f-8c17-a23991e1c8df admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:12.673592 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1463/2910] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 16:06:12 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:06:12.677708 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f64ab8-8333-46dc-9d41-0bd86698482e admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:12.688525 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f64ab8-8333-46dc-9d41-0bd86698482e admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:12.693144 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d10561-bc2f-412b-87e8-8e48d8ee9c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:12.693739 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d10561-bc2f-412b-87e8-8e48d8ee9c2b admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:12.694020 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d10561-bc2f-412b-87e8-8e48d8ee9c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:12.694326 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d10561-bc2f-412b-87e8-8e48d8ee9c2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:12.694962 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d10561-bc2f-412b-87e8-8e48d8ee9c2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:12.696674 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d10561-bc2f-412b-87e8-8e48d8ee9c2b admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:12.706587 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1448/2911] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:06:12.710347 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da3a79-be5f-428f-8c17-a23991e1c8df admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:12.720787 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da3a79-be5f-428f-8c17-a23991e1c8df admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:12.725564 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d887e28-c643-4633-a483-4e55e062cd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:12.726158 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d887e28-c643-4633-a483-4e55e062cd9b admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:12.726494 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d887e28-c643-4633-a483-4e55e062cd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:12.726767 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d887e28-c643-4633-a483-4e55e062cd9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:12.727450 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d887e28-c643-4633-a483-4e55e062cd9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:12.729769 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d887e28-c643-4633-a483-4e55e062cd9b admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:12.740513 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1464/2912] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:06:12.744583 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d10561-bc2f-412b-87e8-8e48d8ee9c2b admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:12.754531 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d10561-bc2f-412b-87e8-8e48d8ee9c2b admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:12.759802 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56923f-ed91-4058-8d9c-66b6b5e99702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:12.760443 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56923f-ed91-4058-8d9c-66b6b5e99702 admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:12.760721 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56923f-ed91-4058-8d9c-66b6b5e99702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:12.760993 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56923f-ed91-4058-8d9c-66b6b5e99702 admin admin] PATH_INFO: `/v3/projects/452c04b0a103492bba7916aba2a4da5f/users/6bc7bf33e15f4be9aaf9c0f5ab3fec2d/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:12.777105 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e56923f-ed91-4058-8d9c-66b6b5e99702 admin admin] RBAC: Authorizing `identity:create_grant(project_id=452c04b0a103492bba7916aba2a4da5f, user_id=6bc7bf33e15f4be9aaf9c0f5ab3fec2d, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:12.779769 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e56923f-ed91-4058-8d9c-66b6b5e99702 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:12.792688 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1449/2913] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 16:06:12 2022] PUT /identity/v3/projects/452c04b0a103492bba7916aba2a4da5f/users/6bc7bf33e15f4be9aaf9c0f5ab3fec2d/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:06:12.804106 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89374f-d117-4084-84d3-1f3949a34479 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:12.804395 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89374f-d117-4084-84d3-1f3949a34479 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:12.804674 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89374f-d117-4084-84d3-1f3949a34479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:12.833877 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-8b89374f-d117-4084-84d3-1f3949a34479 None None] MFA Rules not processed for user `6bc7bf33e15f4be9aaf9c0f5ab3fec2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:06:12.835113 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-8b89374f-d117-4084-84d3-1f3949a34479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:06:12.881273 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:06:12.900573 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1465/2914] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:06:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:06:12.912057 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56923f-ed91-4058-8d9c-66b6b5e99702 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:12.913764 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-2e56923f-ed91-4058-8d9c-66b6b5e99702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:06:12.971290 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56923f-ed91-4058-8d9c-66b6b5e99702 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:12.974881 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fde307-69c3-4338-aa2b-1f2750651b85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:12.975483 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fde307-69c3-4338-aa2b-1f2750651b85 service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:12.975764 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fde307-69c3-4338-aa2b-1f2750651b85 service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:12.976039 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fde307-69c3-4338-aa2b-1f2750651b85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:12.984552 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fde307-69c3-4338-aa2b-1f2750651b85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:12.985980 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fde307-69c3-4338-aa2b-1f2750651b85 service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:12.994965 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1450/2915] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:06:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:06:22.896941 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=5 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:06:22.990765 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=57,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:06:24.425866 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b89374f-d117-4084-84d3-1f3949a34479 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:24.489457 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b89374f-d117-4084-84d3-1f3949a34479 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:24.494008 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85334c01-3bd3-4eb1-9567-0f23494c2116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:24.494649 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85334c01-3bd3-4eb1-9567-0f23494c2116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:24.494927 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85334c01-3bd3-4eb1-9567-0f23494c2116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:24.495200 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85334c01-3bd3-4eb1-9567-0f23494c2116 admin admin] PATH_INFO: `/v3/users/6bc7bf33e15f4be9aaf9c0f5ab3fec2d` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:24.496315 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85334c01-3bd3-4eb1-9567-0f23494c2116 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bc7bf33e15f4be9aaf9c0f5ab3fec2d)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:24.498253 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85334c01-3bd3-4eb1-9567-0f23494c2116 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:24.545255 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-85334c01-3bd3-4eb1-9567-0f23494c2116 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bc7bf33e15f4be9aaf9c0f5ab3fec2d'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:24.552561 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-85334c01-3bd3-4eb1-9567-0f23494c2116 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bc7bf33e15f4be9aaf9c0f5ab3fec2d'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:24.553339 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-85334c01-3bd3-4eb1-9567-0f23494c2116 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bc7bf33e15f4be9aaf9c0f5ab3fec2d'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:24.567019 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-85334c01-3bd3-4eb1-9567-0f23494c2116 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bc7bf33e15f4be9aaf9c0f5ab3fec2d'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:24.567695 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-85334c01-3bd3-4eb1-9567-0f23494c2116 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bc7bf33e15f4be9aaf9c0f5ab3fec2d'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:24.580762 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1466/2916] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 16:06:24 2022] DELETE /identity/v3/users/6bc7bf33e15f4be9aaf9c0f5ab3fec2d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:06:24.585353 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77179a0c-e60e-43be-8a19-a42692463049 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:24.585861 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77179a0c-e60e-43be-8a19-a42692463049 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:24.585982 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77179a0c-e60e-43be-8a19-a42692463049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:24.606372 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-77179a0c-e60e-43be-8a19-a42692463049 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:06:24.607567 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-77179a0c-e60e-43be-8a19-a42692463049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:06:24.664424 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1451/2917] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:06:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:06:24.674854 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85334c01-3bd3-4eb1-9567-0f23494c2116 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:24.676284 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-85334c01-3bd3-4eb1-9567-0f23494c2116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:06:24.734673 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85334c01-3bd3-4eb1-9567-0f23494c2116 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:24.738434 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd2805f-d482-4f34-9b6e-3c69808148c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:24.739040 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2805f-d482-4f34-9b6e-3c69808148c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:24.739324 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2805f-d482-4f34-9b6e-3c69808148c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:24.739600 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2805f-d482-4f34-9b6e-3c69808148c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:24.748981 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd2805f-d482-4f34-9b6e-3c69808148c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:24.750452 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd2805f-d482-4f34-9b6e-3c69808148c9 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:24.759811 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1467/2918] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:06:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:06:25.025248 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77179a0c-e60e-43be-8a19-a42692463049 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:25.027376 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-77179a0c-e60e-43be-8a19-a42692463049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:06:25.045162 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77179a0c-e60e-43be-8a19-a42692463049 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:25.049825 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edacf9df-3e2b-4f5e-aa9a-1e57e3cfec31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:25.050486 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edacf9df-3e2b-4f5e-aa9a-1e57e3cfec31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:25.050771 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edacf9df-3e2b-4f5e-aa9a-1e57e3cfec31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:25.051046 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edacf9df-3e2b-4f5e-aa9a-1e57e3cfec31 admin admin] PATH_INFO: `/v3/projects/452c04b0a103492bba7916aba2a4da5f` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:25.052160 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edacf9df-3e2b-4f5e-aa9a-1e57e3cfec31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=452c04b0a103492bba7916aba2a4da5f)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:25.054245 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edacf9df-3e2b-4f5e-aa9a-1e57e3cfec31 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:25.101434 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-edacf9df-3e2b-4f5e-aa9a-1e57e3cfec31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '452c04b0a103492bba7916aba2a4da5f', 'request_id': 'req-edacf9df-3e2b-4f5e-aa9a-1e57e3cfec31'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:25.107155 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-edacf9df-3e2b-4f5e-aa9a-1e57e3cfec31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '452c04b0a103492bba7916aba2a4da5f', 'request_id': 'req-edacf9df-3e2b-4f5e-aa9a-1e57e3cfec31'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:25.113036 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-edacf9df-3e2b-4f5e-aa9a-1e57e3cfec31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '452c04b0a103492bba7916aba2a4da5f', 'request_id': 'req-edacf9df-3e2b-4f5e-aa9a-1e57e3cfec31'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:25.126328 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-edacf9df-3e2b-4f5e-aa9a-1e57e3cfec31 admin admin] The token cache is being invalidate because project 452c04b0a103492bba7916aba2a4da5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:06:25.126613 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-edacf9df-3e2b-4f5e-aa9a-1e57e3cfec31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:25.127236 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-edacf9df-3e2b-4f5e-aa9a-1e57e3cfec31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:25.128736 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1452/2919] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 16:06:25 2022] DELETE /identity/v3/projects/452c04b0a103492bba7916aba2a4da5f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:06:25.134595 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54abbc7-8b0b-4a46-aa9e-98dfda0b3501 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:25.134889 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54abbc7-8b0b-4a46-aa9e-98dfda0b3501 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:25.135760 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54abbc7-8b0b-4a46-aa9e-98dfda0b3501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:25.155136 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-b54abbc7-8b0b-4a46-aa9e-98dfda0b3501 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:06:25.156336 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-b54abbc7-8b0b-4a46-aa9e-98dfda0b3501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:06:25.173297 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:06:25.218880 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1468/2920] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:06:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:06:25.226723 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0cf654-8a3c-4403-a373-e138e29dfb76 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:25.227008 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0cf654-8a3c-4403-a373-e138e29dfb76 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:25.227278 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0cf654-8a3c-4403-a373-e138e29dfb76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:25.247642 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-6d0cf654-8a3c-4403-a373-e138e29dfb76 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:06:25.248831 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-6d0cf654-8a3c-4403-a373-e138e29dfb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:06:25.256639 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1453/2921] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:06:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:06:25.261402 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54abbc7-8b0b-4a46-aa9e-98dfda0b3501 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:25.271001 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54abbc7-8b0b-4a46-aa9e-98dfda0b3501 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:25.276159 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc684d-43b3-44c6-ba4c-3b88e1ad3a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:25.276767 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc684d-43b3-44c6-ba4c-3b88e1ad3a55 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:25.277055 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc684d-43b3-44c6-ba4c-3b88e1ad3a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:25.277334 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc684d-43b3-44c6-ba4c-3b88e1ad3a55 admin admin] PATH_INFO: `/v3/domains` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:25.277986 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc684d-43b3-44c6-ba4c-3b88e1ad3a55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 16:06:25.278330 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc684d-43b3-44c6-ba4c-3b88e1ad3a55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:25.279942 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc684d-43b3-44c6-ba4c-3b88e1ad3a55 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:25.291550 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1469/2922] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Sep 7 16:06:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 16:06:25.295787 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0cf654-8a3c-4403-a373-e138e29dfb76 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:25.304839 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0cf654-8a3c-4403-a373-e138e29dfb76 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:25.309969 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a5c9f-f8c5-4b62-a533-f57b5cb28125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:25.310587 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a5c9f-f8c5-4b62-a533-f57b5cb28125 admin admin] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:25.310866 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a5c9f-f8c5-4b62-a533-f57b5cb28125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:25.311136 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a5c9f-f8c5-4b62-a533-f57b5cb28125 admin admin] PATH_INFO: `/v3/projects` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:25.311761 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a5c9f-f8c5-4b62-a533-f57b5cb28125 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:25.313634 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a5c9f-f8c5-4b62-a533-f57b5cb28125 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:25.340948 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1454/2923] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Sep 7 16:06:25 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 16:06:25.345095 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc684d-43b3-44c6-ba4c-3b88e1ad3a55 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:25.355045 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc684d-43b3-44c6-ba4c-3b88e1ad3a55 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:25.411888 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d4f63-3b35-46b9-87b5-addec9019e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:25.412418 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d4f63-3b35-46b9-87b5-addec9019e33 admin admin] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:25.412701 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d4f63-3b35-46b9-87b5-addec9019e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:25.412977 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d4f63-3b35-46b9-87b5-addec9019e33 admin admin] PATH_INFO: `/v3/users` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:25.413609 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d4f63-3b35-46b9-87b5-addec9019e33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:25.415548 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d4f63-3b35-46b9-87b5-addec9019e33 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:25.437100 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1470/2924] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Sep 7 16:06:25 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 16:06:25.441143 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a5c9f-f8c5-4b62-a533-f57b5cb28125 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:25.451445 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a5c9f-f8c5-4b62-a533-f57b5cb28125 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:25.456208 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdbecd5-137f-4f88-8660-08138539eaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:25.456800 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdbecd5-137f-4f88-8660-08138539eaaa admin admin] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:25.457081 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdbecd5-137f-4f88-8660-08138539eaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:25.457356 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdbecd5-137f-4f88-8660-08138539eaaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:25.457987 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdbecd5-137f-4f88-8660-08138539eaaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:25.459610 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdbecd5-137f-4f88-8660-08138539eaaa admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:25.469577 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1455/2925] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:06:25.473387 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d4f63-3b35-46b9-87b5-addec9019e33 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:25.483969 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d4f63-3b35-46b9-87b5-addec9019e33 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:25.488626 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0ed9f-87bd-43b0-bd94-0d99aaf69603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:25.489211 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0ed9f-87bd-43b0-bd94-0d99aaf69603 admin admin] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:25.489491 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0ed9f-87bd-43b0-bd94-0d99aaf69603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:25.489770 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0ed9f-87bd-43b0-bd94-0d99aaf69603 admin admin] PATH_INFO: `/v3/roles` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:25.490517 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de0ed9f-87bd-43b0-bd94-0d99aaf69603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:25.492291 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de0ed9f-87bd-43b0-bd94-0d99aaf69603 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:25.503269 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1471/2926] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Sep 7 16:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 16:06:25.507427 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdbecd5-137f-4f88-8660-08138539eaaa admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:25.517387 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdbecd5-137f-4f88-8660-08138539eaaa admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:25.521899 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9313f1-4661-4f2a-ac92-bdce738ce7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:25.522568 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9313f1-4661-4f2a-ac92-bdce738ce7db admin admin] REQUEST_METHOD: `PUT` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:25.522846 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9313f1-4661-4f2a-ac92-bdce738ce7db admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:25.523119 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9313f1-4661-4f2a-ac92-bdce738ce7db admin admin] PATH_INFO: `/v3/projects/9c3b31ef633a4c5c93f01b372b1c6f59/users/ea67991fe54c4b1d94479611dca8d3bc/roles/d45e39b4ad4e4ce782ec649246438663` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:25.539436 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9313f1-4661-4f2a-ac92-bdce738ce7db admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c3b31ef633a4c5c93f01b372b1c6f59, user_id=ea67991fe54c4b1d94479611dca8d3bc, role_id=d45e39b4ad4e4ce782ec649246438663)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:25.542707 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9313f1-4661-4f2a-ac92-bdce738ce7db admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:25.554998 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1456/2927] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Sep 7 16:06:25 2022] PUT /identity/v3/projects/9c3b31ef633a4c5c93f01b372b1c6f59/users/ea67991fe54c4b1d94479611dca8d3bc/roles/d45e39b4ad4e4ce782ec649246438663 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:06:25.567147 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9abd4-24ce-46bc-bdbc-4d569c25aa64 None None] REQUEST_METHOD: `POST` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:25.567436 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9abd4-24ce-46bc-bdbc-4d569c25aa64 None None] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:25.567709 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9abd4-24ce-46bc-bdbc-4d569c25aa64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:25.596348 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.auth.core [None req-98e9abd4-24ce-46bc-bdbc-4d569c25aa64 None None] MFA Rules not processed for user `ea67991fe54c4b1d94479611dca8d3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:06:25.597618 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-98e9abd4-24ce-46bc-bdbc-4d569c25aa64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:06:25.662256 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1472/2928] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:06:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:06:25.673884 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9313f1-4661-4f2a-ac92-bdce738ce7db admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:25.675809 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-2a9313f1-4661-4f2a-ac92-bdce738ce7db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:06:25.698848 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:06:25.735617 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9313f1-4661-4f2a-ac92-bdce738ce7db admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:25.739228 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e726b-8d1b-4a55-8774-f92cbe67a7d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99f8fac7bf3842cba115fa03ef9291d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:25.739822 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e726b-8d1b-4a55-8774-f92cbe67a7d6 service cinder] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:25.740101 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e726b-8d1b-4a55-8774-f92cbe67a7d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:25.740372 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e726b-8d1b-4a55-8774-f92cbe67a7d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:25.749463 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13e726b-8d1b-4a55-8774-f92cbe67a7d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:25.750936 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13e726b-8d1b-4a55-8774-f92cbe67a7d6 service cinder] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:25.759551 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1457/2929] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:06:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:06:27.455650 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9abd4-24ce-46bc-bdbc-4d569c25aa64 None None] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:27.457521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-98e9abd4-24ce-46bc-bdbc-4d569c25aa64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:06:27.482342 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:06:27.525521 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9abd4-24ce-46bc-bdbc-4d569c25aa64 None None] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:27.531040 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155213c6-979f-42f6-aa4a-02d9adf5d3f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:27.531819 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155213c6-979f-42f6-aa4a-02d9adf5d3f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:27.532204 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155213c6-979f-42f6-aa4a-02d9adf5d3f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:27.532493 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155213c6-979f-42f6-aa4a-02d9adf5d3f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:27.534821 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-155213c6-979f-42f6-aa4a-02d9adf5d3f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:06:27.630843 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155213c6-979f-42f6-aa4a-02d9adf5d3f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:27.633126 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155213c6-979f-42f6-aa4a-02d9adf5d3f3 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:27.644484 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1473/2930] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:06:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:06:28.843944 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e726b-8d1b-4a55-8774-f92cbe67a7d6 service cinder] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:28.845705 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-c13e726b-8d1b-4a55-8774-f92cbe67a7d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:06:28.858938 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e726b-8d1b-4a55-8774-f92cbe67a7d6 service cinder] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:28.862705 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2921f00-522a-4cd9-b7f2-c11ae8bb5107 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:28.863334 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2921f00-522a-4cd9-b7f2-c11ae8bb5107 service neutron] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:28.863613 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2921f00-522a-4cd9-b7f2-c11ae8bb5107 service neutron] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:28.863887 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2921f00-522a-4cd9-b7f2-c11ae8bb5107 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:28.865629 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-d2921f00-522a-4cd9-b7f2-c11ae8bb5107 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:06:28.881561 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2921f00-522a-4cd9-b7f2-c11ae8bb5107 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:28.882967 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2921f00-522a-4cd9-b7f2-c11ae8bb5107 service neutron] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:28.895921 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1458/2931] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:06:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 16:06:36.167091 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155213c6-979f-42f6-aa4a-02d9adf5d3f3 service neutron] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:36.235390 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155213c6-979f-42f6-aa4a-02d9adf5d3f3 service neutron] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:36.240439 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1cc8f9-28a2-4395-a698-f87d198ba638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:36.241066 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1cc8f9-28a2-4395-a698-f87d198ba638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:36.241351 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1cc8f9-28a2-4395-a698-f87d198ba638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:36.241632 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1cc8f9-28a2-4395-a698-f87d198ba638 admin admin] PATH_INFO: `/v3/users/ea67991fe54c4b1d94479611dca8d3bc` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:36.242787 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1cc8f9-28a2-4395-a698-f87d198ba638 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea67991fe54c4b1d94479611dca8d3bc)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:36.245131 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1cc8f9-28a2-4395-a698-f87d198ba638 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:36.297790 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-fa1cc8f9-28a2-4395-a698-f87d198ba638 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea67991fe54c4b1d94479611dca8d3bc'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:36.306040 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-fa1cc8f9-28a2-4395-a698-f87d198ba638 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea67991fe54c4b1d94479611dca8d3bc'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:36.307315 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-fa1cc8f9-28a2-4395-a698-f87d198ba638 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea67991fe54c4b1d94479611dca8d3bc'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:36.313320 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:06:36.321881 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-fa1cc8f9-28a2-4395-a698-f87d198ba638 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea67991fe54c4b1d94479611dca8d3bc'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:36.324256 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-fa1cc8f9-28a2-4395-a698-f87d198ba638 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea67991fe54c4b1d94479611dca8d3bc'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:36.359410 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1474/2932] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 16:06:36 2022] DELETE /identity/v3/users/ea67991fe54c4b1d94479611dca8d3bc => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:06:36.364219 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb949da-e35d-48a8-b01f-a69f5fcadcb9 None None] REQUEST_METHOD: `POST` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:36.364740 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb949da-e35d-48a8-b01f-a69f5fcadcb9 None None] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:36.364851 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb949da-e35d-48a8-b01f-a69f5fcadcb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:36.388241 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.auth.core [None req-4fb949da-e35d-48a8-b01f-a69f5fcadcb9 None None] MFA Rules not processed for user `939472ebcad74baeadd29e0d5a82843a`. Rule list: `[]` (Enabled: `True`). {{(pid=81502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 16:06:36.389528 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-4fb949da-e35d-48a8-b01f-a69f5fcadcb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:06:36.468792 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1459/2933] 10.222.0.16 () {58 vars in 958 bytes} [Wed Sep 7 16:06:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 16:06:36.481097 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1cc8f9-28a2-4395-a698-f87d198ba638 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:36.483021 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-fa1cc8f9-28a2-4395-a698-f87d198ba638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:06:36.573409 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1cc8f9-28a2-4395-a698-f87d198ba638 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:36.577779 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626676a7-c653-4ae5-bc19-5e4621260cf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3195fa62961c4d64972b88449d013380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:36.578535 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626676a7-c653-4ae5-bc19-5e4621260cf5 service neutron] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:36.578898 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626676a7-c653-4ae5-bc19-5e4621260cf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:36.579622 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626676a7-c653-4ae5-bc19-5e4621260cf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:36.592479 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626676a7-c653-4ae5-bc19-5e4621260cf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:36.593939 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626676a7-c653-4ae5-bc19-5e4621260cf5 service neutron] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:36.609382 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1475/2934] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:06:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:06:36.923204 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb949da-e35d-48a8-b01f-a69f5fcadcb9 None None] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:36.924920 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-4fb949da-e35d-48a8-b01f-a69f5fcadcb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:06:36.943774 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626676a7-c653-4ae5-bc19-5e4621260cf5 service neutron] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:36.945299 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-626676a7-c653-4ae5-bc19-5e4621260cf5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:06:36.961281 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626676a7-c653-4ae5-bc19-5e4621260cf5 service neutron] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:36.966545 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9c92b-7478-425e-9d97-f9dc9aedfaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:36.967358 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9c92b-7478-425e-9d97-f9dc9aedfaa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:36.967753 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9c92b-7478-425e-9d97-f9dc9aedfaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:36.968240 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9c92b-7478-425e-9d97-f9dc9aedfaa1 admin admin] PATH_INFO: `/v3/projects/9c3b31ef633a4c5c93f01b372b1c6f59` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:36.969509 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb9c92b-7478-425e-9d97-f9dc9aedfaa1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c3b31ef633a4c5c93f01b372b1c6f59)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:36.973391 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb9c92b-7478-425e-9d97-f9dc9aedfaa1 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:37.024192 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb949da-e35d-48a8-b01f-a69f5fcadcb9 None None] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:37.042838 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-3fb9c92b-7478-425e-9d97-f9dc9aedfaa1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c3b31ef633a4c5c93f01b372b1c6f59', 'request_id': 'req-3fb9c92b-7478-425e-9d97-f9dc9aedfaa1'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:37.050096 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-3fb9c92b-7478-425e-9d97-f9dc9aedfaa1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c3b31ef633a4c5c93f01b372b1c6f59', 'request_id': 'req-3fb9c92b-7478-425e-9d97-f9dc9aedfaa1'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:37.056342 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-3fb9c92b-7478-425e-9d97-f9dc9aedfaa1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c3b31ef633a4c5c93f01b372b1c6f59', 'request_id': 'req-3fb9c92b-7478-425e-9d97-f9dc9aedfaa1'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:37.072157 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-3fb9c92b-7478-425e-9d97-f9dc9aedfaa1 admin admin] The token cache is being invalidate because project 9c3b31ef633a4c5c93f01b372b1c6f59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:06:37.072454 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-3fb9c92b-7478-425e-9d97-f9dc9aedfaa1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:37.073103 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-3fb9c92b-7478-425e-9d97-f9dc9aedfaa1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:37.075606 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1476/2935] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 16:06:36 2022] DELETE /identity/v3/projects/9c3b31ef633a4c5c93f01b372b1c6f59 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 16:06:37.076482 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9c92b-7478-425e-9d97-f9dc9aedfaa1 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:37.077830 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-3fb9c92b-7478-425e-9d97-f9dc9aedfaa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:06:37.092546 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=100 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:06:37.111634 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e20d70a-c929-4ca3-8010-14cdc32b8cc4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c270b488024605af84e52d874474e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:37.112498 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20d70a-c929-4ca3-8010-14cdc32b8cc4 service placement] REQUEST_METHOD: `GET` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:37.112854 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20d70a-c929-4ca3-8010-14cdc32b8cc4 service placement] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:37.113210 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20d70a-c929-4ca3-8010-14cdc32b8cc4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:37.115441 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-8e20d70a-c929-4ca3-8010-14cdc32b8cc4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:06:37.128891 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e20d70a-c929-4ca3-8010-14cdc32b8cc4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:37.130658 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e20d70a-c929-4ca3-8010-14cdc32b8cc4 service placement] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:37.142827 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1460/2936] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:06:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:06:37.160562 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9c92b-7478-425e-9d97-f9dc9aedfaa1 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:37.171558 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c14cdc1-2cc8-4d96-bc7e-1263f6fe7242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:37.172290 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14cdc1-2cc8-4d96-bc7e-1263f6fe7242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:37.172643 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14cdc1-2cc8-4d96-bc7e-1263f6fe7242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:37.172929 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14cdc1-2cc8-4d96-bc7e-1263f6fe7242 admin admin] PATH_INFO: `/v3/users/2f6d0f4c6d99493191e3e0a7da7e88bb` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:37.174930 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c14cdc1-2cc8-4d96-bc7e-1263f6fe7242 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f6d0f4c6d99493191e3e0a7da7e88bb)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:37.176993 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c14cdc1-2cc8-4d96-bc7e-1263f6fe7242 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:37.183321 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:06:37.233246 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-4c14cdc1-2cc8-4d96-bc7e-1263f6fe7242 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f6d0f4c6d99493191e3e0a7da7e88bb'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:37.241911 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-4c14cdc1-2cc8-4d96-bc7e-1263f6fe7242 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f6d0f4c6d99493191e3e0a7da7e88bb'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:37.242782 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-4c14cdc1-2cc8-4d96-bc7e-1263f6fe7242 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f6d0f4c6d99493191e3e0a7da7e88bb'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:37.256343 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-4c14cdc1-2cc8-4d96-bc7e-1263f6fe7242 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f6d0f4c6d99493191e3e0a7da7e88bb'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:37.257122 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-4c14cdc1-2cc8-4d96-bc7e-1263f6fe7242 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f6d0f4c6d99493191e3e0a7da7e88bb'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:37.270317 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1477/2937] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 16:06:37 2022] DELETE /identity/v3/users/2f6d0f4c6d99493191e3e0a7da7e88bb => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:06:37.452352 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e20d70a-c929-4ca3-8010-14cdc32b8cc4 service placement] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:37.463663 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e20d70a-c929-4ca3-8010-14cdc32b8cc4 service placement] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:37.520257 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9fe696-bf6a-4f79-8b28-35ecba7d1250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:37.520936 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fe696-bf6a-4f79-8b28-35ecba7d1250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:37.521167 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fe696-bf6a-4f79-8b28-35ecba7d1250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:37.521439 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fe696-bf6a-4f79-8b28-35ecba7d1250 admin admin] PATH_INFO: `/v3/projects/724d220e9813474a95a94134b4d1644b` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:37.522583 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9fe696-bf6a-4f79-8b28-35ecba7d1250 admin admin] RBAC: Authorizing `identity:delete_project(project_id=724d220e9813474a95a94134b4d1644b)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:37.524517 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9fe696-bf6a-4f79-8b28-35ecba7d1250 admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:37.570837 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-4d9fe696-bf6a-4f79-8b28-35ecba7d1250 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '724d220e9813474a95a94134b4d1644b', 'request_id': 'req-4d9fe696-bf6a-4f79-8b28-35ecba7d1250'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:37.576900 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-4d9fe696-bf6a-4f79-8b28-35ecba7d1250 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '724d220e9813474a95a94134b4d1644b', 'request_id': 'req-4d9fe696-bf6a-4f79-8b28-35ecba7d1250'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:37.582977 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-4d9fe696-bf6a-4f79-8b28-35ecba7d1250 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '724d220e9813474a95a94134b4d1644b', 'request_id': 'req-4d9fe696-bf6a-4f79-8b28-35ecba7d1250'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:37.596330 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-4d9fe696-bf6a-4f79-8b28-35ecba7d1250 admin admin] The token cache is being invalidate because project 724d220e9813474a95a94134b4d1644b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:06:37.596657 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-4d9fe696-bf6a-4f79-8b28-35ecba7d1250 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:37.597414 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-4d9fe696-bf6a-4f79-8b28-35ecba7d1250 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:37.599001 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1461/2938] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 16:06:37 2022] DELETE /identity/v3/projects/724d220e9813474a95a94134b4d1644b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:06:37.603161 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c14cdc1-2cc8-4d96-bc7e-1263f6fe7242 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:37.605165 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-4c14cdc1-2cc8-4d96-bc7e-1263f6fe7242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:06:37.618510 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c14cdc1-2cc8-4d96-bc7e-1263f6fe7242 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:37.674789 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1dccc0-d0bb-4a6c-81dc-63655cabbbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:37.675414 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1dccc0-d0bb-4a6c-81dc-63655cabbbf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:37.675693 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1dccc0-d0bb-4a6c-81dc-63655cabbbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:37.675965 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1dccc0-d0bb-4a6c-81dc-63655cabbbf0 admin admin] PATH_INFO: `/v3/users/ba9f12d80ee44d0da623dc9f81dd2afe` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:37.677086 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1dccc0-d0bb-4a6c-81dc-63655cabbbf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba9f12d80ee44d0da623dc9f81dd2afe)` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:37.679021 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1dccc0-d0bb-4a6c-81dc-63655cabbbf0 admin admin] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:37.724492 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-da1dccc0-d0bb-4a6c-81dc-63655cabbbf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba9f12d80ee44d0da623dc9f81dd2afe'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:37.732449 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-da1dccc0-d0bb-4a6c-81dc-63655cabbbf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba9f12d80ee44d0da623dc9f81dd2afe'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:37.733289 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-da1dccc0-d0bb-4a6c-81dc-63655cabbbf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba9f12d80ee44d0da623dc9f81dd2afe'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:37.745773 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-da1dccc0-d0bb-4a6c-81dc-63655cabbbf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba9f12d80ee44d0da623dc9f81dd2afe'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:37.746429 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.notifications [None req-da1dccc0-d0bb-4a6c-81dc-63655cabbbf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba9f12d80ee44d0da623dc9f81dd2afe'} {{(pid=81501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:37.758394 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1478/2939] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Sep 7 16:06:37 2022] DELETE /identity/v3/users/ba9f12d80ee44d0da623dc9f81dd2afe => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:06:37.929696 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9fe696-bf6a-4f79-8b28-35ecba7d1250 admin admin] Authenticating user token {{(pid=81502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:06:37.931130 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.fernet_utils [None req-4d9fe696-bf6a-4f79-8b28-35ecba7d1250 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:06:37.945764 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9fe696-bf6a-4f79-8b28-35ecba7d1250 admin admin] Validating token access rules against request {{(pid=81502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:06:38.008610 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b0c07-3fbb-44b0-83fd-8a69d1d671ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939472ebcad74baeadd29e0d5a82843a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddba81771a254b1699bec72cf0d93f2d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:06:38.009429 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b0c07-3fbb-44b0-83fd-8a69d1d671ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:06:38.009745 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b0c07-3fbb-44b0-83fd-8a69d1d671ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:06:38.010168 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b0c07-3fbb-44b0-83fd-8a69d1d671ae admin admin] PATH_INFO: `/v3/projects/00502c98c90940c781534f6ac1a9a891` {{(pid=81502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:06:38.011552 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b0c07-3fbb-44b0-83fd-8a69d1d671ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=00502c98c90940c781534f6ac1a9a891)` {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:06:38.013736 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b0c07-3fbb-44b0-83fd-8a69d1d671ae admin admin] RBAC: Authorization granted {{(pid=81502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:06:38.030971 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:06:38.067039 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-5e8b0c07-3fbb-44b0-83fd-8a69d1d671ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00502c98c90940c781534f6ac1a9a891', 'request_id': 'req-5e8b0c07-3fbb-44b0-83fd-8a69d1d671ae'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:38.073483 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-5e8b0c07-3fbb-44b0-83fd-8a69d1d671ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00502c98c90940c781534f6ac1a9a891', 'request_id': 'req-5e8b0c07-3fbb-44b0-83fd-8a69d1d671ae'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:38.079907 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-5e8b0c07-3fbb-44b0-83fd-8a69d1d671ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00502c98c90940c781534f6ac1a9a891', 'request_id': 'req-5e8b0c07-3fbb-44b0-83fd-8a69d1d671ae'} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:38.092905 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-5e8b0c07-3fbb-44b0-83fd-8a69d1d671ae admin admin] The token cache is being invalidate because project 00502c98c90940c781534f6ac1a9a891 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 16:06:38.093189 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-5e8b0c07-3fbb-44b0-83fd-8a69d1d671ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:38.093799 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG keystone.notifications [None req-5e8b0c07-3fbb-44b0-83fd-8a69d1d671ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 16:06:38.095361 dv-cinder-853315-8-smb devstack@keystone.service[81502]: [pid: 81502|app: 0|req: 1462/2940] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Sep 7 16:06:37 2022] DELETE /identity/v3/projects/00502c98c90940c781534f6ac1a9a891 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 16:06:47.754945 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=77,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:06:48.089919 dv-cinder-853315-8-smb devstack@keystone.service[81502]: DEBUG dbcounter [-] [81502] Writing DB stats keystone:SELECT=18,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 16:09:23.619856 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1dccc0-d0bb-4a6c-81dc-63655cabbbf0 admin admin] Authenticating user token {{(pid=81501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 16:09:23.621257 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-da1dccc0-d0bb-4a6c-81dc-63655cabbbf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:09:23.692442 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1dccc0-d0bb-4a6c-81dc-63655cabbbf0 admin admin] Validating token access rules against request {{(pid=81501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 16:09:23.753236 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032010e8-91b9-4e77-98bb-cdae83196c1d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c270b488024605af84e52d874474e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '488830167943488f85743236584113d7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 16:09:23.753867 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032010e8-91b9-4e77-98bb-cdae83196c1d service placement] REQUEST_METHOD: `GET` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 16:09:23.754146 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032010e8-91b9-4e77-98bb-cdae83196c1d service placement] SCRIPT_NAME: `/identity` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 16:09:23.754451 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032010e8-91b9-4e77-98bb-cdae83196c1d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 16:09:23.756151 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.fernet_utils [None req-032010e8-91b9-4e77-98bb-cdae83196c1d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 16:09:23.767883 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032010e8-91b9-4e77-98bb-cdae83196c1d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 16:09:23.769458 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032010e8-91b9-4e77-98bb-cdae83196c1d service placement] RBAC: Authorization granted {{(pid=81501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 16:09:23.779118 dv-cinder-853315-8-smb devstack@keystone.service[81501]: [pid: 81501|app: 0|req: 1479/2941] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Sep 7 16:09:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 16:09:33.775028 dv-cinder-853315-8-smb devstack@keystone.service[81501]: DEBUG dbcounter [-] [81501] Writing DB stats keystone:SELECT=58 {{(pid=81501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}